-- Logs begin at Tue 2022-03-29 19:26:09 UTC, end at Tue 2022-03-29 20:38:10 UTC. -- Mar 29 20:00:26.596040 dv-cinder-784815-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Mar 29 20:00:26.603272 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Mar 29 20:00:26.605280 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Mar 29 20:00:26 2022] *** Mar 29 20:00:26.605280 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 29 20:00:26.605280 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 29 20:00:26.605280 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: nodename: dv-cinder-784815-3-iscsi Mar 29 20:00:26.605280 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: machine: x86_64 Mar 29 20:00:26.606317 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: clock source: unix Mar 29 20:00:26.606317 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: pcre jit disabled Mar 29 20:00:26.606317 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: detected number of CPU cores: 4 Mar 29 20:00:26.606317 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: current working directory: / Mar 29 20:00:26.606317 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: detected binary path: /usr/bin/uwsgi-core Mar 29 20:00:26.606317 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: your processes number limit is 47680 Mar 29 20:00:26.606317 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: your memory page size is 4096 bytes Mar 29 20:00:26.606317 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: detected max file descriptor number: 2048 Mar 29 20:00:26.606317 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: lock engine: pthread robust mutexes Mar 29 20:00:26.607018 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: thunder lock: enabled Mar 29 20:00:26.607018 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Mar 29 20:00:26.607018 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Mar 29 20:00:26.652365 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: Python main interpreter initialized at 0x5617604799c0 Mar 29 20:00:26.652365 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: python threads support enabled Mar 29 20:00:26.652365 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: your server socket listen backlog is limited to 100 connections Mar 29 20:00:26.652365 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: your mercy for graceful operations on workers is 90 seconds Mar 29 20:00:26.652736 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: mapped 403077 bytes (393 KB) for 2 cores Mar 29 20:00:26.652811 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: *** Operational MODE: preforking *** Mar 29 20:00:26.653058 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: *** uWSGI is running in multiple interpreter mode *** Mar 29 20:00:26.653058 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: spawned uWSGI master process (pid: 80085) Mar 29 20:00:26.653262 dv-cinder-784815-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Mar 29 20:00:26.655035 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: spawned uWSGI worker 1 (pid: 80092, cores: 1) Mar 29 20:00:26.655035 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: spawned uWSGI worker 2 (pid: 80093, cores: 1) Mar 29 20:00:26.655035 dv-cinder-784815-3-iscsi devstack@keystone.service[80085]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 29 20:00:32.554964 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 29 20:00:32.554964 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: from cryptography.utils import int_from_bytes Mar 29 20:00:32.555758 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 29 20:00:32.555758 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: from cryptography.utils import int_from_bytes Mar 29 20:00:32.556176 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 29 20:00:32.556176 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: from cryptography.utils import int_from_bytes Mar 29 20:00:32.556289 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 29 20:00:32.556289 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: from cryptography.utils import int_from_bytes Mar 29 20:00:32.602091 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 29 20:00:32.602279 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 29 20:00:32.602462 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] command line args: [] {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 29 20:00:32.602734 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 29 20:00:32.602914 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ================================================================================ {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 29 20:00:32.603170 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] admin_token = **** {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.603421 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] config_dir = [] {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.603548 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 29 20:00:32.603634 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.603757 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 29 20:00:32.603847 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] config_source = [] {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.603950 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] debug = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.604032 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] command line args: [] {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 29 20:00:32.604151 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.604410 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 29 20:00:32.604410 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ================================================================================ {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 29 20:00:32.604531 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.604664 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] admin_token = **** {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.604753 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.604878 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] config_dir = [] {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.604964 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.605081 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.605157 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.605257 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] config_source = [] {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.605413 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] list_limit = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.605496 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] debug = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.605611 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] log_config_append = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.605708 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.605835 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.605937 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.606039 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] log_dir = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.606142 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.606236 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] log_file = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.606947 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.607555 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.607555 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.607837 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.607922 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.608039 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] list_limit = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.608039 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] log_config_append = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.608221 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.608312 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.608390 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.608471 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] log_dir = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.608595 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.608671 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] log_file = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.608789 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.608865 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.608985 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.609068 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.609145 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.609258 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.609355 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.609437 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.609578 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.609652 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.609722 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.609836 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.609917 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.609988 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.610065 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.610143 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.610219 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.610341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.610454 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.610687 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.610816 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.610892 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] publish_errors = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.611011 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.611085 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.611205 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.611310 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.611387 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.611507 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.611656 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.611735 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.611944 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.612151 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.612229 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] standard_threads = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.612337 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] publish_errors = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.612467 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.612629 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.612708 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.612790 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.612870 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.612947 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] use_journal = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.613017 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.613119 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] use_json = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.613196 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.613314 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] use_stderr = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.613442 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.613527 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] use_syslog = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.613679 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] standard_threads = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.613756 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.613912 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.614013 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.614155 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.614233 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.614334 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.614441 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.614518 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] use_journal = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.614676 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] use_json = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.614763 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.614854 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] use_stderr = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.614930 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.615066 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] use_syslog = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.615148 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.615384 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.615466 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 20:00:32.615623 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.615744 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.615871 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.616077 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.616159 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.616359 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.616440 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.616599 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.616801 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.616877 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.617074 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.617159 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.617342 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.617511 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.617589 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.617828 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.617919 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.618087 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.618199 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.618343 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.618459 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.618590 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.618719 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.618828 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.619069 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.619151 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.619336 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.619412 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.619596 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.619726 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.619847 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.620052 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.620130 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.620300 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.620430 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.620515 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.620756 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.620837 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.621007 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.621083 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.621257 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.621482 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.621570 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.621733 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.621815 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.622027 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.622571 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.622664 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.622664 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.622803 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.622879 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.622954 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.623037 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.623187 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.623270 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.623425 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.623580 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.623656 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.623878 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.623945 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.624110 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.624265 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.624331 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.624567 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.624641 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.624816 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.624893 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.625047 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.625212 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.625307 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.625496 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.625576 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.625752 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.625835 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.625985 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.626061 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.626223 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.626300 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.626452 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.626527 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.626690 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.626768 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.626928 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.627007 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.627164 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.627243 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.627399 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.627475 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.627639 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.627726 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.627871 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.627949 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.628103 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.628179 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.628336 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.628424 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.628569 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.628653 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.628800 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.628884 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.629034 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.629120 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.629283 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.629406 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.629536 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.629613 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.629772 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.629859 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.630002 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.630077 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.630239 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.630315 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.630477 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.630562 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.630730 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.630807 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.630963 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.631040 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.631199 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.631351 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.631426 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.631496 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.631657 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.631734 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.631900 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.631985 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.632136 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.632213 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.632367 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.632442 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.632610 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.632693 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.632843 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.632919 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.633078 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.633153 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.633326 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.633447 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.633564 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.633641 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.633799 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.633876 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.634032 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.634124 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.634271 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.634361 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.634509 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.634583 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.634744 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.634818 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.634988 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.635073 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.635226 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.635303 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.635462 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.635539 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.635700 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.635784 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.635933 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.636010 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.636165 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.636248 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.636397 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.636483 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.636634 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.636711 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.636864 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.636940 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.637106 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.637184 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.637362 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.637440 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.637776 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.638232 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.638325 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.638400 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.638470 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.638540 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.638540 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.638665 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.638665 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.638800 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.638870 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] auth.external = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.638946 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.639080 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.639159 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.639346 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.639425 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.639592 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.639670 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.639823 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] auth.password = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.639900 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.640053 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] auth.token = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.640144 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.640290 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.640373 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.640523 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.640601 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.640756 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.640877 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.640985 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.641061 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.641219 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.641321 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.641477 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.641558 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.641713 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.641799 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.641950 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.642027 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] credential.caching = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.642194 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.642271 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.642431 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.642510 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.642677 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.642753 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.642913 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.642991 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.643157 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.643236 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.643388 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] auth.external = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.643464 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.643622 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.643700 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.643888 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.643967 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.644126 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.644204 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.644358 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] auth.password = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.644435 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.644580 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] auth.token = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.644663 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.644817 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.644896 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.645054 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.645137 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.645314 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.645397 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.645554 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.645634 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.645809 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.645888 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] federation.caching = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.646067 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.646148 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.646300 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.646378 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.646536 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] credential.caching = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.646614 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.646766 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.646856 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.647013 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.647098 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.647252 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.647331 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.647485 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.647564 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.647732 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.647812 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.647968 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.648047 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.648208 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.648286 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.648453 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.648532 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.648690 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] identity.caching = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.648769 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.648935 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.649015 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.649181 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.649259 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.649444 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.649539 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.649679 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.649758 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.649928 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.650006 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.650160 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.650246 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.650397 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.650476 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] federation.caching = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.650646 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.650723 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.650891 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.650976 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.651123 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.651200 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.651355 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.651433 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.651586 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.651672 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.651829 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.651908 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.652076 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.652161 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.652312 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.652404 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.652570 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.652649 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.652809 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.652891 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.653057 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.653689 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.653926 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.654330 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] identity.caching = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.654406 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.654477 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.654549 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.654634 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.654710 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.654780 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.654850 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.654964 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.655045 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.655216 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.655302 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.655451 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.655538 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.655691 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.655769 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.655919 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.655998 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.656166 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.656244 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.656410 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.656486 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.656643 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.656722 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.656875 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.656954 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.657119 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.657197 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.657375 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.657458 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.657615 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.657692 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.657846 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.657926 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.658088 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.658168 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.658324 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.658408 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.658566 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.658651 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.658804 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.658883 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.659038 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.659114 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.659276 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.659355 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.659510 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.659590 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.659739 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.659815 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.659970 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.660048 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.660208 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.660287 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.660452 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.660529 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.660681 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.660765 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.660915 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.660991 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.661149 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.661227 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.661405 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.user = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.661502 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.661648 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.661727 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.661907 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.661985 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.662139 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.662225 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.662387 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.662465 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.662618 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.662698 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.662856 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.662942 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.663090 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.663166 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.663320 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.663398 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.663556 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.663640 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.663787 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.663864 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.664022 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.664100 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.664252 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.664337 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.664498 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.664576 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.664726 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.664802 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.664976 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.665061 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.665218 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.665322 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.665476 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.665554 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.665708 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.665796 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.665947 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.666023 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.666178 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.user = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.666256 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.666411 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.666496 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.666648 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.666727 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.666882 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.666960 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.667128 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.667212 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.667372 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.667449 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.667609 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.667731 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.667843 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.667997 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.668073 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.668145 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.668297 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.668376 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.668533 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.668620 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.669398 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.669920 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.669920 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.670068 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.670140 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.670225 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.670300 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.670370 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.670441 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.670511 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.670668 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.670756 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.670913 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] resource.caching = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.670992 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.671167 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.671245 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.671418 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.671506 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.671659 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.671738 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.671897 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.671975 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.672137 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.672224 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.672373 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.672450 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.672617 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.672695 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.672853 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.672938 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.673094 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.673173 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.673351 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] role.caching = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.673432 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.673601 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] role.driver = sql {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.673692 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.673834 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.673913 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.674071 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.674148 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.674309 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.674396 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.674548 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.674627 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.674793 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.674870 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.675035 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.675114 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.675270 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.675348 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.675509 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.675587 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.675751 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] resource.caching = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.675831 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.675982 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.676059 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.676230 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.676308 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.676470 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.676555 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.676722 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.676800 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.676970 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.677047 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.677204 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.677398 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.677480 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.677642 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.677721 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.677899 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.677988 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.678155 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] role.caching = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.678232 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.678405 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] role.driver = sql {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.678483 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.678637 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.678724 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.678882 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.678959 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.679129 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.679207 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.679378 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.679464 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.679619 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.679696 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.679855 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.679934 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.680090 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.680176 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.680331 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.680409 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.680578 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.680654 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.680812 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.680899 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.681061 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.681140 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.681342 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.681424 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.681562 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.681652 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.681794 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.681873 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.682032 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] token.caching = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.682202 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.682288 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.682443 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.682523 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.682696 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.682775 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.682948 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.683035 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.683199 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.683278 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.683437 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.683520 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.683675 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.683763 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.683917 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.683994 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.684164 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.684244 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.684425 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.684510 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.685049 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.685134 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.685206 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.685278 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.685374 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.685461 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.685538 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.685609 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.685673 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.685743 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.685851 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.685940 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.686092 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.686171 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.686330 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.686408 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] database.connection = **** {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.686564 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.686651 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.686800 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] token.caching = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.686880 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.687037 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.687116 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.687285 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.687363 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.687524 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.687605 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.687759 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.687836 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.687995 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.688072 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.688238 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.688318 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.688480 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.688556 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.688713 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.688790 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.688956 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.689036 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.689190 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.689267 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.689453 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.689536 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.689687 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.689766 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.689933 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.690047 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.690160 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.690249 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.690396 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.690475 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.690630 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.690707 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.690800 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 29 20:00:32.690929 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.691194 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] database.connection = **** {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.691442 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.691690 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.691929 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.692171 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.692407 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.692644 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.692880 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.693119 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.693390 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.693629 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.693883 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.694121 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.694368 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.694605 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.694852 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.695084 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.695326 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.695562 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 20:00:32.695733 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 29 20:00:32.723574 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.723807 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.724240 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.726528 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.726767 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.726999 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.733683 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.736416 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.762023 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.762257 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.763294 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.763798 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.819632 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.819792 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.869914 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.870153 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.871146 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.871387 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.938809 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.939045 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.939191 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.939281 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.939427 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.939514 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.939651 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.939744 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.939871 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.939954 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.940087 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.940303 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.965151 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.965369 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.965464 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.965544 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.965712 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.966356 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.966455 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.966586 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.966658 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.966970 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.967053 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.967125 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.967201 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.967422 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.992283 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:32.993027 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:33.005464 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:33.005719 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:33.005921 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:33.006142 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:33.006290 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:33.006428 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:33.006548 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:33.006673 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:33.006798 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:33.006920 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:33.007041 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:33.007181 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:33.007355 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:33.007570 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 20:00:33.024922 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.025131 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 29 20:00:33.025243 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.025471 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 29 20:00:33.025560 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.025675 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 29 20:00:33.025807 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.025940 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.026027 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 29 20:00:33.026197 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.026281 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.026451 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.026533 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.026699 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.026783 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.026989 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.038273 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.038413 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.038550 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.038687 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.038816 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.038952 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.039089 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.039227 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.047363 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.047823 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.050637 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.050918 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.051081 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.051203 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.051356 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.051486 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.051633 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.051768 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.051913 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.052033 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.052191 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.052301 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.052447 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.052574 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.052711 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.052843 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.052981 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.053112 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.053250 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.053404 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.053540 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.053800 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.080431 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.081593 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.082011 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.082288 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.083175 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.083450 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.087499 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.087775 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.088170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.088629 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.089017 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.089316 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.095948 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.096228 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.097558 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.097836 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.100638 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.100922 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.101202 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.101506 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.101782 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.102056 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.102247 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.102329 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.102530 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.102613 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.102807 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.103085 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.103352 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.103616 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.103878 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.104139 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.121098 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.121411 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.124209 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.124480 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.126493 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.129004 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.130119 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.130412 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.132608 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.132992 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.135524 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.138496 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.139286 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.142107 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.142923 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.143220 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.143506 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.143789 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.144071 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.144362 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.145720 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.146015 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.146294 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.146572 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.146856 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.147139 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.164325 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.164620 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.164888 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.165149 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.167462 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.167741 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.168003 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.168267 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.173772 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.175460 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.175731 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.177095 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.178794 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.178918 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.179066 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.179206 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.179487 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.179769 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.180051 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.182184 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.182462 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.182749 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.183040 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.183316 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.193499 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.193783 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.194063 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.194342 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.194626 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.194995 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.195284 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.196979 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.197244 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.197554 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.197831 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.199323 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.199865 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.200617 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.213362 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.217509 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.219476 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.220777 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.222695 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.223588 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.225209 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.225510 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.225790 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.225963 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.233613 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.235269 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.238614 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.238915 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.332641 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.334266 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.334549 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.334829 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.339136 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.339475 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.343312 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.344898 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.348295 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.348577 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.348852 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.349124 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.349262 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.349575 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.349865 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.357833 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.358264 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.358545 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.358784 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.358871 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.359069 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.359154 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.359341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.359426 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.359622 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.359892 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.360165 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.360440 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.360718 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.360979 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.361240 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.361529 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.367138 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 20:00:33.367417 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.367790 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.368063 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.368340 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.368606 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.368885 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.369159 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.369453 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.369718 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.369989 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.370257 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.370516 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.370769 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 20:00:33.399411 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5617604799c0 pid: 80093 (default app) Mar 29 20:00:33.402817 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40eb0d2-99c2-4338-945d-4c31c4cd39d9 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:33.403631 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40eb0d2-99c2-4338-945d-4c31c4cd39d9 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:33.403996 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40eb0d2-99c2-4338-945d-4c31c4cd39d9 None None] PATH_INFO: `/v3` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:33.408195 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Tue Mar 29 20:00:33 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:00:33.410388 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5617604799c0 pid: 80092 (default app) Mar 29 20:00:42.493054 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3c8e9-4a77-4bb1-ac26-4d4841612725 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:42.493662 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3c8e9-4a77-4bb1-ac26-4d4841612725 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:42.493662 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3c8e9-4a77-4bb1-ac26-4d4841612725 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:42.495706 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 2/2] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:00:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:00:42.504075 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7beeef5-71f1-4681-b9b8-dad8167514ba None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:42.504524 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7beeef5-71f1-4681-b9b8-dad8167514ba None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:42.504626 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7beeef5-71f1-4681-b9b8-dad8167514ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:42.534816 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG oslo_db.sqlalchemy.engines [None req-b7beeef5-71f1-4681-b9b8-dad8167514ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80092) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 29 20:00:42.720126 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG passlib.handlers.bcrypt [None req-b7beeef5-71f1-4681-b9b8-dad8167514ba None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=80092) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 29 20:00:42.720539 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG passlib.handlers.bcrypt [None req-b7beeef5-71f1-4681-b9b8-dad8167514ba None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80092) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 29 20:00:42.780910 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-b7beeef5-71f1-4681-b9b8-dad8167514ba None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:00:42.782471 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b7beeef5-71f1-4681-b9b8-dad8167514ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:00:42.908965 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1/3] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:00:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Mar 29 20:00:43.066941 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3c8e9-4a77-4bb1-ac26-4d4841612725 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:43.100418 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG oslo_db.sqlalchemy.engines [None req-87a3c8e9-4a77-4bb1-ac26-4d4841612725 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80093) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 29 20:00:43.228198 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3c8e9-4a77-4bb1-ac26-4d4841612725 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:43.233064 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b23651-1877-463c-a0a7-d0024ade079c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:43.233752 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b23651-1877-463c-a0a7-d0024ade079c admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:43.234038 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b23651-1877-463c-a0a7-d0024ade079c admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:43.234315 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b23651-1877-463c-a0a7-d0024ade079c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:43.242286 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b23651-1877-463c-a0a7-d0024ade079c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:43.293810 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.common.rbac_enforcer.enforcer [None req-60b23651-1877-463c-a0a7-d0024ade079c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 29 20:00:43.294149 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b23651-1877-463c-a0a7-d0024ade079c admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:43.304175 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 3/4] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Mar 29 20:00:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 20:00:43.310331 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7beeef5-71f1-4681-b9b8-dad8167514ba None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:43.325267 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7beeef5-71f1-4681-b9b8-dad8167514ba None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:43.330376 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ee870-eec1-467b-a2c0-a56a54b30a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:43.331484 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ee870-eec1-467b-a2c0-a56a54b30a5f admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:43.331769 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ee870-eec1-467b-a2c0-a56a54b30a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:43.332046 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ee870-eec1-467b-a2c0-a56a54b30a5f admin admin] PATH_INFO: `/v3/projects/a15fd3ff4f1b47218a3a97159af6b6bb` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:43.333690 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ee870-eec1-467b-a2c0-a56a54b30a5f admin admin] RBAC: Authorizing `identity:get_project(project_id=a15fd3ff4f1b47218a3a97159af6b6bb)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:43.385933 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a22ee870-eec1-467b-a2c0-a56a54b30a5f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 29 20:00:43.386277 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ee870-eec1-467b-a2c0-a56a54b30a5f admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:43.391449 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 2/5] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Mar 29 20:00:43 2022] GET /identity/v3/projects/a15fd3ff4f1b47218a3a97159af6b6bb => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:00:45.641047 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5322c22-0359-479d-9380-7c593ba6307f None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:45.641593 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5322c22-0359-479d-9380-7c593ba6307f None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:45.641694 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5322c22-0359-479d-9380-7c593ba6307f None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:45.646177 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 4/6] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:00:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:00:45.651481 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074ed49-7e94-4d81-b3ba-fd2900a9eeae None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:45.651904 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074ed49-7e94-4d81-b3ba-fd2900a9eeae None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:45.652041 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074ed49-7e94-4d81-b3ba-fd2900a9eeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:45.671451 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-8074ed49-7e94-4d81-b3ba-fd2900a9eeae None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:00:45.672965 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-8074ed49-7e94-4d81-b3ba-fd2900a9eeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:00:45.680751 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 3/7] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:00:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Mar 29 20:00:45.703619 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5322c22-0359-479d-9380-7c593ba6307f None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:45.715618 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5322c22-0359-479d-9380-7c593ba6307f None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:45.720569 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285a128-6a71-43e2-9889-16d97c1ab0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:45.721196 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285a128-6a71-43e2-9889-16d97c1ab0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:45.721508 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285a128-6a71-43e2-9889-16d97c1ab0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:45.721792 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285a128-6a71-43e2-9889-16d97c1ab0b3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:45.729309 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285a128-6a71-43e2-9889-16d97c1ab0b3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:45.731091 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285a128-6a71-43e2-9889-16d97c1ab0b3 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:45.740217 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 5/8] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Mar 29 20:00:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 20:00:45.745468 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074ed49-7e94-4d81-b3ba-fd2900a9eeae None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:45.755233 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074ed49-7e94-4d81-b3ba-fd2900a9eeae None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:45.759623 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f6538-04e9-4000-8638-9112acea1052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:45.760518 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f6538-04e9-4000-8638-9112acea1052 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:45.760804 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f6538-04e9-4000-8638-9112acea1052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:45.761086 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f6538-04e9-4000-8638-9112acea1052 admin admin] PATH_INFO: `/v3/users/5c0f0cae62ee4c75b41e0ef37bc31d07` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:45.762498 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f6538-04e9-4000-8638-9112acea1052 admin admin] RBAC: Authorizing `identity:get_user(user_id=5c0f0cae62ee4c75b41e0ef37bc31d07)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:45.764526 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f6538-04e9-4000-8638-9112acea1052 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:45.766108 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 4/9] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Mar 29 20:00:45 2022] GET /identity/v3/users/5c0f0cae62ee4c75b41e0ef37bc31d07 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:00:48.138531 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635acfe-bb17-4aad-81b6-5fd6bdd433dc None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:48.139524 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635acfe-bb17-4aad-81b6-5fd6bdd433dc None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:48.139524 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635acfe-bb17-4aad-81b6-5fd6bdd433dc None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:48.140944 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 6/10] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:00:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:00:48.143292 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03dbd74-c7bf-4e0f-92be-6843545a898f None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:48.143726 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03dbd74-c7bf-4e0f-92be-6843545a898f None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:48.143871 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03dbd74-c7bf-4e0f-92be-6843545a898f None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:48.145824 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff4c10-a177-4574-96ce-14397d9c44eb None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:48.145929 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 5/11] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:00:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:00:48.146157 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff4c10-a177-4574-96ce-14397d9c44eb None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:48.146396 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff4c10-a177-4574-96ce-14397d9c44eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:48.150935 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb06db-7dae-462c-aa17-2e721d8608dd None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:48.151232 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb06db-7dae-462c-aa17-2e721d8608dd None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:48.151522 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb06db-7dae-462c-aa17-2e721d8608dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:48.168543 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-20fb06db-7dae-462c-aa17-2e721d8608dd None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:00:48.170394 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-20fb06db-7dae-462c-aa17-2e721d8608dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:00:48.187946 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG passlib.handlers.bcrypt [None req-d7ff4c10-a177-4574-96ce-14397d9c44eb None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=80093) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 29 20:00:48.188291 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG passlib.handlers.bcrypt [None req-d7ff4c10-a177-4574-96ce-14397d9c44eb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80093) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 29 20:00:48.235444 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-d7ff4c10-a177-4574-96ce-14397d9c44eb None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:00:48.237031 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-d7ff4c10-a177-4574-96ce-14397d9c44eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:00:48.247419 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 20:00:48.269728 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb06db-7dae-462c-aa17-2e721d8608dd None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:48.333715 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 20:00:48.358176 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff4c10-a177-4574-96ce-14397d9c44eb None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:48.367585 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb06db-7dae-462c-aa17-2e721d8608dd None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:48.400293 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccf637-8df9-4faf-9066-4d0a421dd7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:48.400954 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccf637-8df9-4faf-9066-4d0a421dd7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:48.401238 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccf637-8df9-4faf-9066-4d0a421dd7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:48.401555 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccf637-8df9-4faf-9066-4d0a421dd7c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:48.453596 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff4c10-a177-4574-96ce-14397d9c44eb None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:48.465401 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaccf637-8df9-4faf-9066-4d0a421dd7c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:48.467050 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaccf637-8df9-4faf-9066-4d0a421dd7c1 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:48.485531 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08882baf-ae90-474a-968f-8e696c5f51cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:48.486567 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08882baf-ae90-474a-968f-8e696c5f51cc None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:48.486865 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08882baf-ae90-474a-968f-8e696c5f51cc None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:48.487141 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08882baf-ae90-474a-968f-8e696c5f51cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:48.499160 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08882baf-ae90-474a-968f-8e696c5f51cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:00:48.506169 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-08882baf-ae90-474a-968f-8e696c5f51cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:00:48.507364 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 8/14] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:00:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:00:48.512968 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08882baf-ae90-474a-968f-8e696c5f51cc None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:48.562022 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 7/15] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:00:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 29 20:00:48.567601 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccf637-8df9-4faf-9066-4d0a421dd7c1 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:48.610094 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08882baf-ae90-474a-968f-8e696c5f51cc None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:48.642158 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab9ed1-db8e-416f-bb1b-b5ab7f2cd77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:48.642833 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab9ed1-db8e-416f-bb1b-b5ab7f2cd77a None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:48.643124 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab9ed1-db8e-416f-bb1b-b5ab7f2cd77a None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:48.643408 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab9ed1-db8e-416f-bb1b-b5ab7f2cd77a None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:48.644163 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab9ed1-db8e-416f-bb1b-b5ab7f2cd77a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:00:48.644475 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab9ed1-db8e-416f-bb1b-b5ab7f2cd77a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:48.645951 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab9ed1-db8e-416f-bb1b-b5ab7f2cd77a None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:48.658193 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 9/16] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:00:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:00:48.660468 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccf637-8df9-4faf-9066-4d0a421dd7c1 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:48.663676 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab9ed1-db8e-416f-bb1b-b5ab7f2cd77a None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:48.692481 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3424c-3e5c-4c17-9f6a-cc6858e86ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:48.693384 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3424c-3e5c-4c17-9f6a-cc6858e86ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:48.693667 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3424c-3e5c-4c17-9f6a-cc6858e86ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:48.693941 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3424c-3e5c-4c17-9f6a-cc6858e86ca1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:48.704502 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3424c-3e5c-4c17-9f6a-cc6858e86ca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:48.705961 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3424c-3e5c-4c17-9f6a-cc6858e86ca1 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:48.722782 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-02e3424c-3e5c-4c17-9f6a-cc6858e86ca1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:00:48.723957 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 8/17] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:00:48.729683 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3424c-3e5c-4c17-9f6a-cc6858e86ca1 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:48.760482 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab9ed1-db8e-416f-bb1b-b5ab7f2cd77a None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:48.793903 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048c7cb-df69-4eec-995d-e591aedf8f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:48.794888 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048c7cb-df69-4eec-995d-e591aedf8f05 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:48.795258 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048c7cb-df69-4eec-995d-e591aedf8f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:48.795551 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048c7cb-df69-4eec-995d-e591aedf8f05 None admin] PATH_INFO: `/v3/users/5c0f0cae62ee4c75b41e0ef37bc31d07` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:48.797141 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0048c7cb-df69-4eec-995d-e591aedf8f05 None admin] RBAC: Authorizing `identity:get_user(user_id=5c0f0cae62ee4c75b41e0ef37bc31d07)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:48.798640 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0048c7cb-df69-4eec-995d-e591aedf8f05 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:48.800437 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 10/18] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:00:48 2022] GET /identity/v3/users/5c0f0cae62ee4c75b41e0ef37bc31d07 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:00:48.805655 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048c7cb-df69-4eec-995d-e591aedf8f05 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:48.824946 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3424c-3e5c-4c17-9f6a-cc6858e86ca1 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:48.858652 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca63603-07dc-4fdf-b2ed-9d28a7d71123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:48.859311 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca63603-07dc-4fdf-b2ed-9d28a7d71123 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:48.859591 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca63603-07dc-4fdf-b2ed-9d28a7d71123 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:48.859874 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca63603-07dc-4fdf-b2ed-9d28a7d71123 None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:48.860586 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca63603-07dc-4fdf-b2ed-9d28a7d71123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:00:48.860894 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca63603-07dc-4fdf-b2ed-9d28a7d71123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:48.862344 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca63603-07dc-4fdf-b2ed-9d28a7d71123 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:48.879711 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 9/19] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:00:48.904280 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048c7cb-df69-4eec-995d-e591aedf8f05 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:48.941384 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed2c48-f7c0-48f9-a73d-27b2d7f530f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:48.942226 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed2c48-f7c0-48f9-a73d-27b2d7f530f5 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:48.942509 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed2c48-f7c0-48f9-a73d-27b2d7f530f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:48.942784 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed2c48-f7c0-48f9-a73d-27b2d7f530f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:48.944097 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed2c48-f7c0-48f9-a73d-27b2d7f530f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:48.945623 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed2c48-f7c0-48f9-a73d-27b2d7f530f5 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:48.947277 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 11/20] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:00:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:00:48.954808 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca63603-07dc-4fdf-b2ed-9d28a7d71123 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:49.056480 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca63603-07dc-4fdf-b2ed-9d28a7d71123 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:49.092022 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b6db3-d86f-4783-b135-39a5d6b0c8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:49.092694 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b6db3-d86f-4783-b135-39a5d6b0c8af None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:49.092980 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b6db3-d86f-4783-b135-39a5d6b0c8af None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:49.093263 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b6db3-d86f-4783-b135-39a5d6b0c8af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:49.094129 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b6db3-d86f-4783-b135-39a5d6b0c8af None admin] RBAC: Adding query filter params (role.id=8cfa924df1a1400986d9ecc9686a7f52, scope.domain.id=default, user.id=5c0f0cae62ee4c75b41e0ef37bc31d07) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:00:49.094447 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b6db3-d86f-4783-b135-39a5d6b0c8af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:49.096026 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b6db3-d86f-4783-b135-39a5d6b0c8af None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:49.102684 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 10/21] 10.222.0.43 () {56 vars in 1322 bytes} [Tue Mar 29 20:00:48 2022] GET /identity/v3/role_assignments?user.id=5c0f0cae62ee4c75b41e0ef37bc31d07&scope.domain.id=default&role.id=8cfa924df1a1400986d9ecc9686a7f52 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:00:51.675417 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7311e-cfc5-4aaa-85b5-42180525f53c None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:51.675940 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7311e-cfc5-4aaa-85b5-42180525f53c None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:51.676038 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7311e-cfc5-4aaa-85b5-42180525f53c None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:51.678068 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 12/22] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:00:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:00:51.683357 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c0c07-ee07-4c79-b27d-ab10ebb38823 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:51.683790 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c0c07-ee07-4c79-b27d-ab10ebb38823 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:51.683911 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c0c07-ee07-4c79-b27d-ab10ebb38823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:51.709522 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-fd1c0c07-ee07-4c79-b27d-ab10ebb38823 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:00:51.711054 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-fd1c0c07-ee07-4c79-b27d-ab10ebb38823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:00:51.816121 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 11/23] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:00:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:00:51.858787 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7311e-cfc5-4aaa-85b5-42180525f53c None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:51.983354 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64618c4-d240-4b21-9e87-4a39b5e60062 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:51.983667 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7311e-cfc5-4aaa-85b5-42180525f53c None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:51.984183 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64618c4-d240-4b21-9e87-4a39b5e60062 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:51.984673 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64618c4-d240-4b21-9e87-4a39b5e60062 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:51.986698 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 12/24] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:00:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:00:51.992500 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcad799-532c-4dca-a046-883e1c77820e None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:51.993020 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcad799-532c-4dca-a046-883e1c77820e None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:51.993551 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcad799-532c-4dca-a046-883e1c77820e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:52.024779 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87dd80-4a36-4d52-abd1-f22bd64c42b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:52.025436 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87dd80-4a36-4d52-abd1-f22bd64c42b9 None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:52.025726 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87dd80-4a36-4d52-abd1-f22bd64c42b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:52.026008 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87dd80-4a36-4d52-abd1-f22bd64c42b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:52.026765 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87dd80-4a36-4d52-abd1-f22bd64c42b9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:52.028148 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87dd80-4a36-4d52-abd1-f22bd64c42b9 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:52.037946 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-bdcad799-532c-4dca-a046-883e1c77820e None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:00:52.039205 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-bdcad799-532c-4dca-a046-883e1c77820e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:00:52.108004 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 13/25] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:00:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 20:00:52.109117 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fee22d-2d59-41fe-b999-3c0122ccb25c None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:52.109434 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fee22d-2d59-41fe-b999-3c0122ccb25c None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:52.109784 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fee22d-2d59-41fe-b999-3c0122ccb25c None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:52.111783 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 14/26] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:00:52.116970 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed811e-9713-4619-b72c-2638043f7fe7 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:52.117262 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed811e-9713-4619-b72c-2638043f7fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:52.117572 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed811e-9713-4619-b72c-2638043f7fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:52.142351 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-47ed811e-9713-4619-b72c-2638043f7fe7 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:00:52.143532 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-47ed811e-9713-4619-b72c-2638043f7fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:00:52.268548 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 15/27] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:00:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 20:00:52.269182 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed811e-9713-4619-b72c-2638043f7fe7 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:52.272611 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 13/28] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Mar 29 20:00:51 2022] POST /identity/v3/roles => generated 219 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:00:52.274315 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c988142-95b6-4f71-b631-c3e899c1cd72 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:52.274767 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c988142-95b6-4f71-b631-c3e899c1cd72 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:52.275190 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c988142-95b6-4f71-b631-c3e899c1cd72 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:52.277683 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 14/29] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:00:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:00:52.289329 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743aa6eb-42ba-4566-8dad-cd343fc0db7f None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:52.289329 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743aa6eb-42ba-4566-8dad-cd343fc0db7f None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:52.289329 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743aa6eb-42ba-4566-8dad-cd343fc0db7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:52.317045 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-743aa6eb-42ba-4566-8dad-cd343fc0db7f None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:00:52.318623 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-743aa6eb-42ba-4566-8dad-cd343fc0db7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:00:52.413586 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed811e-9713-4619-b72c-2638043f7fe7 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:52.453400 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0daa69-440b-42a9-8d5e-d4ae39811bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:52.454225 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0daa69-440b-42a9-8d5e-d4ae39811bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:52.454511 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0daa69-440b-42a9-8d5e-d4ae39811bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:52.454791 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0daa69-440b-42a9-8d5e-d4ae39811bd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:52.468665 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0daa69-440b-42a9-8d5e-d4ae39811bd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:00:52.475843 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-2a0daa69-440b-42a9-8d5e-d4ae39811bd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:00:52.477444 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 16/30] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:00:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:00:52.478233 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0daa69-440b-42a9-8d5e-d4ae39811bd4 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:52.488383 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 15/31] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:00:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:00:52.489587 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743aa6eb-42ba-4566-8dad-cd343fc0db7f None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:52.637709 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0daa69-440b-42a9-8d5e-d4ae39811bd4 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:52.637888 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743aa6eb-42ba-4566-8dad-cd343fc0db7f None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:52.675264 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94ad10-2f1d-4f1e-ab54-2472d52c31db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:52.677097 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94ad10-2f1d-4f1e-ab54-2472d52c31db None admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:52.677433 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94ad10-2f1d-4f1e-ab54-2472d52c31db None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:52.677824 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94ad10-2f1d-4f1e-ab54-2472d52c31db None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:52.678751 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f94ad10-2f1d-4f1e-ab54-2472d52c31db None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:52.680518 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f94ad10-2f1d-4f1e-ab54-2472d52c31db None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:52.680804 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944159ab-b4b3-48b7-ad00-c146db7f9442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:52.681515 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944159ab-b4b3-48b7-ad00-c146db7f9442 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:52.681803 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944159ab-b4b3-48b7-ad00-c146db7f9442 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:52.682081 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944159ab-b4b3-48b7-ad00-c146db7f9442 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:52.682845 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944159ab-b4b3-48b7-ad00-c146db7f9442 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:00:52.683155 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944159ab-b4b3-48b7-ad00-c146db7f9442 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:52.684852 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944159ab-b4b3-48b7-ad00-c146db7f9442 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:52.694837 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 16/32] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:00:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:00:52.695918 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944159ab-b4b3-48b7-ad00-c146db7f9442 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:52.803882 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944159ab-b4b3-48b7-ad00-c146db7f9442 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:52.838711 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87199c5-60e1-4170-8932-6e2ad79ab071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:52.839904 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87199c5-60e1-4170-8932-6e2ad79ab071 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:52.840338 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87199c5-60e1-4170-8932-6e2ad79ab071 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:52.840816 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87199c5-60e1-4170-8932-6e2ad79ab071 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:52.865963 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87199c5-60e1-4170-8932-6e2ad79ab071 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:52.867715 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87199c5-60e1-4170-8932-6e2ad79ab071 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:52.886554 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-b87199c5-60e1-4170-8932-6e2ad79ab071 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:00:52.888550 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 17/33] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:00:52.894527 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87199c5-60e1-4170-8932-6e2ad79ab071 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:52.901544 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 17/34] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Mar 29 20:00:52 2022] POST /identity/v3/roles => generated 225 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:00:52.902814 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94ad10-2f1d-4f1e-ab54-2472d52c31db None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:53.011499 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87199c5-60e1-4170-8932-6e2ad79ab071 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:53.019389 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94ad10-2f1d-4f1e-ab54-2472d52c31db None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:53.049707 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fc46a-4978-4b0c-a6e6-f0769a710438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:53.050597 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fc46a-4978-4b0c-a6e6-f0769a710438 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:53.050890 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fc46a-4978-4b0c-a6e6-f0769a710438 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:53.051180 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fc46a-4978-4b0c-a6e6-f0769a710438 None admin] PATH_INFO: `/v3/users/5c0f0cae62ee4c75b41e0ef37bc31d07` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:53.052429 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fc46a-4978-4b0c-a6e6-f0769a710438 None admin] RBAC: Authorizing `identity:get_user(user_id=5c0f0cae62ee4c75b41e0ef37bc31d07)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:53.054101 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fc46a-4978-4b0c-a6e6-f0769a710438 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:53.056182 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 18/35] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:00:52 2022] GET /identity/v3/users/5c0f0cae62ee4c75b41e0ef37bc31d07 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:00:53.062177 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85faae-8058-42a3-91f6-c3094610c05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:53.062874 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85faae-8058-42a3-91f6-c3094610c05b None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:53.063167 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85faae-8058-42a3-91f6-c3094610c05b None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:53.063450 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85faae-8058-42a3-91f6-c3094610c05b None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:53.064196 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85faae-8058-42a3-91f6-c3094610c05b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:00:53.064510 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85faae-8058-42a3-91f6-c3094610c05b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:53.066067 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85faae-8058-42a3-91f6-c3094610c05b None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:53.066525 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fc46a-4978-4b0c-a6e6-f0769a710438 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:53.082678 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 18/36] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:00:53.089435 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85faae-8058-42a3-91f6-c3094610c05b None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:53.199900 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fc46a-4978-4b0c-a6e6-f0769a710438 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:53.214481 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85faae-8058-42a3-91f6-c3094610c05b None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:53.239637 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c93542-d9a4-4d8a-b310-e89e86120b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:53.240820 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c93542-d9a4-4d8a-b310-e89e86120b10 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:53.241334 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c93542-d9a4-4d8a-b310-e89e86120b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:53.242450 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c93542-d9a4-4d8a-b310-e89e86120b10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:53.244257 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c93542-d9a4-4d8a-b310-e89e86120b10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:53.246780 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c93542-d9a4-4d8a-b310-e89e86120b10 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:53.250545 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 19/37] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:00:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:00:53.252197 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc961a-7485-4ff8-aacc-7a648bdface1 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:53.252777 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc961a-7485-4ff8-aacc-7a648bdface1 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:53.253276 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc961a-7485-4ff8-aacc-7a648bdface1 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:53.255908 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 20/38] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:00:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:00:53.257980 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc961a-7485-4ff8-aacc-7a648bdface1 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:53.262780 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887826b-7ba4-4aae-ad53-dde4d12467a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:53.264129 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887826b-7ba4-4aae-ad53-dde4d12467a9 None admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:53.264419 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887826b-7ba4-4aae-ad53-dde4d12467a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:53.264703 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887826b-7ba4-4aae-ad53-dde4d12467a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:53.265490 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887826b-7ba4-4aae-ad53-dde4d12467a9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:53.266965 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887826b-7ba4-4aae-ad53-dde4d12467a9 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:53.367529 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 19/39] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Mar 29 20:00:53 2022] POST /identity/v3/projects => generated 301 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:00:53.368868 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fa226-f30b-4c49-91ac-67b746f4e567 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:53.369161 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fa226-f30b-4c49-91ac-67b746f4e567 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:53.369478 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fa226-f30b-4c49-91ac-67b746f4e567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:53.387302 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc961a-7485-4ff8-aacc-7a648bdface1 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:53.395515 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-be1fa226-f30b-4c49-91ac-67b746f4e567 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:00:53.397683 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-be1fa226-f30b-4c49-91ac-67b746f4e567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:00:53.432811 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be1455-64ef-40e2-b66e-48b3e4f0f14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:53.433753 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be1455-64ef-40e2-b66e-48b3e4f0f14c None admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:53.434104 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be1455-64ef-40e2-b66e-48b3e4f0f14c None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:53.434402 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be1455-64ef-40e2-b66e-48b3e4f0f14c None admin] PATH_INFO: `/v3/domains/default/users/5c0f0cae62ee4c75b41e0ef37bc31d07/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:53.437643 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be1455-64ef-40e2-b66e-48b3e4f0f14c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5c0f0cae62ee4c75b41e0ef37bc31d07, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:53.439166 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be1455-64ef-40e2-b66e-48b3e4f0f14c None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:53.483470 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 20/40] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:00:53.484804 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd25b2f-42ce-4a25-9ab5-16d2daae1e83 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:53.485170 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd25b2f-42ce-4a25-9ab5-16d2daae1e83 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:53.485421 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd25b2f-42ce-4a25-9ab5-16d2daae1e83 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:53.487258 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 21/41] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:00:53.492538 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9698b4-d44c-4e61-8b47-b10d8ae8fe77 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:53.492833 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9698b4-d44c-4e61-8b47-b10d8ae8fe77 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:53.493190 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9698b4-d44c-4e61-8b47-b10d8ae8fe77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:53.511006 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 21/42] 10.222.0.43 () {58 vars in 1361 bytes} [Tue Mar 29 20:00:53 2022] PUT /identity/v3/domains/default/users/5c0f0cae62ee4c75b41e0ef37bc31d07/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:00:53.511925 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be1455-64ef-40e2-b66e-48b3e4f0f14c None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:53.512107 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-bf9698b4-d44c-4e61-8b47-b10d8ae8fe77 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:00:53.514205 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-bf9698b4-d44c-4e61-8b47-b10d8ae8fe77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:00:53.604518 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 22/43] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 20:00:53.630441 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9698b4-d44c-4e61-8b47-b10d8ae8fe77 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:53.673971 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be1455-64ef-40e2-b66e-48b3e4f0f14c None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:53.709075 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4ea34-297c-4f87-8555-f8ffdbaad542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:53.709895 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4ea34-297c-4f87-8555-f8ffdbaad542 None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:53.710080 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4ea34-297c-4f87-8555-f8ffdbaad542 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:53.710353 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4ea34-297c-4f87-8555-f8ffdbaad542 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:53.711110 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4ea34-297c-4f87-8555-f8ffdbaad542 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:53.712509 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4ea34-297c-4f87-8555-f8ffdbaad542 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:53.743623 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9698b4-d44c-4e61-8b47-b10d8ae8fe77 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:53.777756 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492af69-813c-4d72-84fa-87dac74370a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:53.778566 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492af69-813c-4d72-84fa-87dac74370a4 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:53.779458 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492af69-813c-4d72-84fa-87dac74370a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:53.780348 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492af69-813c-4d72-84fa-87dac74370a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:53.781675 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492af69-813c-4d72-84fa-87dac74370a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:53.783138 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492af69-813c-4d72-84fa-87dac74370a4 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:53.784741 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 22/44] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Mar 29 20:00:53 2022] POST /identity/v3/roles => generated 223 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:00:53.784867 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 23/45] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:00:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:00:53.790350 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4ea34-297c-4f87-8555-f8ffdbaad542 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:53.902051 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4ea34-297c-4f87-8555-f8ffdbaad542 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:53.948413 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615442f8-389b-47f4-b70d-05b6f928aa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:53.949369 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615442f8-389b-47f4-b70d-05b6f928aa25 None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:53.949660 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615442f8-389b-47f4-b70d-05b6f928aa25 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:53.949938 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615442f8-389b-47f4-b70d-05b6f928aa25 None admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:53.951218 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615442f8-389b-47f4-b70d-05b6f928aa25 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:53.953845 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615442f8-389b-47f4-b70d-05b6f928aa25 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:54.037834 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 23/46] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Mar 29 20:00:53 2022] POST /identity/v3/projects => generated 312 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:00:55.835013 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd40ce-d290-43a5-9ce7-720135cea1ef None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:55.835563 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd40ce-d290-43a5-9ce7-720135cea1ef None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:55.835563 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd40ce-d290-43a5-9ce7-720135cea1ef None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:55.837376 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 24/47] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:00:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:00:55.842981 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bb19f-5e63-4f9d-b322-2c0124ea4742 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:55.843373 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bb19f-5e63-4f9d-b322-2c0124ea4742 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:55.843672 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bb19f-5e63-4f9d-b322-2c0124ea4742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:55.860801 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-2f3bb19f-5e63-4f9d-b322-2c0124ea4742 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:00:55.862026 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-2f3bb19f-5e63-4f9d-b322-2c0124ea4742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:00:55.926427 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 24/48] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:00:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:00:55.951035 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd40ce-d290-43a5-9ce7-720135cea1ef None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:56.051936 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd40ce-d290-43a5-9ce7-720135cea1ef None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:56.085518 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c21f7-8f25-4602-96bc-77fefe465d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:56.086234 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c21f7-8f25-4602-96bc-77fefe465d59 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:56.086524 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c21f7-8f25-4602-96bc-77fefe465d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:56.086806 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c21f7-8f25-4602-96bc-77fefe465d59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:56.097088 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c21f7-8f25-4602-96bc-77fefe465d59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:00:56.104068 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-9a2c21f7-8f25-4602-96bc-77fefe465d59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:00:56.105242 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 25/49] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:00:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:00:56.111054 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bb19f-5e63-4f9d-b322-2c0124ea4742 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:56.206203 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bb19f-5e63-4f9d-b322-2c0124ea4742 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:56.239084 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713b707-dad6-4f92-96d7-aeb83dd3f684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:56.239750 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713b707-dad6-4f92-96d7-aeb83dd3f684 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:56.240034 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713b707-dad6-4f92-96d7-aeb83dd3f684 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:56.240338 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713b707-dad6-4f92-96d7-aeb83dd3f684 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:56.241113 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713b707-dad6-4f92-96d7-aeb83dd3f684 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:00:56.241442 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713b707-dad6-4f92-96d7-aeb83dd3f684 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:56.242811 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713b707-dad6-4f92-96d7-aeb83dd3f684 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:56.250692 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 25/50] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:00:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:00:56.256238 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c21f7-8f25-4602-96bc-77fefe465d59 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:56.311202 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c9758-cd97-4f59-96fb-75726cc1f9d3 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:56.311496 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c9758-cd97-4f59-96fb-75726cc1f9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:56.311789 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c9758-cd97-4f59-96fb-75726cc1f9d3 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:56.313608 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 26/51] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:00:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:00:56.318295 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf71e88-778b-4421-bfd9-9a7e37778b5b None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:56.318595 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf71e88-778b-4421-bfd9-9a7e37778b5b None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:56.318886 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf71e88-778b-4421-bfd9-9a7e37778b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:56.335844 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-4bf71e88-778b-4421-bfd9-9a7e37778b5b None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:00:56.336990 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-4bf71e88-778b-4421-bfd9-9a7e37778b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:00:56.355123 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c21f7-8f25-4602-96bc-77fefe465d59 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:56.387529 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b46c03-7c2b-4727-b560-86b7fc204fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:56.389460 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b46c03-7c2b-4727-b560-86b7fc204fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:56.389749 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b46c03-7c2b-4727-b560-86b7fc204fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:56.390029 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b46c03-7c2b-4727-b560-86b7fc204fb9 None admin] PATH_INFO: `/v3/users/5c0f0cae62ee4c75b41e0ef37bc31d07` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:56.391208 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b46c03-7c2b-4727-b560-86b7fc204fb9 None admin] RBAC: Authorizing `identity:get_user(user_id=5c0f0cae62ee4c75b41e0ef37bc31d07)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:56.392658 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b46c03-7c2b-4727-b560-86b7fc204fb9 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:56.394295 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 26/52] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:00:56 2022] GET /identity/v3/users/5c0f0cae62ee4c75b41e0ef37bc31d07 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:00:56.399851 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b46c03-7c2b-4727-b560-86b7fc204fb9 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:56.401661 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 27/53] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 20:00:56.424224 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf71e88-778b-4421-bfd9-9a7e37778b5b None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:56.494948 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b46c03-7c2b-4727-b560-86b7fc204fb9 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:56.517473 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf71e88-778b-4421-bfd9-9a7e37778b5b None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:56.527073 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b072598-6791-4073-ae06-4ec579b2b613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:56.527860 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b072598-6791-4073-ae06-4ec579b2b613 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:56.528152 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b072598-6791-4073-ae06-4ec579b2b613 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:56.528428 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b072598-6791-4073-ae06-4ec579b2b613 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:56.530620 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b072598-6791-4073-ae06-4ec579b2b613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:56.532057 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b072598-6791-4073-ae06-4ec579b2b613 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:56.533744 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 27/54] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:00:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:00:56.539428 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b072598-6791-4073-ae06-4ec579b2b613 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:56.551059 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc70b3-312f-4f12-a136-a592f5d17a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:56.551859 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc70b3-312f-4f12-a136-a592f5d17a59 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:56.552151 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc70b3-312f-4f12-a136-a592f5d17a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:56.552434 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc70b3-312f-4f12-a136-a592f5d17a59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:56.553644 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc70b3-312f-4f12-a136-a592f5d17a59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:56.555079 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc70b3-312f-4f12-a136-a592f5d17a59 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:56.556872 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 28/55] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:00:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:00:56.562061 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc70b3-312f-4f12-a136-a592f5d17a59 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:56.634947 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b072598-6791-4073-ae06-4ec579b2b613 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:56.655983 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc70b3-312f-4f12-a136-a592f5d17a59 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:56.666665 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581f49a-f94f-4543-8be7-4197c603f4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:56.667399 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581f49a-f94f-4543-8be7-4197c603f4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:56.667698 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581f49a-f94f-4543-8be7-4197c603f4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:56.667973 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581f49a-f94f-4543-8be7-4197c603f4e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:56.668796 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581f49a-f94f-4543-8be7-4197c603f4e4 None admin] RBAC: Adding query filter params (role.id=8cfa924df1a1400986d9ecc9686a7f52, scope.domain.id=default, user.id=5c0f0cae62ee4c75b41e0ef37bc31d07) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:00:56.669113 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581f49a-f94f-4543-8be7-4197c603f4e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:56.671365 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581f49a-f94f-4543-8be7-4197c603f4e4 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:56.676926 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 28/56] 10.222.0.43 () {56 vars in 1322 bytes} [Tue Mar 29 20:00:56 2022] GET /identity/v3/role_assignments?user.id=5c0f0cae62ee4c75b41e0ef37bc31d07&scope.domain.id=default&role.id=8cfa924df1a1400986d9ecc9686a7f52 => generated 530 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:00:56.689447 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d9363-c169-417c-8b85-7b2e5dcfbfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:56.690140 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d9363-c169-417c-8b85-7b2e5dcfbfb0 None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:56.690433 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d9363-c169-417c-8b85-7b2e5dcfbfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:56.690717 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d9363-c169-417c-8b85-7b2e5dcfbfb0 None admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:56.691460 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d9363-c169-417c-8b85-7b2e5dcfbfb0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:56.692953 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d9363-c169-417c-8b85-7b2e5dcfbfb0 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:56.807623 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 29/57] 10.222.0.43 () {60 vars in 1140 bytes} [Tue Mar 29 20:00:56 2022] POST /identity/v3/projects => generated 298 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:00:59.096388 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b346a-e51e-4dc9-b131-2ad7e7be86cb None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:59.096907 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b346a-e51e-4dc9-b131-2ad7e7be86cb None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:59.097064 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b346a-e51e-4dc9-b131-2ad7e7be86cb None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:59.098908 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 29/58] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:00:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:00:59.103919 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da007d-3a24-46ae-a5aa-6c4c2512fab3 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:59.104299 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da007d-3a24-46ae-a5aa-6c4c2512fab3 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:59.104501 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da007d-3a24-46ae-a5aa-6c4c2512fab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:59.121704 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-76da007d-3a24-46ae-a5aa-6c4c2512fab3 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:00:59.123534 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-76da007d-3a24-46ae-a5aa-6c4c2512fab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:00:59.186920 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 30/59] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:00:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:00:59.210841 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b346a-e51e-4dc9-b131-2ad7e7be86cb None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:59.310918 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b346a-e51e-4dc9-b131-2ad7e7be86cb None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:59.343970 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31b966-2593-44fc-8fbb-83475782da55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:59.344758 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31b966-2593-44fc-8fbb-83475782da55 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:59.345044 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31b966-2593-44fc-8fbb-83475782da55 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:59.345352 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31b966-2593-44fc-8fbb-83475782da55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:59.346573 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31b966-2593-44fc-8fbb-83475782da55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:59.348039 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31b966-2593-44fc-8fbb-83475782da55 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:59.349665 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 30/60] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:00:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:00:59.355069 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da007d-3a24-46ae-a5aa-6c4c2512fab3 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:00:59.450027 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da007d-3a24-46ae-a5aa-6c4c2512fab3 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:00:59.483532 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733dbc4-e08d-4b2e-ae81-997551157694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:00:59.484186 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733dbc4-e08d-4b2e-ae81-997551157694 None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:00:59.484473 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733dbc4-e08d-4b2e-ae81-997551157694 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:00:59.484753 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733dbc4-e08d-4b2e-ae81-997551157694 None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:00:59.485482 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733dbc4-e08d-4b2e-ae81-997551157694 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:00:59.486917 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733dbc4-e08d-4b2e-ae81-997551157694 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:00:59.597884 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 31/61] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Mar 29 20:00:59 2022] POST /identity/v3/users => generated 275 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:01:03.136806 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9de83-4a18-40a1-9b6d-3e6823afceee None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:03.137934 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9de83-4a18-40a1-9b6d-3e6823afceee None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:03.138474 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9de83-4a18-40a1-9b6d-3e6823afceee None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:03.140474 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 31/62] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:03.145935 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e44b93-065d-47b2-979e-6fdb98ff09d8 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:03.146856 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e44b93-065d-47b2-979e-6fdb98ff09d8 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:03.147359 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e44b93-065d-47b2-979e-6fdb98ff09d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:03.166517 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-48e44b93-065d-47b2-979e-6fdb98ff09d8 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:03.168203 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-48e44b93-065d-47b2-979e-6fdb98ff09d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:03.226451 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73157f-1942-46f9-80d3-4ee00a2c9199 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:03.227041 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73157f-1942-46f9-80d3-4ee00a2c9199 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:03.227523 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73157f-1942-46f9-80d3-4ee00a2c9199 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:03.229576 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 32/63] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:03.234836 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d065b8-aded-45fe-8122-e3e60e47a309 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:03.235386 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d065b8-aded-45fe-8122-e3e60e47a309 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:03.235961 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d065b8-aded-45fe-8122-e3e60e47a309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:03.255945 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-54d065b8-aded-45fe-8122-e3e60e47a309 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:03.257583 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-54d065b8-aded-45fe-8122-e3e60e47a309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:03.279891 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 32/64] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:03.322991 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e44b93-065d-47b2-979e-6fdb98ff09d8 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:03.340004 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 33/65] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 20:01:03.358923 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6a61e-c47c-4c6e-9ca6-e80056e925b6 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:03.359228 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6a61e-c47c-4c6e-9ca6-e80056e925b6 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:03.359510 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6a61e-c47c-4c6e-9ca6-e80056e925b6 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:03.361412 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 34/66] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:03.366954 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0e42f-e683-44e4-9452-0d3d0e6f625d None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:03.367570 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0e42f-e683-44e4-9452-0d3d0e6f625d None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:03.368058 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0e42f-e683-44e4-9452-0d3d0e6f625d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:03.386920 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-97e0e42f-e683-44e4-9452-0d3d0e6f625d None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:03.389335 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-97e0e42f-e683-44e4-9452-0d3d0e6f625d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:03.445757 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e44b93-065d-47b2-979e-6fdb98ff09d8 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:03.459556 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 35/67] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 20:01:03.460724 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0e42f-e683-44e4-9452-0d3d0e6f625d None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:03.486145 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d5ea5-b3af-41c2-8f00-5577b1141469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:03.487262 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d5ea5-b3af-41c2-8f00-5577b1141469 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:03.487750 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d5ea5-b3af-41c2-8f00-5577b1141469 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:03.488226 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d5ea5-b3af-41c2-8f00-5577b1141469 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:03.499331 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d5ea5-b3af-41c2-8f00-5577b1141469 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:03.506612 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-df9d5ea5-b3af-41c2-8f00-5577b1141469 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:01:03.508062 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 33/68] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:01:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:01:03.509151 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d5ea5-b3af-41c2-8f00-5577b1141469 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:03.563020 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0e42f-e683-44e4-9452-0d3d0e6f625d None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:03.597672 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7529a89-3bbb-4613-8c51-08a56fcf0be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:03.598479 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7529a89-3bbb-4613-8c51-08a56fcf0be7 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:03.598768 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7529a89-3bbb-4613-8c51-08a56fcf0be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:03.599047 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7529a89-3bbb-4613-8c51-08a56fcf0be7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:03.610741 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7529a89-3bbb-4613-8c51-08a56fcf0be7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:03.612773 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d5ea5-b3af-41c2-8f00-5577b1141469 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:03.618125 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-e7529a89-3bbb-4613-8c51-08a56fcf0be7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 20:01:03.624509 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 36/69] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:03.624509 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7529a89-3bbb-4613-8c51-08a56fcf0be7 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:03.652699 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e73f0-9aae-4bc9-b3fa-5e1e0dc7ecb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:03.653585 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e73f0-9aae-4bc9-b3fa-5e1e0dc7ecb9 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:03.653883 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e73f0-9aae-4bc9-b3fa-5e1e0dc7ecb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:03.654174 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e73f0-9aae-4bc9-b3fa-5e1e0dc7ecb9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:03.664396 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e73f0-9aae-4bc9-b3fa-5e1e0dc7ecb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:03.672584 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-508e73f0-9aae-4bc9-b3fa-5e1e0dc7ecb9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 29 20:01:03.673818 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 34/70] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Mar 29 20:01:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:03.677976 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c016a21-fe26-4256-bbe5-bb43984681f6 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:03.678928 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c016a21-fe26-4256-bbe5-bb43984681f6 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:03.679227 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c016a21-fe26-4256-bbe5-bb43984681f6 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:03.681885 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 35/71] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:03.686373 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c016a21-fe26-4256-bbe5-bb43984681f6 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:03.726667 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7529a89-3bbb-4613-8c51-08a56fcf0be7 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:03.761945 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224934d-c611-44f7-ac89-d64edd9bc771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:03.763159 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224934d-c611-44f7-ac89-d64edd9bc771 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:03.763451 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224934d-c611-44f7-ac89-d64edd9bc771 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:03.763737 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224934d-c611-44f7-ac89-d64edd9bc771 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:03.764495 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224934d-c611-44f7-ac89-d64edd9bc771 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:03.764805 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224934d-c611-44f7-ac89-d64edd9bc771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:03.766303 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224934d-c611-44f7-ac89-d64edd9bc771 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:03.778159 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 37/72] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:03.778159 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224934d-c611-44f7-ac89-d64edd9bc771 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:03.789320 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c016a21-fe26-4256-bbe5-bb43984681f6 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:03.822438 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3aee40-67bd-4eee-a06e-6c3d700f5002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:03.823115 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3aee40-67bd-4eee-a06e-6c3d700f5002 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:03.823408 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3aee40-67bd-4eee-a06e-6c3d700f5002 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:03.823703 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3aee40-67bd-4eee-a06e-6c3d700f5002 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:03.824725 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3aee40-67bd-4eee-a06e-6c3d700f5002 None admin] RBAC: Adding query filter params (name=member) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:03.825098 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3aee40-67bd-4eee-a06e-6c3d700f5002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:03.826523 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3aee40-67bd-4eee-a06e-6c3d700f5002 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:03.834748 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 36/73] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:03.835999 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78601d-4033-4bc3-b8a7-2fa41d99581f None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:03.836298 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78601d-4033-4bc3-b8a7-2fa41d99581f None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:03.836584 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78601d-4033-4bc3-b8a7-2fa41d99581f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:03.852985 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-cf78601d-4033-4bc3-b8a7-2fa41d99581f None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:03.854209 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-cf78601d-4033-4bc3-b8a7-2fa41d99581f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:03.879495 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224934d-c611-44f7-ac89-d64edd9bc771 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:03.912512 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cec56d-8d63-4e0c-8bb0-20ed0edf425a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:03.913181 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cec56d-8d63-4e0c-8bb0-20ed0edf425a None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:03.913499 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cec56d-8d63-4e0c-8bb0-20ed0edf425a None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:03.913785 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cec56d-8d63-4e0c-8bb0-20ed0edf425a None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:03.914531 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cec56d-8d63-4e0c-8bb0-20ed0edf425a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:03.914843 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cec56d-8d63-4e0c-8bb0-20ed0edf425a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:03.916232 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cec56d-8d63-4e0c-8bb0-20ed0edf425a None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:03.918686 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 37/74] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:03.920598 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f66563-fb0d-4a74-9021-a0cb4e668853 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:03.920895 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f66563-fb0d-4a74-9021-a0cb4e668853 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:03.929712 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f66563-fb0d-4a74-9021-a0cb4e668853 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:03.929712 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 38/75] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:03.929712 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f66563-fb0d-4a74-9021-a0cb4e668853 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:03.929973 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 38/76] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:01:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:03.929973 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cec56d-8d63-4e0c-8bb0-20ed0edf425a None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:04.030626 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cec56d-8d63-4e0c-8bb0-20ed0edf425a None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:04.031023 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f66563-fb0d-4a74-9021-a0cb4e668853 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:04.063150 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf2bad-fcea-4f5a-9187-b8295a65819d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:04.063313 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09121eb9-6bc1-47d0-a886-60fbf220f8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:04.064029 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf2bad-fcea-4f5a-9187-b8295a65819d None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:04.064125 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09121eb9-6bc1-47d0-a886-60fbf220f8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:04.064317 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf2bad-fcea-4f5a-9187-b8295a65819d None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:04.064404 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09121eb9-6bc1-47d0-a886-60fbf220f8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:04.064598 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf2bad-fcea-4f5a-9187-b8295a65819d None admin] PATH_INFO: `/v3/users/5c0f0cae62ee4c75b41e0ef37bc31d07` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:04.064695 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09121eb9-6bc1-47d0-a886-60fbf220f8d0 None admin] PATH_INFO: `/v3/users/1aa2a0d7c3c94ca69150064a665859b5` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:04.065818 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf2bad-fcea-4f5a-9187-b8295a65819d None admin] RBAC: Authorizing `identity:get_user(user_id=5c0f0cae62ee4c75b41e0ef37bc31d07)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:04.067274 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf2bad-fcea-4f5a-9187-b8295a65819d None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:04.068874 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 39/77] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:03 2022] GET /identity/v3/users/5c0f0cae62ee4c75b41e0ef37bc31d07 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:04.069835 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf2bad-fcea-4f5a-9187-b8295a65819d None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:04.078809 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09121eb9-6bc1-47d0-a886-60fbf220f8d0 None admin] RBAC: Authorizing `identity:get_user(user_id=1aa2a0d7c3c94ca69150064a665859b5)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:04.080265 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09121eb9-6bc1-47d0-a886-60fbf220f8d0 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:04.081955 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 39/78] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:03 2022] GET /identity/v3/users/1aa2a0d7c3c94ca69150064a665859b5 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:04.083132 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5754b75-8e92-4dc1-93c6-6398f5e11e41 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:04.083418 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5754b75-8e92-4dc1-93c6-6398f5e11e41 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:04.083694 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5754b75-8e92-4dc1-93c6-6398f5e11e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:04.100169 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-e5754b75-8e92-4dc1-93c6-6398f5e11e41 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:04.101387 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e5754b75-8e92-4dc1-93c6-6398f5e11e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:04.166161 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 40/79] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:04.170272 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5754b75-8e92-4dc1-93c6-6398f5e11e41 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:04.170779 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf2bad-fcea-4f5a-9187-b8295a65819d None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:04.204973 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95049ce4-a143-45fc-961f-266051c70e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:04.205874 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95049ce4-a143-45fc-961f-266051c70e93 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:04.206162 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95049ce4-a143-45fc-961f-266051c70e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:04.206441 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95049ce4-a143-45fc-961f-266051c70e93 None admin] PATH_INFO: `/v3/users/1aa2a0d7c3c94ca69150064a665859b5` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:04.207639 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95049ce4-a143-45fc-961f-266051c70e93 None admin] RBAC: Authorizing `identity:get_user(user_id=1aa2a0d7c3c94ca69150064a665859b5)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:04.209120 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95049ce4-a143-45fc-961f-266051c70e93 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:04.210765 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 40/80] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:04 2022] GET /identity/v3/users/1aa2a0d7c3c94ca69150064a665859b5 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:04.210765 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95049ce4-a143-45fc-961f-266051c70e93 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:04.266654 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5754b75-8e92-4dc1-93c6-6398f5e11e41 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:04.299419 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51927c-241a-42bb-834b-376ac163ef1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:04.300247 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51927c-241a-42bb-834b-376ac163ef1a None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:04.300601 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51927c-241a-42bb-834b-376ac163ef1a None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:04.300889 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51927c-241a-42bb-834b-376ac163ef1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:04.304871 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95049ce4-a143-45fc-961f-266051c70e93 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:04.310718 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51927c-241a-42bb-834b-376ac163ef1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:04.317718 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-fd51927c-241a-42bb-834b-376ac163ef1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 20:01:04.318898 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 41/81] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:04.319670 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51927c-241a-42bb-834b-376ac163ef1a None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:04.339184 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50913329-96a9-4942-87b9-1b65eccf4206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:04.339834 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50913329-96a9-4942-87b9-1b65eccf4206 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:04.340124 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50913329-96a9-4942-87b9-1b65eccf4206 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:04.340406 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50913329-96a9-4942-87b9-1b65eccf4206 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:04.404503 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50913329-96a9-4942-87b9-1b65eccf4206 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:04.406002 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50913329-96a9-4942-87b9-1b65eccf4206 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:04.414203 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51927c-241a-42bb-834b-376ac163ef1a None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:04.445787 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e693c-97d7-4a60-b54b-1964f6c9fa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:04.446435 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e693c-97d7-4a60-b54b-1964f6c9fa91 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:04.446729 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e693c-97d7-4a60-b54b-1964f6c9fa91 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:04.447017 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e693c-97d7-4a60-b54b-1964f6c9fa91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:04.498712 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 41/82] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:01:04.499539 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50913329-96a9-4942-87b9-1b65eccf4206 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:04.513483 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e693c-97d7-4a60-b54b-1964f6c9fa91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:04.514955 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e693c-97d7-4a60-b54b-1964f6c9fa91 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:04.593192 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50913329-96a9-4942-87b9-1b65eccf4206 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:04.608069 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 42/83] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:01:04.612813 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e693c-97d7-4a60-b54b-1964f6c9fa91 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:04.626068 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffd014-5422-44ee-8191-680b8fee9f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:04.626861 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffd014-5422-44ee-8191-680b8fee9f62 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:04.627195 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffd014-5422-44ee-8191-680b8fee9f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:04.627435 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffd014-5422-44ee-8191-680b8fee9f62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:04.628607 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fffd014-5422-44ee-8191-680b8fee9f62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:04.630095 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fffd014-5422-44ee-8191-680b8fee9f62 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:04.631686 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 42/84] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:01:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:04.632441 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffd014-5422-44ee-8191-680b8fee9f62 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:04.705170 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e693c-97d7-4a60-b54b-1964f6c9fa91 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:04.729436 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffd014-5422-44ee-8191-680b8fee9f62 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:04.736842 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd0539-d5a6-4ce6-a149-c48c80c070a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:04.737527 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd0539-d5a6-4ce6-a149-c48c80c070a6 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:04.737822 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd0539-d5a6-4ce6-a149-c48c80c070a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:04.738113 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd0539-d5a6-4ce6-a149-c48c80c070a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:04.761926 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2dd61-ce3d-4c5f-9879-4fc9ed052e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:04.762645 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2dd61-ce3d-4c5f-9879-4fc9ed052e71 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:04.762937 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2dd61-ce3d-4c5f-9879-4fc9ed052e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:04.763223 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2dd61-ce3d-4c5f-9879-4fc9ed052e71 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:04.763974 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2dd61-ce3d-4c5f-9879-4fc9ed052e71 None admin] RBAC: Adding query filter params (name=member) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:04.764293 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2dd61-ce3d-4c5f-9879-4fc9ed052e71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:04.765710 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2dd61-ce3d-4c5f-9879-4fc9ed052e71 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:04.773398 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 43/85] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:04.774269 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2dd61-ce3d-4c5f-9879-4fc9ed052e71 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:04.804035 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd0539-d5a6-4ce6-a149-c48c80c070a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:04.805541 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd0539-d5a6-4ce6-a149-c48c80c070a6 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:04.869958 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2dd61-ce3d-4c5f-9879-4fc9ed052e71 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:04.902602 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75446bd-3a3c-4a01-9e11-ee79efc14c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:04.902878 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 43/86] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:01:04.903937 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd0539-d5a6-4ce6-a149-c48c80c070a6 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:04.906160 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75446bd-3a3c-4a01-9e11-ee79efc14c81 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:04.906457 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75446bd-3a3c-4a01-9e11-ee79efc14c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:04.906758 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75446bd-3a3c-4a01-9e11-ee79efc14c81 None admin] PATH_INFO: `/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:04.908033 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75446bd-3a3c-4a01-9e11-ee79efc14c81 None admin] RBAC: Authorizing `identity:get_project(project_id=fec2338df2a64a9a9b5d8a9b527bbf26)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:04.909525 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75446bd-3a3c-4a01-9e11-ee79efc14c81 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:04.911237 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 44/87] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:04 2022] GET /identity/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:04.911981 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75446bd-3a3c-4a01-9e11-ee79efc14c81 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:05.001752 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd0539-d5a6-4ce6-a149-c48c80c070a6 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:05.014797 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75446bd-3a3c-4a01-9e11-ee79efc14c81 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:05.033359 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257d4a2-72c5-45a1-b555-8256e9a9e25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:05.034226 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257d4a2-72c5-45a1-b555-8256e9a9e25f None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:05.034513 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257d4a2-72c5-45a1-b555-8256e9a9e25f None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:05.034800 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257d4a2-72c5-45a1-b555-8256e9a9e25f None admin] PATH_INFO: `/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:05.035983 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257d4a2-72c5-45a1-b555-8256e9a9e25f None admin] RBAC: Authorizing `identity:get_project(project_id=fec2338df2a64a9a9b5d8a9b527bbf26)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:05.037486 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257d4a2-72c5-45a1-b555-8256e9a9e25f None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:05.039160 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 44/88] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:04 2022] GET /identity/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26 => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:05.040061 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257d4a2-72c5-45a1-b555-8256e9a9e25f None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:05.048303 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec9678-9837-4b3a-bd88-23832855c49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:05.048984 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec9678-9837-4b3a-bd88-23832855c49b None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:05.049278 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec9678-9837-4b3a-bd88-23832855c49b None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:05.049603 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec9678-9837-4b3a-bd88-23832855c49b None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:05.050326 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec9678-9837-4b3a-bd88-23832855c49b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:05.051760 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec9678-9837-4b3a-bd88-23832855c49b None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:05.134768 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257d4a2-72c5-45a1-b555-8256e9a9e25f None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:05.164982 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 45/89] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Mar 29 20:01:04 2022] POST /identity/v3/users => generated 289 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:01:05.165872 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec9678-9837-4b3a-bd88-23832855c49b None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:05.171558 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb1f5a-ec9d-4440-9338-093d2041c825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:05.172465 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb1f5a-ec9d-4440-9338-093d2041c825 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:05.172752 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb1f5a-ec9d-4440-9338-093d2041c825 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:05.173034 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb1f5a-ec9d-4440-9338-093d2041c825 None admin] PATH_INFO: `/v3/users/1aa2a0d7c3c94ca69150064a665859b5` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:05.174451 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb1f5a-ec9d-4440-9338-093d2041c825 None admin] RBAC: Authorizing `identity:get_user(user_id=1aa2a0d7c3c94ca69150064a665859b5)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:05.176142 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb1f5a-ec9d-4440-9338-093d2041c825 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:05.182773 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 45/90] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:05 2022] GET /identity/v3/users/1aa2a0d7c3c94ca69150064a665859b5 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:05.182773 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb1f5a-ec9d-4440-9338-093d2041c825 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:05.274510 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec9678-9837-4b3a-bd88-23832855c49b None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:05.284826 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb1f5a-ec9d-4440-9338-093d2041c825 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:05.310376 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7f1f6-21e0-494a-bd4d-057a0fbeb67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:05.311269 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7f1f6-21e0-494a-bd4d-057a0fbeb67a None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:05.311563 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7f1f6-21e0-494a-bd4d-057a0fbeb67a None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:05.311850 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7f1f6-21e0-494a-bd4d-057a0fbeb67a None admin] PATH_INFO: `/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:05.313130 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7f1f6-21e0-494a-bd4d-057a0fbeb67a None admin] RBAC: Authorizing `identity:get_project(project_id=fec2338df2a64a9a9b5d8a9b527bbf26)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:05.314666 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7f1f6-21e0-494a-bd4d-057a0fbeb67a None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:05.321863 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 46/91] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:05 2022] GET /identity/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:05.321863 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7f1f6-21e0-494a-bd4d-057a0fbeb67a None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:05.326360 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964d1c2-470f-4e80-ba90-5033d3fa48b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:05.327045 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964d1c2-470f-4e80-ba90-5033d3fa48b3 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:05.327331 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964d1c2-470f-4e80-ba90-5033d3fa48b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:05.327620 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964d1c2-470f-4e80-ba90-5033d3fa48b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:05.328516 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964d1c2-470f-4e80-ba90-5033d3fa48b3 None admin] RBAC: Adding query filter params (role.id=8cfa924df1a1400986d9ecc9686a7f52, scope.project.id=fec2338df2a64a9a9b5d8a9b527bbf26, user.id=5c0f0cae62ee4c75b41e0ef37bc31d07) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:05.328840 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964d1c2-470f-4e80-ba90-5033d3fa48b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:05.330361 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964d1c2-470f-4e80-ba90-5033d3fa48b3 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:05.336507 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 46/92] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:01:05 2022] GET /identity/v3/role_assignments?user.id=5c0f0cae62ee4c75b41e0ef37bc31d07&scope.project.id=fec2338df2a64a9a9b5d8a9b527bbf26&role.id=8cfa924df1a1400986d9ecc9686a7f52 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:05.337393 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964d1c2-470f-4e80-ba90-5033d3fa48b3 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:05.464948 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7f1f6-21e0-494a-bd4d-057a0fbeb67a None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:05.479595 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964d1c2-470f-4e80-ba90-5033d3fa48b3 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:05.511181 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad6dab-8a15-41d6-b228-bec1a2a57197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:05.511855 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad6dab-8a15-41d6-b228-bec1a2a57197 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:05.512142 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad6dab-8a15-41d6-b228-bec1a2a57197 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:05.512581 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad6dab-8a15-41d6-b228-bec1a2a57197 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:05.513861 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad6dab-8a15-41d6-b228-bec1a2a57197 None admin] RBAC: Adding query filter params (role.id=e49df2a8408b4f5fa7e284575007ce83, scope.project.id=fec2338df2a64a9a9b5d8a9b527bbf26, user.id=1aa2a0d7c3c94ca69150064a665859b5) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:05.514186 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad6dab-8a15-41d6-b228-bec1a2a57197 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:05.515693 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad6dab-8a15-41d6-b228-bec1a2a57197 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:05.524372 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 47/93] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:01:05 2022] GET /identity/v3/role_assignments?user.id=1aa2a0d7c3c94ca69150064a665859b5&scope.project.id=fec2338df2a64a9a9b5d8a9b527bbf26&role.id=e49df2a8408b4f5fa7e284575007ce83 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:05.524926 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d665390-afd9-41bf-b2ff-5f9544d34a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:05.525050 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad6dab-8a15-41d6-b228-bec1a2a57197 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:05.525642 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d665390-afd9-41bf-b2ff-5f9544d34a31 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:05.525934 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d665390-afd9-41bf-b2ff-5f9544d34a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:05.526225 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d665390-afd9-41bf-b2ff-5f9544d34a31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:05.611063 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d665390-afd9-41bf-b2ff-5f9544d34a31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:05.612566 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d665390-afd9-41bf-b2ff-5f9544d34a31 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:05.668872 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad6dab-8a15-41d6-b228-bec1a2a57197 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:05.720047 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf79f5-13d3-44b7-83a1-559fce853854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:05.720652 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf79f5-13d3-44b7-83a1-559fce853854 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:05.720944 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf79f5-13d3-44b7-83a1-559fce853854 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:05.721226 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf79f5-13d3-44b7-83a1-559fce853854 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:05.722109 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf79f5-13d3-44b7-83a1-559fce853854 None admin] RBAC: Adding query filter params (role.id=82747af757b549cbaa39504334f32f9f, scope.project.id=fec2338df2a64a9a9b5d8a9b527bbf26, user.id=1aa2a0d7c3c94ca69150064a665859b5) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:05.722425 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf79f5-13d3-44b7-83a1-559fce853854 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:05.723916 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf79f5-13d3-44b7-83a1-559fce853854 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:05.742013 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 48/94] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:01:05 2022] GET /identity/v3/role_assignments?user.id=1aa2a0d7c3c94ca69150064a665859b5&scope.project.id=fec2338df2a64a9a9b5d8a9b527bbf26&role.id=82747af757b549cbaa39504334f32f9f => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:05.756192 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 47/95] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:01:05.763790 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf79f5-13d3-44b7-83a1-559fce853854 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:05.906664 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf79f5-13d3-44b7-83a1-559fce853854 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:05.953782 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a6859-d7a1-4f66-a231-8ab5cfc3b353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:05.954674 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a6859-d7a1-4f66-a231-8ab5cfc3b353 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:05.954962 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a6859-d7a1-4f66-a231-8ab5cfc3b353 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:05.955241 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a6859-d7a1-4f66-a231-8ab5cfc3b353 None admin] PATH_INFO: `/v3/projects/3328a8fb9c40430098d4cb6799ba7591` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:05.956442 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a6859-d7a1-4f66-a231-8ab5cfc3b353 None admin] RBAC: Authorizing `identity:get_project(project_id=3328a8fb9c40430098d4cb6799ba7591)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:05.957920 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a6859-d7a1-4f66-a231-8ab5cfc3b353 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:05.959776 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 49/96] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:05 2022] GET /identity/v3/projects/3328a8fb9c40430098d4cb6799ba7591 => generated 312 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:05.965669 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d665390-afd9-41bf-b2ff-5f9544d34a31 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:06.114700 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d665390-afd9-41bf-b2ff-5f9544d34a31 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:06.149737 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6731c25-22b1-426b-bb76-63fe554ad997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:06.150401 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6731c25-22b1-426b-bb76-63fe554ad997 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:06.150689 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6731c25-22b1-426b-bb76-63fe554ad997 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:06.150972 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6731c25-22b1-426b-bb76-63fe554ad997 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:06.151795 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6731c25-22b1-426b-bb76-63fe554ad997 None admin] RBAC: Adding query filter params (role.id=e49df2a8408b4f5fa7e284575007ce83, scope.project.id=3328a8fb9c40430098d4cb6799ba7591, user.id=1aa2a0d7c3c94ca69150064a665859b5) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:06.152109 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6731c25-22b1-426b-bb76-63fe554ad997 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:06.154708 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6731c25-22b1-426b-bb76-63fe554ad997 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:06.160229 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 48/97] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:01:05 2022] GET /identity/v3/role_assignments?user.id=1aa2a0d7c3c94ca69150064a665859b5&scope.project.id=3328a8fb9c40430098d4cb6799ba7591&role.id=e49df2a8408b4f5fa7e284575007ce83 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:08.437199 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e5ccf-8606-483f-99cf-97964f9e5226 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:08.437799 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e5ccf-8606-483f-99cf-97964f9e5226 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:08.437799 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e5ccf-8606-483f-99cf-97964f9e5226 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:08.439700 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 50/98] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:08.445229 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7217bd6-2a9c-4e26-ab59-e85dea95d55b None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:08.445720 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7217bd6-2a9c-4e26-ab59-e85dea95d55b None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:08.445802 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7217bd6-2a9c-4e26-ab59-e85dea95d55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:08.468754 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-f7217bd6-2a9c-4e26-ab59-e85dea95d55b None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:08.474018 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-f7217bd6-2a9c-4e26-ab59-e85dea95d55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:08.547317 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 49/99] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:08.583639 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e5ccf-8606-483f-99cf-97964f9e5226 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:08.619191 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7df2e1-5172-47fb-9556-e875925b41cd None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:08.619512 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7df2e1-5172-47fb-9556-e875925b41cd None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:08.619920 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7df2e1-5172-47fb-9556-e875925b41cd None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:08.623782 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 50/100] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:01:08.627523 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d199672-625b-41e2-bd67-94ed369b855e None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:08.627924 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d199672-625b-41e2-bd67-94ed369b855e None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:08.628309 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d199672-625b-41e2-bd67-94ed369b855e None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:08.630315 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 51/101] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:08.634882 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc52f10-3126-4d6e-bc3b-e93383abf385 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:08.635180 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc52f10-3126-4d6e-bc3b-e93383abf385 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:08.635464 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc52f10-3126-4d6e-bc3b-e93383abf385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:08.657532 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-5cc52f10-3126-4d6e-bc3b-e93383abf385 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:08.658883 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-5cc52f10-3126-4d6e-bc3b-e93383abf385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:08.736037 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 52/102] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:08.737763 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f838d-2630-4f45-bfd6-dd8e953b6283 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:08.738062 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f838d-2630-4f45-bfd6-dd8e953b6283 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:08.738347 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f838d-2630-4f45-bfd6-dd8e953b6283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:08.756288 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-012f838d-2630-4f45-bfd6-dd8e953b6283 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:08.757488 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-012f838d-2630-4f45-bfd6-dd8e953b6283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:08.772046 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e5ccf-8606-483f-99cf-97964f9e5226 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:08.838976 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 53/103] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:08.840042 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f838d-2630-4f45-bfd6-dd8e953b6283 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:08.869193 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f17efa-de10-4be0-8110-ac2e7f0696dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:08.870090 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f17efa-de10-4be0-8110-ac2e7f0696dd None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:08.870381 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f17efa-de10-4be0-8110-ac2e7f0696dd None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:08.870661 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f17efa-de10-4be0-8110-ac2e7f0696dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:08.900382 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f17efa-de10-4be0-8110-ac2e7f0696dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:08.907559 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-47f17efa-de10-4be0-8110-ac2e7f0696dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 20:01:08.909007 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 51/104] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:08.916797 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f17efa-de10-4be0-8110-ac2e7f0696dd None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:08.980053 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f838d-2630-4f45-bfd6-dd8e953b6283 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:09.086504 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a514e-ce92-490b-8796-00cadaebf5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:09.087316 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a514e-ce92-490b-8796-00cadaebf5da None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:09.087604 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a514e-ce92-490b-8796-00cadaebf5da None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:09.087888 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a514e-ce92-490b-8796-00cadaebf5da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:09.116482 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a514e-ce92-490b-8796-00cadaebf5da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:09.124670 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-714a514e-ce92-490b-8796-00cadaebf5da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:01:09.139667 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 54/105] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:01:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:09.142671 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a514e-ce92-490b-8796-00cadaebf5da None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:09.189624 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f17efa-de10-4be0-8110-ac2e7f0696dd None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:09.244747 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2433c5-4c7d-4783-9b04-4925c6bafeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:09.245461 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2433c5-4c7d-4783-9b04-4925c6bafeb7 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:09.245805 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2433c5-4c7d-4783-9b04-4925c6bafeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:09.246093 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2433c5-4c7d-4783-9b04-4925c6bafeb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:09.247493 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2433c5-4c7d-4783-9b04-4925c6bafeb7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:09.247811 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2433c5-4c7d-4783-9b04-4925c6bafeb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:09.249307 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2433c5-4c7d-4783-9b04-4925c6bafeb7 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:09.259984 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 52/106] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:09.267959 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2433c5-4c7d-4783-9b04-4925c6bafeb7 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:09.307593 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a514e-ce92-490b-8796-00cadaebf5da None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:09.354578 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc3c15-f477-4f00-b2e6-f2f630bec01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:09.355834 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc3c15-f477-4f00-b2e6-f2f630bec01b None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:09.357222 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc3c15-f477-4f00-b2e6-f2f630bec01b None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:09.357649 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc3c15-f477-4f00-b2e6-f2f630bec01b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:09.370743 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc3c15-f477-4f00-b2e6-f2f630bec01b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:09.379126 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-cdbc3c15-f477-4f00-b2e6-f2f630bec01b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 29 20:01:09.380358 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 55/107] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:09.381778 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e064d59-f74e-4c17-a791-7d81fa6df584 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:09.381917 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e064d59-f74e-4c17-a791-7d81fa6df584 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:09.382165 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e064d59-f74e-4c17-a791-7d81fa6df584 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:09.383831 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 56/108] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:09.384535 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e064d59-f74e-4c17-a791-7d81fa6df584 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:09.386577 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2433c5-4c7d-4783-9b04-4925c6bafeb7 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:09.423128 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b507944-c412-43f6-afae-e4f08e8ddf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:09.423812 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b507944-c412-43f6-afae-e4f08e8ddf74 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:09.424091 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b507944-c412-43f6-afae-e4f08e8ddf74 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:09.424382 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b507944-c412-43f6-afae-e4f08e8ddf74 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:09.425135 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b507944-c412-43f6-afae-e4f08e8ddf74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:09.425480 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b507944-c412-43f6-afae-e4f08e8ddf74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:09.426856 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b507944-c412-43f6-afae-e4f08e8ddf74 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:09.435685 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 53/109] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:09.436780 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998a9b1-18f2-4b07-9e83-91e914aac8a5 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:09.437078 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998a9b1-18f2-4b07-9e83-91e914aac8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:09.441338 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998a9b1-18f2-4b07-9e83-91e914aac8a5 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:09.441338 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 54/110] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:09.441338 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998a9b1-18f2-4b07-9e83-91e914aac8a5 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:09.495469 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e064d59-f74e-4c17-a791-7d81fa6df584 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:09.529327 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003963b-13a5-41f7-9d18-fa87b2f18d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:09.530198 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003963b-13a5-41f7-9d18-fa87b2f18d3c None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:09.530486 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003963b-13a5-41f7-9d18-fa87b2f18d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:09.530769 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003963b-13a5-41f7-9d18-fa87b2f18d3c None admin] PATH_INFO: `/v3/users/1aa2a0d7c3c94ca69150064a665859b5` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:09.531969 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003963b-13a5-41f7-9d18-fa87b2f18d3c None admin] RBAC: Authorizing `identity:get_user(user_id=1aa2a0d7c3c94ca69150064a665859b5)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:09.533475 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003963b-13a5-41f7-9d18-fa87b2f18d3c None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:09.535245 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 57/111] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:09 2022] GET /identity/v3/users/1aa2a0d7c3c94ca69150064a665859b5 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:09.536229 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db9f89-b793-4e8f-a2be-fca364c0006a None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:09.536518 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db9f89-b793-4e8f-a2be-fca364c0006a None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:09.536800 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db9f89-b793-4e8f-a2be-fca364c0006a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:09.538544 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998a9b1-18f2-4b07-9e83-91e914aac8a5 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:09.553250 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-e8db9f89-b793-4e8f-a2be-fca364c0006a None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:09.554457 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e8db9f89-b793-4e8f-a2be-fca364c0006a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:09.574058 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058c549-1e49-4dc1-9f57-3d2f2cc90d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:09.575571 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058c549-1e49-4dc1-9f57-3d2f2cc90d66 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:09.575862 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058c549-1e49-4dc1-9f57-3d2f2cc90d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:09.576145 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058c549-1e49-4dc1-9f57-3d2f2cc90d66 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:09.576898 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058c549-1e49-4dc1-9f57-3d2f2cc90d66 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:09.577213 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058c549-1e49-4dc1-9f57-3d2f2cc90d66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:09.578631 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058c549-1e49-4dc1-9f57-3d2f2cc90d66 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:09.587229 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 55/112] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:09.588032 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058c549-1e49-4dc1-9f57-3d2f2cc90d66 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:09.620768 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 58/113] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:09.622103 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89592e-3df8-4e59-9fed-ea8ed9fc8ccf None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:09.622396 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89592e-3df8-4e59-9fed-ea8ed9fc8ccf None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:09.622680 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89592e-3df8-4e59-9fed-ea8ed9fc8ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:09.645137 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-8f89592e-3df8-4e59-9fed-ea8ed9fc8ccf None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:09.646349 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-8f89592e-3df8-4e59-9fed-ea8ed9fc8ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:09.701286 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058c549-1e49-4dc1-9f57-3d2f2cc90d66 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:09.713930 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 59/114] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:09.723775 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89592e-3df8-4e59-9fed-ea8ed9fc8ccf None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:09.735408 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a19e69-c072-4211-b3d2-ca3ad34fc791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:09.736293 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a19e69-c072-4211-b3d2-ca3ad34fc791 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:09.736581 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a19e69-c072-4211-b3d2-ca3ad34fc791 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:09.736865 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a19e69-c072-4211-b3d2-ca3ad34fc791 None admin] PATH_INFO: `/v3/users/5c0f0cae62ee4c75b41e0ef37bc31d07` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:09.738107 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a19e69-c072-4211-b3d2-ca3ad34fc791 None admin] RBAC: Authorizing `identity:get_user(user_id=5c0f0cae62ee4c75b41e0ef37bc31d07)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:09.739557 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a19e69-c072-4211-b3d2-ca3ad34fc791 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:09.741174 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 56/115] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:09 2022] GET /identity/v3/users/5c0f0cae62ee4c75b41e0ef37bc31d07 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:09.743090 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a19e69-c072-4211-b3d2-ca3ad34fc791 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:09.819575 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89592e-3df8-4e59-9fed-ea8ed9fc8ccf None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:09.839512 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a19e69-c072-4211-b3d2-ca3ad34fc791 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:09.852164 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad63ce-df20-4bba-aa3d-c937451952c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:09.853025 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad63ce-df20-4bba-aa3d-c937451952c7 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:09.853380 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad63ce-df20-4bba-aa3d-c937451952c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:09.853668 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad63ce-df20-4bba-aa3d-c937451952c7 None admin] PATH_INFO: `/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:09.854846 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad63ce-df20-4bba-aa3d-c937451952c7 None admin] RBAC: Authorizing `identity:get_project(project_id=fec2338df2a64a9a9b5d8a9b527bbf26)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:09.856368 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad63ce-df20-4bba-aa3d-c937451952c7 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:09.858090 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 60/116] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:09 2022] GET /identity/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:09.858862 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad63ce-df20-4bba-aa3d-c937451952c7 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:09.873266 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce59ee-13a8-4168-a6c4-f9ec5b1993a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:09.874104 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce59ee-13a8-4168-a6c4-f9ec5b1993a3 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:09.874393 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce59ee-13a8-4168-a6c4-f9ec5b1993a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:09.874674 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce59ee-13a8-4168-a6c4-f9ec5b1993a3 None admin] PATH_INFO: `/v3/users/95a8ae2a89a34376b20b6f07c0123a2d` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:09.889872 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce59ee-13a8-4168-a6c4-f9ec5b1993a3 None admin] RBAC: Authorizing `identity:get_user(user_id=95a8ae2a89a34376b20b6f07c0123a2d)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:09.891318 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce59ee-13a8-4168-a6c4-f9ec5b1993a3 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:09.893187 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 57/117] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:09 2022] GET /identity/v3/users/95a8ae2a89a34376b20b6f07c0123a2d => generated 289 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:09.894207 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b0b99-0c74-4352-abac-7556e1ea1bc4 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:09.894483 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b0b99-0c74-4352-abac-7556e1ea1bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:09.894768 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b0b99-0c74-4352-abac-7556e1ea1bc4 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:09.897634 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 58/118] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:09.897634 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b0b99-0c74-4352-abac-7556e1ea1bc4 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:09.956572 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad63ce-df20-4bba-aa3d-c937451952c7 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:09.989042 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186527d-d9f4-4a09-891d-8e49ab4a40d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:09.989886 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186527d-d9f4-4a09-891d-8e49ab4a40d3 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:09.990179 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186527d-d9f4-4a09-891d-8e49ab4a40d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:09.990457 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186527d-d9f4-4a09-891d-8e49ab4a40d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:09.995551 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b0b99-0c74-4352-abac-7556e1ea1bc4 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:10.000860 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186527d-d9f4-4a09-891d-8e49ab4a40d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:10.008224 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-e186527d-d9f4-4a09-891d-8e49ab4a40d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 29 20:01:10.009428 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 61/119] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Mar 29 20:01:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:10.010548 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186527d-d9f4-4a09-891d-8e49ab4a40d3 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:10.029310 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808c0ca-66dd-42ac-8b4e-bb19cb7f80ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:10.030120 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808c0ca-66dd-42ac-8b4e-bb19cb7f80ea None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:10.030408 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808c0ca-66dd-42ac-8b4e-bb19cb7f80ea None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:10.030687 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808c0ca-66dd-42ac-8b4e-bb19cb7f80ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:10.031857 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808c0ca-66dd-42ac-8b4e-bb19cb7f80ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:10.033322 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808c0ca-66dd-42ac-8b4e-bb19cb7f80ea None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:10.035106 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 59/120] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:01:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:10.035670 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808c0ca-66dd-42ac-8b4e-bb19cb7f80ea None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:10.106239 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186527d-d9f4-4a09-891d-8e49ab4a40d3 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:10.130797 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808c0ca-66dd-42ac-8b4e-bb19cb7f80ea None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:10.138503 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee1b39-3bdd-488a-9b40-5f5505579a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:10.139365 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee1b39-3bdd-488a-9b40-5f5505579a1a None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:10.139653 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee1b39-3bdd-488a-9b40-5f5505579a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:10.139925 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee1b39-3bdd-488a-9b40-5f5505579a1a None admin] PATH_INFO: `/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:10.141113 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee1b39-3bdd-488a-9b40-5f5505579a1a None admin] RBAC: Authorizing `identity:get_project(project_id=fec2338df2a64a9a9b5d8a9b527bbf26)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:10.142608 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee1b39-3bdd-488a-9b40-5f5505579a1a None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:10.144440 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 62/121] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:10 2022] GET /identity/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26 => generated 298 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:10.145028 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee1b39-3bdd-488a-9b40-5f5505579a1a None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:10.164130 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53fc60-e2f8-4056-ab2d-6a6943659e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:10.165024 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53fc60-e2f8-4056-ab2d-6a6943659e0b None admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:10.165346 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53fc60-e2f8-4056-ab2d-6a6943659e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:10.165634 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53fc60-e2f8-4056-ab2d-6a6943659e0b None admin] PATH_INFO: `/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26/users/1aa2a0d7c3c94ca69150064a665859b5/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:10.167617 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53fc60-e2f8-4056-ab2d-6a6943659e0b None admin] RBAC: Authorizing `identity:create_grant(project_id=fec2338df2a64a9a9b5d8a9b527bbf26, user_id=1aa2a0d7c3c94ca69150064a665859b5, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:10.169362 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53fc60-e2f8-4056-ab2d-6a6943659e0b None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:10.239503 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee1b39-3bdd-488a-9b40-5f5505579a1a None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:10.254563 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 60/122] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Mar 29 20:01:10 2022] PUT /identity/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26/users/1aa2a0d7c3c94ca69150064a665859b5/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:01:10.255815 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81ee3f-7dca-4a02-99f4-a16fe1048e58 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:10.256113 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81ee3f-7dca-4a02-99f4-a16fe1048e58 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:10.256398 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81ee3f-7dca-4a02-99f4-a16fe1048e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:10.273662 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b452f-f43b-454f-9738-e8b3e325fcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:10.274076 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-9c81ee3f-7dca-4a02-99f4-a16fe1048e58 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:10.274350 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b452f-f43b-454f-9738-e8b3e325fcb3 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:10.274637 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b452f-f43b-454f-9738-e8b3e325fcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:10.274919 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b452f-f43b-454f-9738-e8b3e325fcb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:10.275320 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9c81ee3f-7dca-4a02-99f4-a16fe1048e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:10.347318 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b452f-f43b-454f-9738-e8b3e325fcb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:10.353510 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 61/123] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:10.353510 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81ee3f-7dca-4a02-99f4-a16fe1048e58 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:10.353785 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b452f-f43b-454f-9738-e8b3e325fcb3 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:10.453832 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81ee3f-7dca-4a02-99f4-a16fe1048e58 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:10.454739 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 63/124] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:01:10.455601 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b452f-f43b-454f-9738-e8b3e325fcb3 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:10.488368 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213d968-d7ed-465a-acc0-aeee6bbbb629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:10.489047 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213d968-d7ed-465a-acc0-aeee6bbbb629 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:10.489372 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213d968-d7ed-465a-acc0-aeee6bbbb629 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:10.489660 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213d968-d7ed-465a-acc0-aeee6bbbb629 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:10.490419 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213d968-d7ed-465a-acc0-aeee6bbbb629 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:10.490765 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213d968-d7ed-465a-acc0-aeee6bbbb629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:10.492171 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213d968-d7ed-465a-acc0-aeee6bbbb629 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:10.500367 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 62/125] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:01:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:10.506164 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213d968-d7ed-465a-acc0-aeee6bbbb629 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:10.555471 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b452f-f43b-454f-9738-e8b3e325fcb3 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:10.589120 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b56b8c-a8a5-478c-a41b-c5a746fe034a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:10.589822 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b56b8c-a8a5-478c-a41b-c5a746fe034a None admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:10.590112 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b56b8c-a8a5-478c-a41b-c5a746fe034a None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:10.590946 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b56b8c-a8a5-478c-a41b-c5a746fe034a None admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:10.591655 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b56b8c-a8a5-478c-a41b-c5a746fe034a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:10.593099 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b56b8c-a8a5-478c-a41b-c5a746fe034a None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:10.605109 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213d968-d7ed-465a-acc0-aeee6bbbb629 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:10.637930 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0670a-4cab-4347-8e4d-01d1143db5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:10.638823 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0670a-4cab-4347-8e4d-01d1143db5b6 None admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:10.639112 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0670a-4cab-4347-8e4d-01d1143db5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:10.639392 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0670a-4cab-4347-8e4d-01d1143db5b6 None admin] PATH_INFO: `/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26/users/5c0f0cae62ee4c75b41e0ef37bc31d07/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:10.641363 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0670a-4cab-4347-8e4d-01d1143db5b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=fec2338df2a64a9a9b5d8a9b527bbf26, user_id=5c0f0cae62ee4c75b41e0ef37bc31d07, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:10.642889 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0670a-4cab-4347-8e4d-01d1143db5b6 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:10.691074 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 64/126] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Mar 29 20:01:10 2022] POST /identity/v3/projects => generated 302 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:01:10.691074 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b56b8c-a8a5-478c-a41b-c5a746fe034a None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:10.724596 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 63/127] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Mar 29 20:01:10 2022] PUT /identity/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26/users/5c0f0cae62ee4c75b41e0ef37bc31d07/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:01:10.730566 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0670a-4cab-4347-8e4d-01d1143db5b6 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:10.804987 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b56b8c-a8a5-478c-a41b-c5a746fe034a None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:10.842093 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae9f9c-f87d-4301-b82e-fecadc11a2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:10.842929 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae9f9c-f87d-4301-b82e-fecadc11a2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:10.843216 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae9f9c-f87d-4301-b82e-fecadc11a2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:10.843497 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae9f9c-f87d-4301-b82e-fecadc11a2e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:10.865410 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae9f9c-f87d-4301-b82e-fecadc11a2e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:10.875677 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-1bae9f9c-f87d-4301-b82e-fecadc11a2e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 20:01:10.879572 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 65/128] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:10.886835 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae9f9c-f87d-4301-b82e-fecadc11a2e1 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:10.971305 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0670a-4cab-4347-8e4d-01d1143db5b6 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:11.013094 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae9f9c-f87d-4301-b82e-fecadc11a2e1 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:11.014641 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019a06a-4fb0-4470-ae27-e689d09646cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:11.015697 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019a06a-4fb0-4470-ae27-e689d09646cc None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:11.016210 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019a06a-4fb0-4470-ae27-e689d09646cc None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:11.016688 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019a06a-4fb0-4470-ae27-e689d09646cc None admin] PATH_INFO: `/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:11.018203 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019a06a-4fb0-4470-ae27-e689d09646cc None admin] RBAC: Authorizing `identity:get_project(project_id=fec2338df2a64a9a9b5d8a9b527bbf26)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:11.019707 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019a06a-4fb0-4470-ae27-e689d09646cc None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:11.021752 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 64/129] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:10 2022] GET /identity/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26 => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:11.022551 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019a06a-4fb0-4470-ae27-e689d09646cc None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:11.052888 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e55c5d-3827-4e32-88dc-980f8e662cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:11.053750 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e55c5d-3827-4e32-88dc-980f8e662cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:11.054043 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e55c5d-3827-4e32-88dc-980f8e662cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:11.054330 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e55c5d-3827-4e32-88dc-980f8e662cd5 None admin] PATH_INFO: `/v3/users/1aa2a0d7c3c94ca69150064a665859b5` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:11.056391 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e55c5d-3827-4e32-88dc-980f8e662cd5 None admin] RBAC: Authorizing `identity:get_user(user_id=1aa2a0d7c3c94ca69150064a665859b5)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:11.057520 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e55c5d-3827-4e32-88dc-980f8e662cd5 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:11.059574 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 66/130] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:10 2022] GET /identity/v3/users/1aa2a0d7c3c94ca69150064a665859b5 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:11.060489 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e55c5d-3827-4e32-88dc-980f8e662cd5 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:11.167481 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019a06a-4fb0-4470-ae27-e689d09646cc None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:11.177212 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e55c5d-3827-4e32-88dc-980f8e662cd5 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:11.206750 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a83a1-7a5c-4e69-8581-8003147c0a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:11.207772 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a83a1-7a5c-4e69-8581-8003147c0a4b None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:11.208265 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a83a1-7a5c-4e69-8581-8003147c0a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:11.208773 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a83a1-7a5c-4e69-8581-8003147c0a4b None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:11.217402 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a83a1-7a5c-4e69-8581-8003147c0a4b None admin] RBAC: Adding query filter params (name=member) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:11.217402 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a83a1-7a5c-4e69-8581-8003147c0a4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:11.217402 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a83a1-7a5c-4e69-8581-8003147c0a4b None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:11.223980 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e607b-32bf-42d9-9fb7-e84e170b6f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:11.224657 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e607b-32bf-42d9-9fb7-e84e170b6f28 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:11.224950 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e607b-32bf-42d9-9fb7-e84e170b6f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:11.225238 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e607b-32bf-42d9-9fb7-e84e170b6f28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:11.226109 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e607b-32bf-42d9-9fb7-e84e170b6f28 None admin] RBAC: Adding query filter params (role.id=cd320364ae634461bc6ce03abdb40fa8, scope.project.id=fec2338df2a64a9a9b5d8a9b527bbf26, user.id=95a8ae2a89a34376b20b6f07c0123a2d) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:11.226432 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e607b-32bf-42d9-9fb7-e84e170b6f28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:11.227903 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e607b-32bf-42d9-9fb7-e84e170b6f28 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:11.235707 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 65/131] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:11.237902 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a83a1-7a5c-4e69-8581-8003147c0a4b None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:11.238670 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 67/132] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:01:11 2022] GET /identity/v3/role_assignments?user.id=95a8ae2a89a34376b20b6f07c0123a2d&scope.project.id=fec2338df2a64a9a9b5d8a9b527bbf26&role.id=cd320364ae634461bc6ce03abdb40fa8 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:11.252174 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e607b-32bf-42d9-9fb7-e84e170b6f28 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:11.383340 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e607b-32bf-42d9-9fb7-e84e170b6f28 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:11.420128 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a83a1-7a5c-4e69-8581-8003147c0a4b None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:11.427363 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d91d6-9cc0-4f46-945a-8caf98627936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:11.428335 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d91d6-9cc0-4f46-945a-8caf98627936 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:11.428634 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d91d6-9cc0-4f46-945a-8caf98627936 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:11.428921 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d91d6-9cc0-4f46-945a-8caf98627936 None admin] PATH_INFO: `/v3/users/1aa2a0d7c3c94ca69150064a665859b5` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:11.430326 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d91d6-9cc0-4f46-945a-8caf98627936 None admin] RBAC: Authorizing `identity:get_user(user_id=1aa2a0d7c3c94ca69150064a665859b5)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:11.431818 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d91d6-9cc0-4f46-945a-8caf98627936 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:11.433778 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 68/133] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:11 2022] GET /identity/v3/users/1aa2a0d7c3c94ca69150064a665859b5 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:01:11.439931 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d91d6-9cc0-4f46-945a-8caf98627936 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:11.456095 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7300cd2-8a2e-4e64-9e55-ccfaf70b1383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:11.456986 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7300cd2-8a2e-4e64-9e55-ccfaf70b1383 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:11.457277 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7300cd2-8a2e-4e64-9e55-ccfaf70b1383 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:11.457594 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7300cd2-8a2e-4e64-9e55-ccfaf70b1383 None admin] PATH_INFO: `/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:11.458826 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7300cd2-8a2e-4e64-9e55-ccfaf70b1383 None admin] RBAC: Authorizing `identity:get_project(project_id=fec2338df2a64a9a9b5d8a9b527bbf26)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:11.460291 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7300cd2-8a2e-4e64-9e55-ccfaf70b1383 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:11.462359 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 66/134] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:11 2022] GET /identity/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:11.468368 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7300cd2-8a2e-4e64-9e55-ccfaf70b1383 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:11.570997 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7300cd2-8a2e-4e64-9e55-ccfaf70b1383 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:11.595107 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d91d6-9cc0-4f46-945a-8caf98627936 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:11.605996 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5705e0-d157-4cd3-84ad-2cbad36f9c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:11.607110 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5705e0-d157-4cd3-84ad-2cbad36f9c5e None admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:11.607400 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5705e0-d157-4cd3-84ad-2cbad36f9c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:11.607684 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5705e0-d157-4cd3-84ad-2cbad36f9c5e None admin] PATH_INFO: `/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26/users/1aa2a0d7c3c94ca69150064a665859b5/roles/82747af757b549cbaa39504334f32f9f` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:11.610014 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5705e0-d157-4cd3-84ad-2cbad36f9c5e None admin] RBAC: Authorizing `identity:create_grant(project_id=fec2338df2a64a9a9b5d8a9b527bbf26, user_id=1aa2a0d7c3c94ca69150064a665859b5, role_id=82747af757b549cbaa39504334f32f9f)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:11.611483 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5705e0-d157-4cd3-84ad-2cbad36f9c5e None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:11.640523 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e74aad-603c-4516-864a-c25dd5c7510e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:11.640523 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e74aad-603c-4516-864a-c25dd5c7510e None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:11.640523 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e74aad-603c-4516-864a-c25dd5c7510e None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:11.640523 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e74aad-603c-4516-864a-c25dd5c7510e None admin] PATH_INFO: `/v3/projects/3328a8fb9c40430098d4cb6799ba7591` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:11.641838 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e74aad-603c-4516-864a-c25dd5c7510e None admin] RBAC: Authorizing `identity:get_project(project_id=3328a8fb9c40430098d4cb6799ba7591)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:11.643609 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e74aad-603c-4516-864a-c25dd5c7510e None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:11.645659 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 69/135] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:11 2022] GET /identity/v3/projects/3328a8fb9c40430098d4cb6799ba7591 => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:01:11.652188 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e74aad-603c-4516-864a-c25dd5c7510e None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:11.706646 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 67/136] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Mar 29 20:01:11 2022] PUT /identity/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26/users/1aa2a0d7c3c94ca69150064a665859b5/roles/82747af757b549cbaa39504334f32f9f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:01:11.770788 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e74aad-603c-4516-864a-c25dd5c7510e None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:11.812716 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c95cef-54cd-404c-9dfe-2796cf9abe51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:11.813930 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c95cef-54cd-404c-9dfe-2796cf9abe51 None admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:11.814362 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c95cef-54cd-404c-9dfe-2796cf9abe51 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:11.814816 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c95cef-54cd-404c-9dfe-2796cf9abe51 None admin] PATH_INFO: `/v3/projects/3328a8fb9c40430098d4cb6799ba7591/users/1aa2a0d7c3c94ca69150064a665859b5/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:11.817543 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c95cef-54cd-404c-9dfe-2796cf9abe51 None admin] RBAC: Authorizing `identity:create_grant(project_id=3328a8fb9c40430098d4cb6799ba7591, user_id=1aa2a0d7c3c94ca69150064a665859b5, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:11.819216 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c95cef-54cd-404c-9dfe-2796cf9abe51 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:11.890628 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 70/137] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Mar 29 20:01:11 2022] PUT /identity/v3/projects/3328a8fb9c40430098d4cb6799ba7591/users/1aa2a0d7c3c94ca69150064a665859b5/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:01:13.561868 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75a1d9-bf0a-4328-b283-6da492e969d6 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:13.562388 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75a1d9-bf0a-4328-b283-6da492e969d6 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:13.562462 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75a1d9-bf0a-4328-b283-6da492e969d6 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:13.564519 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 68/138] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:13.569729 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd113e72-0e07-450b-b494-323100e02789 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:13.570158 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd113e72-0e07-450b-b494-323100e02789 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:13.570158 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd113e72-0e07-450b-b494-323100e02789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:13.594498 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-bd113e72-0e07-450b-b494-323100e02789 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:13.595722 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-bd113e72-0e07-450b-b494-323100e02789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:13.676016 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 71/139] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:13.712700 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75a1d9-bf0a-4328-b283-6da492e969d6 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:13.839406 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75a1d9-bf0a-4328-b283-6da492e969d6 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:13.884829 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a6ac9-89e9-4171-9565-134f9a781dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:13.885661 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a6ac9-89e9-4171-9565-134f9a781dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:13.885952 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a6ac9-89e9-4171-9565-134f9a781dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:13.886237 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a6ac9-89e9-4171-9565-134f9a781dd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:13.905485 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a6ac9-89e9-4171-9565-134f9a781dd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:13.912534 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-6f3a6ac9-89e9-4171-9565-134f9a781dd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 20:01:13.914080 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 69/140] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:13.920114 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd113e72-0e07-450b-b494-323100e02789 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:14.019310 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfbb45-2c83-4583-ac47-59a81eba4f96 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:14.019772 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfbb45-2c83-4583-ac47-59a81eba4f96 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:14.019875 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfbb45-2c83-4583-ac47-59a81eba4f96 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:14.021986 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 70/141] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:01:14.026893 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9397f6e-19f0-46ae-9feb-247ac4ed0ca9 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:14.027188 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9397f6e-19f0-46ae-9feb-247ac4ed0ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:14.027465 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9397f6e-19f0-46ae-9feb-247ac4ed0ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:14.045369 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd113e72-0e07-450b-b494-323100e02789 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:14.061192 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-a9397f6e-19f0-46ae-9feb-247ac4ed0ca9 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:14.062474 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-a9397f6e-19f0-46ae-9feb-247ac4ed0ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:14.091371 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e62b44-bb2a-4dea-b51f-0109100974ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:14.091371 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e62b44-bb2a-4dea-b51f-0109100974ba None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:14.091371 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e62b44-bb2a-4dea-b51f-0109100974ba None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:14.091696 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e62b44-bb2a-4dea-b51f-0109100974ba None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:14.092184 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e62b44-bb2a-4dea-b51f-0109100974ba None admin] RBAC: Adding query filter params (name=member) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:14.092498 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e62b44-bb2a-4dea-b51f-0109100974ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:14.094130 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e62b44-bb2a-4dea-b51f-0109100974ba None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:14.103566 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 72/142] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:14.124826 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e62b44-bb2a-4dea-b51f-0109100974ba None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:14.205434 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 71/143] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 20:01:14.210771 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb303fe-1dfc-4771-853e-deb05eb0c1e0 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:14.211071 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb303fe-1dfc-4771-853e-deb05eb0c1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:14.211365 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb303fe-1dfc-4771-853e-deb05eb0c1e0 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:14.213088 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 72/144] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:14.218528 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b8d30-27cc-43f0-9d7e-8454e1579382 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:14.218825 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b8d30-27cc-43f0-9d7e-8454e1579382 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:14.219116 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b8d30-27cc-43f0-9d7e-8454e1579382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:14.247709 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e62b44-bb2a-4dea-b51f-0109100974ba None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:14.253491 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-122b8d30-27cc-43f0-9d7e-8454e1579382 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:14.254752 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-122b8d30-27cc-43f0-9d7e-8454e1579382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:14.291437 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd18bcd-4da7-4ad3-830a-aadd355efdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:14.292342 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd18bcd-4da7-4ad3-830a-aadd355efdfd None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:14.292636 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd18bcd-4da7-4ad3-830a-aadd355efdfd None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:14.292919 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd18bcd-4da7-4ad3-830a-aadd355efdfd None admin] PATH_INFO: `/v3/users/1aa2a0d7c3c94ca69150064a665859b5` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:14.294793 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd18bcd-4da7-4ad3-830a-aadd355efdfd None admin] RBAC: Authorizing `identity:get_user(user_id=1aa2a0d7c3c94ca69150064a665859b5)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:14.296277 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd18bcd-4da7-4ad3-830a-aadd355efdfd None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:14.298569 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 73/145] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:14 2022] GET /identity/v3/users/1aa2a0d7c3c94ca69150064a665859b5 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:01:14.299361 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd18bcd-4da7-4ad3-830a-aadd355efdfd None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:14.390121 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 73/146] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 20:01:14.390692 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b8d30-27cc-43f0-9d7e-8454e1579382 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:14.465822 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd18bcd-4da7-4ad3-830a-aadd355efdfd None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:14.514020 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8718e-f0da-4d69-9e1e-9525a09f8598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:14.514840 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8718e-f0da-4d69-9e1e-9525a09f8598 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:14.515129 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8718e-f0da-4d69-9e1e-9525a09f8598 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:14.515414 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8718e-f0da-4d69-9e1e-9525a09f8598 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:14.517133 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8718e-f0da-4d69-9e1e-9525a09f8598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:14.518699 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8718e-f0da-4d69-9e1e-9525a09f8598 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:14.520316 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 74/147] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:01:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:14.525529 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8718e-f0da-4d69-9e1e-9525a09f8598 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:14.623077 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b8d30-27cc-43f0-9d7e-8454e1579382 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:14.673146 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8718e-f0da-4d69-9e1e-9525a09f8598 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:14.697663 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f5afa-6510-423b-a91b-8eb0987824c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:14.698326 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f5afa-6510-423b-a91b-8eb0987824c2 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:14.698871 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f5afa-6510-423b-a91b-8eb0987824c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:14.699160 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f5afa-6510-423b-a91b-8eb0987824c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:14.740745 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f81695-c0cd-4ea7-9c6b-d48d42691b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:14.741635 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f81695-c0cd-4ea7-9c6b-d48d42691b15 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:14.741927 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f81695-c0cd-4ea7-9c6b-d48d42691b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:14.742268 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f81695-c0cd-4ea7-9c6b-d48d42691b15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:14.760301 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f81695-c0cd-4ea7-9c6b-d48d42691b15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:14.775209 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-56f81695-c0cd-4ea7-9c6b-d48d42691b15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:01:14.780972 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 75/148] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:01:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:14.781807 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f81695-c0cd-4ea7-9c6b-d48d42691b15 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:14.816939 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f5afa-6510-423b-a91b-8eb0987824c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:14.818780 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f5afa-6510-423b-a91b-8eb0987824c2 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:14.933944 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f81695-c0cd-4ea7-9c6b-d48d42691b15 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:14.941867 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 74/149] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:01:14.945131 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f5afa-6510-423b-a91b-8eb0987824c2 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:14.970030 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e094044-b036-4a1d-ba7b-6035ba471e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:14.970880 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e094044-b036-4a1d-ba7b-6035ba471e8b None admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:14.971267 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e094044-b036-4a1d-ba7b-6035ba471e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:14.971652 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e094044-b036-4a1d-ba7b-6035ba471e8b None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:14.972469 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e094044-b036-4a1d-ba7b-6035ba471e8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:14.974065 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e094044-b036-4a1d-ba7b-6035ba471e8b None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:15.051971 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f5afa-6510-423b-a91b-8eb0987824c2 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:15.085431 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 76/150] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Mar 29 20:01:14 2022] POST /identity/v3/users => generated 283 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:01:15.086752 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22894b7-6f37-46b9-aa14-939ddfa961c7 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:15.087039 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22894b7-6f37-46b9-aa14-939ddfa961c7 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:15.087487 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22894b7-6f37-46b9-aa14-939ddfa961c7 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:15.089323 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 77/151] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:15.089926 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22894b7-6f37-46b9-aa14-939ddfa961c7 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:15.097042 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832572e-8d06-4c92-b405-c94b66cbad31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:15.097042 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832572e-8d06-4c92-b405-c94b66cbad31 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:15.097042 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832572e-8d06-4c92-b405-c94b66cbad31 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:15.097042 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832572e-8d06-4c92-b405-c94b66cbad31 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:15.097521 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832572e-8d06-4c92-b405-c94b66cbad31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:15.097521 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832572e-8d06-4c92-b405-c94b66cbad31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:15.098436 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832572e-8d06-4c92-b405-c94b66cbad31 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:15.111867 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 75/152] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:15.114593 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a16dc4-d522-4129-8f36-dd46d3e42631 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:15.116419 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a16dc4-d522-4129-8f36-dd46d3e42631 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:15.117364 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a16dc4-d522-4129-8f36-dd46d3e42631 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:15.119915 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 76/153] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:15.122066 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae2ad9-14b0-4112-a6ad-a0eccf8079dc None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:15.122661 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae2ad9-14b0-4112-a6ad-a0eccf8079dc None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:15.123176 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae2ad9-14b0-4112-a6ad-a0eccf8079dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:15.144513 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-b7ae2ad9-14b0-4112-a6ad-a0eccf8079dc None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:15.146145 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-b7ae2ad9-14b0-4112-a6ad-a0eccf8079dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:15.233535 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 77/154] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:15.234927 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae2ad9-14b0-4112-a6ad-a0eccf8079dc None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:15.239171 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22894b7-6f37-46b9-aa14-939ddfa961c7 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:15.282761 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d5b18-516a-4c75-9bf8-b16936a7cfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:15.283259 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d5b18-516a-4c75-9bf8-b16936a7cfc6 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:15.283542 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d5b18-516a-4c75-9bf8-b16936a7cfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:15.283823 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d5b18-516a-4c75-9bf8-b16936a7cfc6 None admin] PATH_INFO: `/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:15.285875 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d5b18-516a-4c75-9bf8-b16936a7cfc6 None admin] RBAC: Authorizing `identity:get_project(project_id=fec2338df2a64a9a9b5d8a9b527bbf26)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:15.287380 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d5b18-516a-4c75-9bf8-b16936a7cfc6 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:15.289233 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 78/155] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:15 2022] GET /identity/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:15.290300 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bdbc3-3efa-42ea-8158-48be586f0cbd None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:15.290600 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bdbc3-3efa-42ea-8158-48be586f0cbd None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:15.290878 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bdbc3-3efa-42ea-8158-48be586f0cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:15.317359 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-6e8bdbc3-3efa-42ea-8158-48be586f0cbd None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:15.318535 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-6e8bdbc3-3efa-42ea-8158-48be586f0cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:15.382720 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae2ad9-14b0-4112-a6ad-a0eccf8079dc None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:15.409554 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 79/156] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:15.410497 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bdbc3-3efa-42ea-8158-48be586f0cbd None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:15.433670 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038242f6-5306-4373-b036-32b3f1351c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:15.436125 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038242f6-5306-4373-b036-32b3f1351c40 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:15.436889 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038242f6-5306-4373-b036-32b3f1351c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:15.437391 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038242f6-5306-4373-b036-32b3f1351c40 None admin] PATH_INFO: `/v3/users/5c0f0cae62ee4c75b41e0ef37bc31d07` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:15.439502 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038242f6-5306-4373-b036-32b3f1351c40 None admin] RBAC: Authorizing `identity:get_user(user_id=5c0f0cae62ee4c75b41e0ef37bc31d07)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:15.441693 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038242f6-5306-4373-b036-32b3f1351c40 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:15.444339 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 78/157] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:15 2022] GET /identity/v3/users/5c0f0cae62ee4c75b41e0ef37bc31d07 => generated 247 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:15.445365 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038242f6-5306-4373-b036-32b3f1351c40 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:15.540534 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bdbc3-3efa-42ea-8158-48be586f0cbd None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:15.568427 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038242f6-5306-4373-b036-32b3f1351c40 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:15.583792 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48adf1-d5da-4980-94b4-72a91e034037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:15.584604 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48adf1-d5da-4980-94b4-72a91e034037 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:15.584891 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48adf1-d5da-4980-94b4-72a91e034037 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:15.585172 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48adf1-d5da-4980-94b4-72a91e034037 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:15.601619 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48adf1-d5da-4980-94b4-72a91e034037 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:15.605394 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bce9b-140b-45ea-8cd8-9a95cfdea340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:15.607351 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bce9b-140b-45ea-8cd8-9a95cfdea340 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:15.607643 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bce9b-140b-45ea-8cd8-9a95cfdea340 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:15.607966 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bce9b-140b-45ea-8cd8-9a95cfdea340 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:15.608761 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673bce9b-140b-45ea-8cd8-9a95cfdea340 None admin] RBAC: Adding query filter params (role.id=e49df2a8408b4f5fa7e284575007ce83, scope.project.id=fec2338df2a64a9a9b5d8a9b527bbf26, user.id=1aa2a0d7c3c94ca69150064a665859b5) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:15.609070 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673bce9b-140b-45ea-8cd8-9a95cfdea340 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:15.609551 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-bc48adf1-d5da-4980-94b4-72a91e034037 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 29 20:01:15.610619 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673bce9b-140b-45ea-8cd8-9a95cfdea340 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:15.611038 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 80/158] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:15.611654 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48adf1-d5da-4980-94b4-72a91e034037 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:15.622556 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 79/159] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:01:15 2022] GET /identity/v3/role_assignments?user.id=1aa2a0d7c3c94ca69150064a665859b5&scope.project.id=fec2338df2a64a9a9b5d8a9b527bbf26&role.id=e49df2a8408b4f5fa7e284575007ce83 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:15.623414 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bce9b-140b-45ea-8cd8-9a95cfdea340 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:15.725322 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48adf1-d5da-4980-94b4-72a91e034037 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:15.736873 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bce9b-140b-45ea-8cd8-9a95cfdea340 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:15.767347 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c1e50-1d40-4733-a265-eff444c4beda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:15.768236 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c1e50-1d40-4733-a265-eff444c4beda None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:15.768526 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c1e50-1d40-4733-a265-eff444c4beda None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:15.768802 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c1e50-1d40-4733-a265-eff444c4beda None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:15.774446 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5e313-ad2f-45bd-acb4-dcb2a68f0e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:15.775101 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5e313-ad2f-45bd-acb4-dcb2a68f0e99 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:15.775381 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5e313-ad2f-45bd-acb4-dcb2a68f0e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:15.775657 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5e313-ad2f-45bd-acb4-dcb2a68f0e99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:15.781165 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c1e50-1d40-4733-a265-eff444c4beda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:15.788996 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-092c1e50-1d40-4733-a265-eff444c4beda None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 29 20:01:15.791685 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 81/160] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Mar 29 20:01:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:15.792882 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7fe85-e938-4a90-8e58-f69ec05d15c7 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:15.793777 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7fe85-e938-4a90-8e58-f69ec05d15c7 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:15.794120 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7fe85-e938-4a90-8e58-f69ec05d15c7 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:15.795985 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 82/161] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:15.796634 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7fe85-e938-4a90-8e58-f69ec05d15c7 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:15.857182 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5e313-ad2f-45bd-acb4-dcb2a68f0e99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:15.858714 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5e313-ad2f-45bd-acb4-dcb2a68f0e99 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:15.912118 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7fe85-e938-4a90-8e58-f69ec05d15c7 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:15.952210 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326e35d-5402-4b14-99b7-d137f2578c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:15.952893 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326e35d-5402-4b14-99b7-d137f2578c40 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:15.953177 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326e35d-5402-4b14-99b7-d137f2578c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:15.953489 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326e35d-5402-4b14-99b7-d137f2578c40 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:15.954246 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326e35d-5402-4b14-99b7-d137f2578c40 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:15.954607 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326e35d-5402-4b14-99b7-d137f2578c40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:15.956024 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326e35d-5402-4b14-99b7-d137f2578c40 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:15.964584 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 80/162] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:01:15.966588 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 83/163] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:15.966759 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5e313-ad2f-45bd-acb4-dcb2a68f0e99 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:15.967715 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf95c9d-cbe5-4935-8954-fde7ad5a2cfc None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:15.971954 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf95c9d-cbe5-4935-8954-fde7ad5a2cfc None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:15.971954 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf95c9d-cbe5-4935-8954-fde7ad5a2cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:15.989606 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-bbf95c9d-cbe5-4935-8954-fde7ad5a2cfc None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:15.990853 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-bbf95c9d-cbe5-4935-8954-fde7ad5a2cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:16.060454 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 84/164] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:16.061126 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf95c9d-cbe5-4935-8954-fde7ad5a2cfc None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:16.077334 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5e313-ad2f-45bd-acb4-dcb2a68f0e99 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:16.113659 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b522c1-afca-4a2d-8175-e18129d51f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:16.114323 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b522c1-afca-4a2d-8175-e18129d51f4a None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:16.114599 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b522c1-afca-4a2d-8175-e18129d51f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:16.114869 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b522c1-afca-4a2d-8175-e18129d51f4a None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:16.115616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b522c1-afca-4a2d-8175-e18129d51f4a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:16.115921 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b522c1-afca-4a2d-8175-e18129d51f4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:16.117319 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b522c1-afca-4a2d-8175-e18129d51f4a None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:16.126655 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 81/165] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:01:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:16.127484 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b522c1-afca-4a2d-8175-e18129d51f4a None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:16.164229 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf95c9d-cbe5-4935-8954-fde7ad5a2cfc None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:16.200658 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714ff8e-18b9-4f11-9132-a7b8465689c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:16.201587 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714ff8e-18b9-4f11-9132-a7b8465689c3 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:16.201873 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714ff8e-18b9-4f11-9132-a7b8465689c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:16.202154 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714ff8e-18b9-4f11-9132-a7b8465689c3 None admin] PATH_INFO: `/v3/users/95a8ae2a89a34376b20b6f07c0123a2d` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:16.203383 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714ff8e-18b9-4f11-9132-a7b8465689c3 None admin] RBAC: Authorizing `identity:get_user(user_id=95a8ae2a89a34376b20b6f07c0123a2d)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:16.204859 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714ff8e-18b9-4f11-9132-a7b8465689c3 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:16.206686 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 85/166] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:16 2022] GET /identity/v3/users/95a8ae2a89a34376b20b6f07c0123a2d => generated 289 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:16.207384 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714ff8e-18b9-4f11-9132-a7b8465689c3 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:16.230509 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b522c1-afca-4a2d-8175-e18129d51f4a None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:16.268380 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c53273-c7fe-4ea4-8a56-d5089736650f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:16.269250 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c53273-c7fe-4ea4-8a56-d5089736650f None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:16.269590 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c53273-c7fe-4ea4-8a56-d5089736650f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:16.269848 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c53273-c7fe-4ea4-8a56-d5089736650f None admin] PATH_INFO: `/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:16.271062 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c53273-c7fe-4ea4-8a56-d5089736650f None admin] RBAC: Authorizing `identity:get_project(project_id=fec2338df2a64a9a9b5d8a9b527bbf26)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:16.272493 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c53273-c7fe-4ea4-8a56-d5089736650f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:16.274369 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 82/167] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:16 2022] GET /identity/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:16.274962 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c53273-c7fe-4ea4-8a56-d5089736650f None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:16.316315 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714ff8e-18b9-4f11-9132-a7b8465689c3 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:16.351251 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5a3be-9a55-4347-8591-0307a83fb348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:16.352061 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5a3be-9a55-4347-8591-0307a83fb348 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:16.352349 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5a3be-9a55-4347-8591-0307a83fb348 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:16.352630 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5a3be-9a55-4347-8591-0307a83fb348 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:16.363977 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5a3be-9a55-4347-8591-0307a83fb348 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:16.371373 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-9fc5a3be-9a55-4347-8591-0307a83fb348 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 20:01:16.372969 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 86/168] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:16.373702 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5a3be-9a55-4347-8591-0307a83fb348 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:16.379700 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c53273-c7fe-4ea4-8a56-d5089736650f None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:16.415398 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37704b0-f9a6-43e8-b222-0910fd893a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:16.416276 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37704b0-f9a6-43e8-b222-0910fd893a40 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:16.416558 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37704b0-f9a6-43e8-b222-0910fd893a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:16.416833 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37704b0-f9a6-43e8-b222-0910fd893a40 None admin] PATH_INFO: `/v3/users/1aa2a0d7c3c94ca69150064a665859b5` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:16.418074 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37704b0-f9a6-43e8-b222-0910fd893a40 None admin] RBAC: Authorizing `identity:get_user(user_id=1aa2a0d7c3c94ca69150064a665859b5)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:16.420764 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37704b0-f9a6-43e8-b222-0910fd893a40 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:16.422494 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 83/169] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:16 2022] GET /identity/v3/users/1aa2a0d7c3c94ca69150064a665859b5 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:16.423062 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37704b0-f9a6-43e8-b222-0910fd893a40 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:16.478327 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5a3be-9a55-4347-8591-0307a83fb348 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:16.513593 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044af29e-6f40-40ad-8adb-218b70717951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:16.514472 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044af29e-6f40-40ad-8adb-218b70717951 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:16.514760 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044af29e-6f40-40ad-8adb-218b70717951 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:16.515045 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044af29e-6f40-40ad-8adb-218b70717951 None admin] PATH_INFO: `/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:16.516267 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044af29e-6f40-40ad-8adb-218b70717951 None admin] RBAC: Authorizing `identity:get_project(project_id=fec2338df2a64a9a9b5d8a9b527bbf26)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:16.517773 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044af29e-6f40-40ad-8adb-218b70717951 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:16.519482 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 87/170] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:16 2022] GET /identity/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:16.520334 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044af29e-6f40-40ad-8adb-218b70717951 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:16.523920 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37704b0-f9a6-43e8-b222-0910fd893a40 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:16.559015 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ad001-8506-438c-8cce-378e7e3f4618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:16.560227 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ad001-8506-438c-8cce-378e7e3f4618 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:16.560513 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ad001-8506-438c-8cce-378e7e3f4618 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:16.560793 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ad001-8506-438c-8cce-378e7e3f4618 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:16.561661 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ad001-8506-438c-8cce-378e7e3f4618 None admin] RBAC: Adding query filter params (role.id=8cfa924df1a1400986d9ecc9686a7f52, scope.project.id=fec2338df2a64a9a9b5d8a9b527bbf26, user.id=5c0f0cae62ee4c75b41e0ef37bc31d07) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:16.561977 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ad001-8506-438c-8cce-378e7e3f4618 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:16.563417 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ad001-8506-438c-8cce-378e7e3f4618 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:16.569608 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 84/171] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:01:16 2022] GET /identity/v3/role_assignments?user.id=5c0f0cae62ee4c75b41e0ef37bc31d07&scope.project.id=fec2338df2a64a9a9b5d8a9b527bbf26&role.id=8cfa924df1a1400986d9ecc9686a7f52 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:16.570433 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ad001-8506-438c-8cce-378e7e3f4618 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:16.649196 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044af29e-6f40-40ad-8adb-218b70717951 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:16.677903 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ad001-8506-438c-8cce-378e7e3f4618 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:16.708369 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d21638-f444-405b-8ac4-0d198968e675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:16.709058 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d21638-f444-405b-8ac4-0d198968e675 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:16.709379 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d21638-f444-405b-8ac4-0d198968e675 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:16.709654 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d21638-f444-405b-8ac4-0d198968e675 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:16.710414 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d21638-f444-405b-8ac4-0d198968e675 None admin] RBAC: Adding query filter params (name=member) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:16.710727 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d21638-f444-405b-8ac4-0d198968e675 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:16.712365 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d21638-f444-405b-8ac4-0d198968e675 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:16.714584 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e1843-d180-4b78-af1e-b848e26d9e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:16.715876 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e1843-d180-4b78-af1e-b848e26d9e4f None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:16.716694 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e1843-d180-4b78-af1e-b848e26d9e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:16.716977 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e1843-d180-4b78-af1e-b848e26d9e4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:16.729643 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 88/172] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:16.730494 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d21638-f444-405b-8ac4-0d198968e675 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:16.789757 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e1843-d180-4b78-af1e-b848e26d9e4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:16.791238 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e1843-d180-4b78-af1e-b848e26d9e4f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:16.856219 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d21638-f444-405b-8ac4-0d198968e675 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:16.893166 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6640e-7f79-4f26-84d1-0f8ff9f49231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:16.894109 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6640e-7f79-4f26-84d1-0f8ff9f49231 None admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:16.894398 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6640e-7f79-4f26-84d1-0f8ff9f49231 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:16.894683 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6640e-7f79-4f26-84d1-0f8ff9f49231 None admin] PATH_INFO: `/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26/users/95a8ae2a89a34376b20b6f07c0123a2d/roles/cd320364ae634461bc6ce03abdb40fa8` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:16.896764 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6640e-7f79-4f26-84d1-0f8ff9f49231 None admin] RBAC: Authorizing `identity:create_grant(project_id=fec2338df2a64a9a9b5d8a9b527bbf26, user_id=95a8ae2a89a34376b20b6f07c0123a2d, role_id=cd320364ae634461bc6ce03abdb40fa8)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:16.898302 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6640e-7f79-4f26-84d1-0f8ff9f49231 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:16.901973 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 85/173] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:01:16.903638 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e1843-d180-4b78-af1e-b848e26d9e4f None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:16.980265 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 89/174] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Mar 29 20:01:16 2022] PUT /identity/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26/users/95a8ae2a89a34376b20b6f07c0123a2d/roles/cd320364ae634461bc6ce03abdb40fa8 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:01:16.986558 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6640e-7f79-4f26-84d1-0f8ff9f49231 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:17.015958 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e1843-d180-4b78-af1e-b848e26d9e4f None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:17.054818 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a2215-430a-41a0-93ad-19a1112c5341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:17.054818 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a2215-430a-41a0-93ad-19a1112c5341 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:17.055104 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a2215-430a-41a0-93ad-19a1112c5341 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:17.055361 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a2215-430a-41a0-93ad-19a1112c5341 None admin] PATH_INFO: `/v3/users/1aa2a0d7c3c94ca69150064a665859b5` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:17.057267 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a2215-430a-41a0-93ad-19a1112c5341 None admin] RBAC: Authorizing `identity:get_user(user_id=1aa2a0d7c3c94ca69150064a665859b5)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:17.059603 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a2215-430a-41a0-93ad-19a1112c5341 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:17.062294 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 86/175] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:16 2022] GET /identity/v3/users/1aa2a0d7c3c94ca69150064a665859b5 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:17.067456 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a2215-430a-41a0-93ad-19a1112c5341 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:17.126174 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6640e-7f79-4f26-84d1-0f8ff9f49231 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:17.163175 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0dc186-c297-4859-9b14-6e0abdf9de0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:17.164437 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0dc186-c297-4859-9b14-6e0abdf9de0f None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:17.164947 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0dc186-c297-4859-9b14-6e0abdf9de0f None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:17.165455 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0dc186-c297-4859-9b14-6e0abdf9de0f None admin] PATH_INFO: `/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:17.166959 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0dc186-c297-4859-9b14-6e0abdf9de0f None admin] RBAC: Authorizing `identity:get_project(project_id=fec2338df2a64a9a9b5d8a9b527bbf26)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:17.168946 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0dc186-c297-4859-9b14-6e0abdf9de0f None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:17.171033 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 90/176] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:16 2022] GET /identity/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:17.179336 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0dc186-c297-4859-9b14-6e0abdf9de0f None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:17.181061 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a2215-430a-41a0-93ad-19a1112c5341 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:17.220024 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bef7e-da56-4284-bc27-bab0268bba17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:17.220690 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bef7e-da56-4284-bc27-bab0268bba17 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:17.220970 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bef7e-da56-4284-bc27-bab0268bba17 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:17.221246 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bef7e-da56-4284-bc27-bab0268bba17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:17.286265 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0dc186-c297-4859-9b14-6e0abdf9de0f None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:17.296710 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8bef7e-da56-4284-bc27-bab0268bba17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:17.298356 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8bef7e-da56-4284-bc27-bab0268bba17 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:17.322376 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cb522-8698-43bc-bb0b-b3ed244f9275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:17.323439 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cb522-8698-43bc-bb0b-b3ed244f9275 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:17.324184 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cb522-8698-43bc-bb0b-b3ed244f9275 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:17.325215 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cb522-8698-43bc-bb0b-b3ed244f9275 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:17.326312 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cb522-8698-43bc-bb0b-b3ed244f9275 None admin] RBAC: Adding query filter params (role.id=82747af757b549cbaa39504334f32f9f, scope.project.id=fec2338df2a64a9a9b5d8a9b527bbf26, user.id=1aa2a0d7c3c94ca69150064a665859b5) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:17.326842 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cb522-8698-43bc-bb0b-b3ed244f9275 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:17.328567 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cb522-8698-43bc-bb0b-b3ed244f9275 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:17.341428 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 91/177] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:01:17 2022] GET /identity/v3/role_assignments?user.id=1aa2a0d7c3c94ca69150064a665859b5&scope.project.id=fec2338df2a64a9a9b5d8a9b527bbf26&role.id=82747af757b549cbaa39504334f32f9f => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:01:17.414629 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 87/178] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 29 20:01:17.421022 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cb522-8698-43bc-bb0b-b3ed244f9275 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:17.551530 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cb522-8698-43bc-bb0b-b3ed244f9275 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:17.589735 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80dfe3d-cf02-4fab-ba61-b884b3d25d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:17.590834 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dfe3d-cf02-4fab-ba61-b884b3d25d08 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:17.591116 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dfe3d-cf02-4fab-ba61-b884b3d25d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:17.591391 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dfe3d-cf02-4fab-ba61-b884b3d25d08 None admin] PATH_INFO: `/v3/projects/3328a8fb9c40430098d4cb6799ba7591` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:17.592610 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80dfe3d-cf02-4fab-ba61-b884b3d25d08 None admin] RBAC: Authorizing `identity:get_project(project_id=3328a8fb9c40430098d4cb6799ba7591)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:17.594113 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80dfe3d-cf02-4fab-ba61-b884b3d25d08 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:17.596166 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 92/179] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:17 2022] GET /identity/v3/projects/3328a8fb9c40430098d4cb6799ba7591 => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:17.602052 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bef7e-da56-4284-bc27-bab0268bba17 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:17.739080 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bef7e-da56-4284-bc27-bab0268bba17 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:17.778755 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c09e54-0d6a-4ee8-a54b-5b634cf01594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:17.779794 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c09e54-0d6a-4ee8-a54b-5b634cf01594 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:17.780284 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c09e54-0d6a-4ee8-a54b-5b634cf01594 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:17.780750 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c09e54-0d6a-4ee8-a54b-5b634cf01594 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:17.781813 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c09e54-0d6a-4ee8-a54b-5b634cf01594 None admin] RBAC: Adding query filter params (role.id=e49df2a8408b4f5fa7e284575007ce83, scope.project.id=3328a8fb9c40430098d4cb6799ba7591, user.id=1aa2a0d7c3c94ca69150064a665859b5) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:17.782336 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c09e54-0d6a-4ee8-a54b-5b634cf01594 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:17.783950 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c09e54-0d6a-4ee8-a54b-5b634cf01594 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:17.790371 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 88/180] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:01:17 2022] GET /identity/v3/role_assignments?user.id=1aa2a0d7c3c94ca69150064a665859b5&scope.project.id=3328a8fb9c40430098d4cb6799ba7591&role.id=e49df2a8408b4f5fa7e284575007ce83 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:18.857621 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5cd5f-6887-4047-8104-42c3f7c5ce43 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:18.858139 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5cd5f-6887-4047-8104-42c3f7c5ce43 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:18.858250 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5cd5f-6887-4047-8104-42c3f7c5ce43 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:18.859975 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 93/181] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:01:18.865227 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d83881-e0ec-4766-8504-ca87b68b8a90 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:18.865656 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d83881-e0ec-4766-8504-ca87b68b8a90 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:18.865845 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d83881-e0ec-4766-8504-ca87b68b8a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:18.889031 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-a0d83881-e0ec-4766-8504-ca87b68b8a90 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:18.890277 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-a0d83881-e0ec-4766-8504-ca87b68b8a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:18.960561 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 89/182] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 20:01:18.974524 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6493d2b-db6f-4d8c-b080-fdbb7f7001d0 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:18.974819 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6493d2b-db6f-4d8c-b080-fdbb7f7001d0 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:18.975105 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6493d2b-db6f-4d8c-b080-fdbb7f7001d0 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:18.976911 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 94/183] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:18.982081 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d4c30-47ae-4a1a-882b-705b7396483e None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:18.982378 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d4c30-47ae-4a1a-882b-705b7396483e None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:18.982661 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d4c30-47ae-4a1a-882b-705b7396483e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:18.983706 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6493d2b-db6f-4d8c-b080-fdbb7f7001d0 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:19.014736 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-b42d4c30-47ae-4a1a-882b-705b7396483e None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:19.016522 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-b42d4c30-47ae-4a1a-882b-705b7396483e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:19.100137 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 90/184] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:19.121714 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6493d2b-db6f-4d8c-b080-fdbb7f7001d0 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:19.124664 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d4c30-47ae-4a1a-882b-705b7396483e None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:19.166987 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32aa32d-d9ca-4cb8-9b35-850460492ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:19.167811 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aa32d-d9ca-4cb8-9b35-850460492ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:19.168712 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aa32d-d9ca-4cb8-9b35-850460492ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:19.168712 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aa32d-d9ca-4cb8-9b35-850460492ea5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:19.187250 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32aa32d-d9ca-4cb8-9b35-850460492ea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:19.197246 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-e32aa32d-d9ca-4cb8-9b35-850460492ea5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 29 20:01:19.200587 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 95/185] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Mar 29 20:01:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:19.205572 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32aa32d-d9ca-4cb8-9b35-850460492ea5 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:19.232283 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d4c30-47ae-4a1a-882b-705b7396483e None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:19.267267 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664cd01-1c2c-4583-a272-73ffd3f8947f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:19.268088 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664cd01-1c2c-4583-a272-73ffd3f8947f None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:19.268371 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664cd01-1c2c-4583-a272-73ffd3f8947f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:19.268646 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664cd01-1c2c-4583-a272-73ffd3f8947f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:19.278887 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664cd01-1c2c-4583-a272-73ffd3f8947f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:19.285946 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-d664cd01-1c2c-4583-a272-73ffd3f8947f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:01:19.287134 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 91/186] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:01:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:01:19.292719 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664cd01-1c2c-4583-a272-73ffd3f8947f None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:19.326888 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32aa32d-d9ca-4cb8-9b35-850460492ea5 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:19.363693 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce47a3-8c8c-44e8-a909-703f6bd6ebe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:19.364676 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce47a3-8c8c-44e8-a909-703f6bd6ebe1 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:19.365074 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce47a3-8c8c-44e8-a909-703f6bd6ebe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:19.365686 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce47a3-8c8c-44e8-a909-703f6bd6ebe1 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:19.366707 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce47a3-8c8c-44e8-a909-703f6bd6ebe1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:19.367021 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce47a3-8c8c-44e8-a909-703f6bd6ebe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:19.368424 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce47a3-8c8c-44e8-a909-703f6bd6ebe1 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:19.378716 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 96/187] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:01:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:01:19.384097 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce47a3-8c8c-44e8-a909-703f6bd6ebe1 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:19.412751 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664cd01-1c2c-4583-a272-73ffd3f8947f None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:19.456865 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13992a82-6354-470c-bf82-d22c3bf923a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:19.457831 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13992a82-6354-470c-bf82-d22c3bf923a1 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:19.458261 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13992a82-6354-470c-bf82-d22c3bf923a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:19.458681 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13992a82-6354-470c-bf82-d22c3bf923a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:19.459594 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13992a82-6354-470c-bf82-d22c3bf923a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:19.460059 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13992a82-6354-470c-bf82-d22c3bf923a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:19.462093 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13992a82-6354-470c-bf82-d22c3bf923a1 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:19.473413 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 92/188] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:01:19.478864 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13992a82-6354-470c-bf82-d22c3bf923a1 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:19.493536 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce47a3-8c8c-44e8-a909-703f6bd6ebe1 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:19.530240 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a52459-3efd-4b05-ab17-4a8c0cabe878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:19.531478 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a52459-3efd-4b05-ab17-4a8c0cabe878 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:19.531973 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a52459-3efd-4b05-ab17-4a8c0cabe878 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:19.532319 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a52459-3efd-4b05-ab17-4a8c0cabe878 None admin] PATH_INFO: `/v3/users/0efbecf6cc184f31b9809d34075af160` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:19.546117 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a52459-3efd-4b05-ab17-4a8c0cabe878 None admin] RBAC: Authorizing `identity:get_user(user_id=0efbecf6cc184f31b9809d34075af160)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:19.547585 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a52459-3efd-4b05-ab17-4a8c0cabe878 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:19.553438 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 97/189] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:19 2022] GET /identity/v3/users/0efbecf6cc184f31b9809d34075af160 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:19.553438 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217225f9-3df0-4c4e-a818-100a77030e64 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:19.553438 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217225f9-3df0-4c4e-a818-100a77030e64 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:19.553438 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217225f9-3df0-4c4e-a818-100a77030e64 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:19.553438 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 98/190] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:19.554888 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217225f9-3df0-4c4e-a818-100a77030e64 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:19.589677 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13992a82-6354-470c-bf82-d22c3bf923a1 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:19.626214 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efaa4c4-c449-4a8d-b502-df29ef035b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:19.626951 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaa4c4-c449-4a8d-b502-df29ef035b3c None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:19.627327 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaa4c4-c449-4a8d-b502-df29ef035b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:19.627585 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaa4c4-c449-4a8d-b502-df29ef035b3c None admin] PATH_INFO: `/v3/users/0efbecf6cc184f31b9809d34075af160` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:19.628847 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efaa4c4-c449-4a8d-b502-df29ef035b3c None admin] RBAC: Authorizing `identity:get_user(user_id=0efbecf6cc184f31b9809d34075af160)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:19.630316 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efaa4c4-c449-4a8d-b502-df29ef035b3c None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:19.637350 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 93/191] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:19 2022] GET /identity/v3/users/0efbecf6cc184f31b9809d34075af160 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:19.637350 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14913338-5322-45a2-94de-2b166aad589b None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:19.637350 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14913338-5322-45a2-94de-2b166aad589b None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:19.637350 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14913338-5322-45a2-94de-2b166aad589b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:19.655725 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-14913338-5322-45a2-94de-2b166aad589b None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:19.657100 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-14913338-5322-45a2-94de-2b166aad589b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:19.663791 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217225f9-3df0-4c4e-a818-100a77030e64 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:19.698393 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63751ceb-285f-4987-a724-a6f98ae45f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:19.700178 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63751ceb-285f-4987-a724-a6f98ae45f31 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:19.700466 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63751ceb-285f-4987-a724-a6f98ae45f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:19.700743 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63751ceb-285f-4987-a724-a6f98ae45f31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:19.733322 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 94/192] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:19.733322 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14913338-5322-45a2-94de-2b166aad589b None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:19.777098 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63751ceb-285f-4987-a724-a6f98ae45f31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:19.779653 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63751ceb-285f-4987-a724-a6f98ae45f31 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:19.836149 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14913338-5322-45a2-94de-2b166aad589b None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:19.869876 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8f1ca-3648-4651-9d77-4020a6bf7f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:19.872367 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8f1ca-3648-4651-9d77-4020a6bf7f6d None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:19.872859 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8f1ca-3648-4651-9d77-4020a6bf7f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:19.873351 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8f1ca-3648-4651-9d77-4020a6bf7f6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:19.876594 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 99/193] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 29 20:01:19.878025 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63751ceb-285f-4987-a724-a6f98ae45f31 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:19.949476 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8f1ca-3648-4651-9d77-4020a6bf7f6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:19.950984 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8f1ca-3648-4651-9d77-4020a6bf7f6d None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:19.982516 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63751ceb-285f-4987-a724-a6f98ae45f31 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:20.015741 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca7bd5-453c-4ef1-ae08-bd6382c9e6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:20.016524 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca7bd5-453c-4ef1-ae08-bd6382c9e6ca None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:20.016801 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca7bd5-453c-4ef1-ae08-bd6382c9e6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:20.017099 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca7bd5-453c-4ef1-ae08-bd6382c9e6ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:20.018271 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca7bd5-453c-4ef1-ae08-bd6382c9e6ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:20.019723 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca7bd5-453c-4ef1-ae08-bd6382c9e6ca None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:20.021312 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 100/194] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:01:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:20.022145 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca7bd5-453c-4ef1-ae08-bd6382c9e6ca None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:20.047413 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 95/195] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:01:20.048729 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f5c00-fe29-4d86-9f18-656d48b69344 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:20.049019 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f5c00-fe29-4d86-9f18-656d48b69344 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:20.049319 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f5c00-fe29-4d86-9f18-656d48b69344 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:20.050998 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 96/196] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:20.051908 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f5c00-fe29-4d86-9f18-656d48b69344 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:20.118842 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca7bd5-453c-4ef1-ae08-bd6382c9e6ca None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:20.147321 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f5c00-fe29-4d86-9f18-656d48b69344 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:20.150620 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2757a-eb16-483a-9c42-455f0fd05a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:20.151468 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2757a-eb16-483a-9c42-455f0fd05a61 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:20.151747 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2757a-eb16-483a-9c42-455f0fd05a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:20.152020 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2757a-eb16-483a-9c42-455f0fd05a61 None admin] PATH_INFO: `/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:20.153279 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2757a-eb16-483a-9c42-455f0fd05a61 None admin] RBAC: Authorizing `identity:get_project(project_id=90e0b1babc6a4f59b9783fd69c68f2ce)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:20.154744 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2757a-eb16-483a-9c42-455f0fd05a61 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:20.156421 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 101/197] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:20 2022] GET /identity/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce => generated 302 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:20.157173 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2757a-eb16-483a-9c42-455f0fd05a61 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:20.180629 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fcc27-f8d5-4c9b-b280-b22b190dd156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:20.181319 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fcc27-f8d5-4c9b-b280-b22b190dd156 None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:20.181601 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fcc27-f8d5-4c9b-b280-b22b190dd156 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:20.181877 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fcc27-f8d5-4c9b-b280-b22b190dd156 None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:20.182580 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fcc27-f8d5-4c9b-b280-b22b190dd156 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:20.185185 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fcc27-f8d5-4c9b-b280-b22b190dd156 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:20.255166 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2757a-eb16-483a-9c42-455f0fd05a61 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:20.276922 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 97/198] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Mar 29 20:01:20 2022] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:01:20.286729 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7320b-b11a-4a84-8170-52d8aa4e6e6c None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:20.287031 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7320b-b11a-4a84-8170-52d8aa4e6e6c None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:20.287370 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7320b-b11a-4a84-8170-52d8aa4e6e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:20.288432 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da72444-9afd-44ee-8022-7d6753fa9817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:20.289397 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da72444-9afd-44ee-8022-7d6753fa9817 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:20.289681 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da72444-9afd-44ee-8022-7d6753fa9817 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:20.289954 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da72444-9afd-44ee-8022-7d6753fa9817 None admin] PATH_INFO: `/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:20.291241 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da72444-9afd-44ee-8022-7d6753fa9817 None admin] RBAC: Authorizing `identity:get_project(project_id=90e0b1babc6a4f59b9783fd69c68f2ce)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:20.292741 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da72444-9afd-44ee-8022-7d6753fa9817 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:20.296005 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 102/199] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:20 2022] GET /identity/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:20.296625 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da72444-9afd-44ee-8022-7d6753fa9817 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:20.305422 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-aac7320b-b11a-4a84-8170-52d8aa4e6e6c None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:20.306668 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-aac7320b-b11a-4a84-8170-52d8aa4e6e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:20.378938 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 98/200] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:20.380359 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7320b-b11a-4a84-8170-52d8aa4e6e6c None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:20.419526 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da72444-9afd-44ee-8022-7d6753fa9817 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:20.454995 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81933dfd-6bf1-4038-b204-544a536923d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:20.455582 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81933dfd-6bf1-4038-b204-544a536923d5 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:20.455869 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81933dfd-6bf1-4038-b204-544a536923d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:20.456155 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81933dfd-6bf1-4038-b204-544a536923d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:20.456985 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81933dfd-6bf1-4038-b204-544a536923d5 None admin] RBAC: Adding query filter params (role.id=82747af757b549cbaa39504334f32f9f, scope.project.id=90e0b1babc6a4f59b9783fd69c68f2ce, user.id=0efbecf6cc184f31b9809d34075af160) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:20.457317 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81933dfd-6bf1-4038-b204-544a536923d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:20.458798 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81933dfd-6bf1-4038-b204-544a536923d5 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:20.466316 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 103/201] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:01:20 2022] GET /identity/v3/role_assignments?user.id=0efbecf6cc184f31b9809d34075af160&scope.project.id=90e0b1babc6a4f59b9783fd69c68f2ce&role.id=82747af757b549cbaa39504334f32f9f => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:20.467174 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81933dfd-6bf1-4038-b204-544a536923d5 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:20.493499 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7320b-b11a-4a84-8170-52d8aa4e6e6c None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:20.545218 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c8d4c-144b-4182-8625-114672ad0efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:20.545929 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c8d4c-144b-4182-8625-114672ad0efd None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:20.546215 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c8d4c-144b-4182-8625-114672ad0efd None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:20.546491 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c8d4c-144b-4182-8625-114672ad0efd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:20.547345 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c8d4c-144b-4182-8625-114672ad0efd None admin] RBAC: Adding query filter params (role.id=8cfa924df1a1400986d9ecc9686a7f52, scope.project.id=90e0b1babc6a4f59b9783fd69c68f2ce, user.id=0efbecf6cc184f31b9809d34075af160) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:20.547661 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c8d4c-144b-4182-8625-114672ad0efd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:20.549129 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c8d4c-144b-4182-8625-114672ad0efd None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:20.557337 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 99/202] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:01:20 2022] GET /identity/v3/role_assignments?user.id=0efbecf6cc184f31b9809d34075af160&scope.project.id=90e0b1babc6a4f59b9783fd69c68f2ce&role.id=8cfa924df1a1400986d9ecc9686a7f52 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:20.599397 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81933dfd-6bf1-4038-b204-544a536923d5 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:20.644021 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461ddac-ec96-4978-adbc-a6335a94ae6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:20.645152 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461ddac-ec96-4978-adbc-a6335a94ae6c None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:20.645630 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461ddac-ec96-4978-adbc-a6335a94ae6c None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:20.646067 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461ddac-ec96-4978-adbc-a6335a94ae6c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:20.659781 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461ddac-ec96-4978-adbc-a6335a94ae6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:20.667509 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-1461ddac-ec96-4978-adbc-a6335a94ae6c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 29 20:01:20.670353 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 104/203] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:20.676046 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c8d4c-144b-4182-8625-114672ad0efd None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:20.789275 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c8d4c-144b-4182-8625-114672ad0efd None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:20.823392 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2b7ac-ca83-4c72-b692-a60e55acf9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:20.825005 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2b7ac-ca83-4c72-b692-a60e55acf9d1 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:20.825487 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2b7ac-ca83-4c72-b692-a60e55acf9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:20.825761 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2b7ac-ca83-4c72-b692-a60e55acf9d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:20.826518 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2b7ac-ca83-4c72-b692-a60e55acf9d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:20.826824 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2b7ac-ca83-4c72-b692-a60e55acf9d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:20.828203 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2b7ac-ca83-4c72-b692-a60e55acf9d1 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:20.836792 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 100/204] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:01:20.842507 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461ddac-ec96-4978-adbc-a6335a94ae6c None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:20.954224 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461ddac-ec96-4978-adbc-a6335a94ae6c None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:20.996834 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2663c7-739b-4e67-aa2e-342c460defc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:20.997829 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2663c7-739b-4e67-aa2e-342c460defc0 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:20.998115 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2663c7-739b-4e67-aa2e-342c460defc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:20.998393 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2663c7-739b-4e67-aa2e-342c460defc0 None admin] PATH_INFO: `/v3/users/95a8ae2a89a34376b20b6f07c0123a2d` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:20.999622 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2663c7-739b-4e67-aa2e-342c460defc0 None admin] RBAC: Authorizing `identity:get_user(user_id=95a8ae2a89a34376b20b6f07c0123a2d)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:21.001097 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2663c7-739b-4e67-aa2e-342c460defc0 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:21.003087 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 105/205] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:20 2022] GET /identity/v3/users/95a8ae2a89a34376b20b6f07c0123a2d => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:21.010509 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2b7ac-ca83-4c72-b692-a60e55acf9d1 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:21.146508 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2b7ac-ca83-4c72-b692-a60e55acf9d1 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:21.190436 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83211640-84d9-47f5-96bb-094f41ad3811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:21.191090 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83211640-84d9-47f5-96bb-094f41ad3811 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:21.191379 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83211640-84d9-47f5-96bb-094f41ad3811 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:21.191664 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83211640-84d9-47f5-96bb-094f41ad3811 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:21.287599 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83211640-84d9-47f5-96bb-094f41ad3811 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:21.289073 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83211640-84d9-47f5-96bb-094f41ad3811 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:21.419663 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 101/206] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:01:21.424674 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2663c7-739b-4e67-aa2e-342c460defc0 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:21.586629 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2663c7-739b-4e67-aa2e-342c460defc0 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:21.633777 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cefce-671b-4427-9d0a-8a17e11f7c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:21.635024 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cefce-671b-4427-9d0a-8a17e11f7c9f None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:21.635505 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cefce-671b-4427-9d0a-8a17e11f7c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:21.635977 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cefce-671b-4427-9d0a-8a17e11f7c9f None admin] PATH_INFO: `/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:21.642019 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94cefce-671b-4427-9d0a-8a17e11f7c9f None admin] RBAC: Authorizing `identity:get_project(project_id=fec2338df2a64a9a9b5d8a9b527bbf26)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:21.643701 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94cefce-671b-4427-9d0a-8a17e11f7c9f None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:21.645935 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 106/207] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:21 2022] GET /identity/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:21.651300 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83211640-84d9-47f5-96bb-094f41ad3811 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:21.805245 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83211640-84d9-47f5-96bb-094f41ad3811 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:21.849491 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23ffc5-3fc1-4856-95e9-0570932a6228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:21.850213 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23ffc5-3fc1-4856-95e9-0570932a6228 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:21.850499 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23ffc5-3fc1-4856-95e9-0570932a6228 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:21.850819 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23ffc5-3fc1-4856-95e9-0570932a6228 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:21.851664 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23ffc5-3fc1-4856-95e9-0570932a6228 None admin] RBAC: Adding query filter params (role.id=cd320364ae634461bc6ce03abdb40fa8, scope.project.id=fec2338df2a64a9a9b5d8a9b527bbf26, user.id=95a8ae2a89a34376b20b6f07c0123a2d) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:21.851979 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23ffc5-3fc1-4856-95e9-0570932a6228 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:21.853461 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23ffc5-3fc1-4856-95e9-0570932a6228 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:21.862669 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 102/208] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:01:21 2022] GET /identity/v3/role_assignments?user.id=95a8ae2a89a34376b20b6f07c0123a2d&scope.project.id=fec2338df2a64a9a9b5d8a9b527bbf26&role.id=cd320364ae634461bc6ce03abdb40fa8 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:23.178692 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b226c8-44f0-4340-ae9f-c04d2d3f6f9d None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:23.179199 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b226c8-44f0-4340-ae9f-c04d2d3f6f9d None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:23.179273 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b226c8-44f0-4340-ae9f-c04d2d3f6f9d None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:23.181317 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 107/209] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:23.185082 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf83d9b-9b5d-498a-a0f6-bff3fe5ce393 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:23.185573 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf83d9b-9b5d-498a-a0f6-bff3fe5ce393 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:23.185649 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf83d9b-9b5d-498a-a0f6-bff3fe5ce393 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:23.187490 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 103/210] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:23.191512 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71160a-929a-4f4b-b00e-3ba50b2f141c None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:23.191805 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71160a-929a-4f4b-b00e-3ba50b2f141c None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:23.192087 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71160a-929a-4f4b-b00e-3ba50b2f141c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:23.194950 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a431c-26b8-420c-9040-74e1b75ef02e None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:23.195471 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a431c-26b8-420c-9040-74e1b75ef02e None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:23.195950 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a431c-26b8-420c-9040-74e1b75ef02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:23.210493 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-ae71160a-929a-4f4b-b00e-3ba50b2f141c None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:23.211671 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-ae71160a-929a-4f4b-b00e-3ba50b2f141c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:23.214586 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-715a431c-26b8-420c-9040-74e1b75ef02e None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:23.216660 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-715a431c-26b8-420c-9040-74e1b75ef02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:23.279022 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 108/211] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:23.280680 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dae25-596c-4c1e-b5fa-1a75af3ff01f None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:23.281115 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dae25-596c-4c1e-b5fa-1a75af3ff01f None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:23.281586 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dae25-596c-4c1e-b5fa-1a75af3ff01f None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:23.283719 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 109/212] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:23.285110 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4291e9-f654-4ae4-95d7-ccdb01665808 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:23.285437 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4291e9-f654-4ae4-95d7-ccdb01665808 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:23.285703 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4291e9-f654-4ae4-95d7-ccdb01665808 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:23.287665 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 110/213] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:23.291160 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf050db2-e051-444b-a151-b5c902d1814f None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:23.291160 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf050db2-e051-444b-a151-b5c902d1814f None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:23.291160 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf050db2-e051-444b-a151-b5c902d1814f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:23.291342 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 104/214] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 20:01:23.293252 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559453eb-4f1a-49bd-9a42-63a2275985be None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:23.293625 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559453eb-4f1a-49bd-9a42-63a2275985be None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:23.293908 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559453eb-4f1a-49bd-9a42-63a2275985be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:23.310742 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-559453eb-4f1a-49bd-9a42-63a2275985be None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:23.311919 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-559453eb-4f1a-49bd-9a42-63a2275985be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:23.315511 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-bf050db2-e051-444b-a151-b5c902d1814f None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:23.316656 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-bf050db2-e051-444b-a151-b5c902d1814f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:23.376376 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 105/215] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 20:01:23.377283 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559453eb-4f1a-49bd-9a42-63a2275985be None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:23.389811 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 111/216] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:23.389811 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf050db2-e051-444b-a151-b5c902d1814f None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:23.476529 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559453eb-4f1a-49bd-9a42-63a2275985be None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:23.486954 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf050db2-e051-444b-a151-b5c902d1814f None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:23.508649 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579d88b-948e-4f46-85c7-ef56bcb3dd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:23.509554 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579d88b-948e-4f46-85c7-ef56bcb3dd7e None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:23.509859 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579d88b-948e-4f46-85c7-ef56bcb3dd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:23.510140 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579d88b-948e-4f46-85c7-ef56bcb3dd7e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:23.518972 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d70818-0453-4742-8814-6c5485d68749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:23.519866 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d70818-0453-4742-8814-6c5485d68749 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:23.520092 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579d88b-948e-4f46-85c7-ef56bcb3dd7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:23.520275 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d70818-0453-4742-8814-6c5485d68749 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:23.520617 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d70818-0453-4742-8814-6c5485d68749 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:23.528276 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-0579d88b-948e-4f46-85c7-ef56bcb3dd7e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 29 20:01:23.529662 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 106/217] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Mar 29 20:01:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:23.530242 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579d88b-948e-4f46-85c7-ef56bcb3dd7e None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:23.531126 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d70818-0453-4742-8814-6c5485d68749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:23.538164 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-c6d70818-0453-4742-8814-6c5485d68749 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 20:01:23.539344 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 112/218] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:23.540109 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d70818-0453-4742-8814-6c5485d68749 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:23.628315 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579d88b-948e-4f46-85c7-ef56bcb3dd7e None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:23.633676 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d70818-0453-4742-8814-6c5485d68749 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:23.659980 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564a61b-3fff-4614-bfd3-060b4ef64902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:23.660765 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564a61b-3fff-4614-bfd3-060b4ef64902 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:23.661054 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564a61b-3fff-4614-bfd3-060b4ef64902 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:23.661361 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564a61b-3fff-4614-bfd3-060b4ef64902 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:23.665403 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257517b-9b41-4c2b-b331-e8e338088413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:23.666199 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257517b-9b41-4c2b-b331-e8e338088413 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:23.666464 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257517b-9b41-4c2b-b331-e8e338088413 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:23.666736 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257517b-9b41-4c2b-b331-e8e338088413 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:23.667919 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257517b-9b41-4c2b-b331-e8e338088413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:23.669553 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257517b-9b41-4c2b-b331-e8e338088413 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:23.671158 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 113/219] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:01:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:23.671260 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564a61b-3fff-4614-bfd3-060b4ef64902 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:23.671920 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257517b-9b41-4c2b-b331-e8e338088413 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:23.678272 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-8564a61b-3fff-4614-bfd3-060b4ef64902 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:01:23.680569 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 107/220] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:01:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:23.680569 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564a61b-3fff-4614-bfd3-060b4ef64902 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:23.772831 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257517b-9b41-4c2b-b331-e8e338088413 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:23.775236 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564a61b-3fff-4614-bfd3-060b4ef64902 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:23.804929 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d144d-2532-4f34-88b2-d5b47c826308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:23.805635 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d144d-2532-4f34-88b2-d5b47c826308 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:23.805920 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d144d-2532-4f34-88b2-d5b47c826308 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:23.806201 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d144d-2532-4f34-88b2-d5b47c826308 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:23.806705 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a255d3-0144-4e82-aad5-63bc0a24e195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:23.806940 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d144d-2532-4f34-88b2-d5b47c826308 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:23.807250 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d144d-2532-4f34-88b2-d5b47c826308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:23.807366 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a255d3-0144-4e82-aad5-63bc0a24e195 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:23.807654 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a255d3-0144-4e82-aad5-63bc0a24e195 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:23.807937 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a255d3-0144-4e82-aad5-63bc0a24e195 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:23.809192 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d144d-2532-4f34-88b2-d5b47c826308 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:23.809657 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a255d3-0144-4e82-aad5-63bc0a24e195 None admin] RBAC: Adding query filter params (name=member) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:23.810000 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a255d3-0144-4e82-aad5-63bc0a24e195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:23.811380 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a255d3-0144-4e82-aad5-63bc0a24e195 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:23.816924 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 114/221] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:01:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:23.817724 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d144d-2532-4f34-88b2-d5b47c826308 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:23.820395 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 108/222] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:23.821183 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a255d3-0144-4e82-aad5-63bc0a24e195 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:23.912085 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d144d-2532-4f34-88b2-d5b47c826308 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:23.913389 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a255d3-0144-4e82-aad5-63bc0a24e195 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:23.946064 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1ba6e-7567-49b2-b43b-dab7bc3c56b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:23.946239 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2bcfae-2703-4d21-bc38-ff9c3e57cb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:23.946740 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1ba6e-7567-49b2-b43b-dab7bc3c56b0 None admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:23.946858 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bcfae-2703-4d21-bc38-ff9c3e57cb49 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:23.947020 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1ba6e-7567-49b2-b43b-dab7bc3c56b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:23.947117 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bcfae-2703-4d21-bc38-ff9c3e57cb49 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:23.947294 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1ba6e-7567-49b2-b43b-dab7bc3c56b0 None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:23.947388 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bcfae-2703-4d21-bc38-ff9c3e57cb49 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:23.948005 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1ba6e-7567-49b2-b43b-dab7bc3c56b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:23.948098 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2bcfae-2703-4d21-bc38-ff9c3e57cb49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:23.948668 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2bcfae-2703-4d21-bc38-ff9c3e57cb49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:23.950127 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1ba6e-7567-49b2-b43b-dab7bc3c56b0 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:23.950230 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2bcfae-2703-4d21-bc38-ff9c3e57cb49 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:23.958579 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 109/223] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:23.959376 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2bcfae-2703-4d21-bc38-ff9c3e57cb49 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:24.054053 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2bcfae-2703-4d21-bc38-ff9c3e57cb49 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:24.086448 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d252f-200a-40ff-b2e2-465fdef4b630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:24.087316 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d252f-200a-40ff-b2e2-465fdef4b630 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:24.087604 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d252f-200a-40ff-b2e2-465fdef4b630 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:24.087886 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d252f-200a-40ff-b2e2-465fdef4b630 None admin] PATH_INFO: `/v3/users/0efbecf6cc184f31b9809d34075af160` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:24.089074 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d252f-200a-40ff-b2e2-465fdef4b630 None admin] RBAC: Authorizing `identity:get_user(user_id=0efbecf6cc184f31b9809d34075af160)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:24.091050 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d252f-200a-40ff-b2e2-465fdef4b630 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:24.092663 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 110/224] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:23 2022] GET /identity/v3/users/0efbecf6cc184f31b9809d34075af160 => generated 283 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:24.093451 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d252f-200a-40ff-b2e2-465fdef4b630 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:24.188426 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d252f-200a-40ff-b2e2-465fdef4b630 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:24.220964 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139140b-8f4a-4608-acbb-102c6195750f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:24.221846 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139140b-8f4a-4608-acbb-102c6195750f None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:24.222134 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139140b-8f4a-4608-acbb-102c6195750f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:24.222414 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139140b-8f4a-4608-acbb-102c6195750f None admin] PATH_INFO: `/v3/users/fa6855ce28094c438341192a7ef721ad` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:24.232011 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 115/225] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Mar 29 20:01:23 2022] POST /identity/v3/users => generated 297 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:01:24.232838 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1ba6e-7567-49b2-b43b-dab7bc3c56b0 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:24.236852 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139140b-8f4a-4608-acbb-102c6195750f None admin] RBAC: Authorizing `identity:get_user(user_id=fa6855ce28094c438341192a7ef721ad)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:24.237772 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139140b-8f4a-4608-acbb-102c6195750f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:24.239530 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 111/226] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:24 2022] GET /identity/v3/users/fa6855ce28094c438341192a7ef721ad => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:24.240336 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139140b-8f4a-4608-acbb-102c6195750f None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:24.341329 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1ba6e-7567-49b2-b43b-dab7bc3c56b0 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:24.353757 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139140b-8f4a-4608-acbb-102c6195750f None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:24.376233 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec38aa-38d9-41de-8076-e451fc88635f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:24.376956 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec38aa-38d9-41de-8076-e451fc88635f None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:24.377240 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec38aa-38d9-41de-8076-e451fc88635f None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:24.377550 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec38aa-38d9-41de-8076-e451fc88635f None admin] PATH_INFO: `/v3/users/0efbecf6cc184f31b9809d34075af160` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:24.378774 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec38aa-38d9-41de-8076-e451fc88635f None admin] RBAC: Authorizing `identity:get_user(user_id=0efbecf6cc184f31b9809d34075af160)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:24.380238 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec38aa-38d9-41de-8076-e451fc88635f None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:24.382092 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 116/227] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:24 2022] GET /identity/v3/users/0efbecf6cc184f31b9809d34075af160 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:24.382765 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec38aa-38d9-41de-8076-e451fc88635f None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:24.393280 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294eb28-7b7b-4a4e-b981-23ae098c24da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:24.394750 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294eb28-7b7b-4a4e-b981-23ae098c24da None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:24.395042 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294eb28-7b7b-4a4e-b981-23ae098c24da None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:24.395326 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294eb28-7b7b-4a4e-b981-23ae098c24da None admin] PATH_INFO: `/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:24.397319 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294eb28-7b7b-4a4e-b981-23ae098c24da None admin] RBAC: Authorizing `identity:get_project(project_id=90e0b1babc6a4f59b9783fd69c68f2ce)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:24.399140 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294eb28-7b7b-4a4e-b981-23ae098c24da None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:24.407127 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 112/228] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:24 2022] GET /identity/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:24.407127 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294eb28-7b7b-4a4e-b981-23ae098c24da None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:24.495885 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec38aa-38d9-41de-8076-e451fc88635f None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:24.510611 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294eb28-7b7b-4a4e-b981-23ae098c24da None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:24.531996 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c068e1-fd00-40d2-b41a-0e10a1fed533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:24.532659 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c068e1-fd00-40d2-b41a-0e10a1fed533 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:24.532950 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c068e1-fd00-40d2-b41a-0e10a1fed533 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:24.533234 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c068e1-fd00-40d2-b41a-0e10a1fed533 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:24.547131 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046cfd7-9b76-4761-bc9d-0b287662d56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:24.548229 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046cfd7-9b76-4761-bc9d-0b287662d56a None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:24.548649 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046cfd7-9b76-4761-bc9d-0b287662d56a None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:24.549059 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046cfd7-9b76-4761-bc9d-0b287662d56a None admin] PATH_INFO: `/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:24.550449 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046cfd7-9b76-4761-bc9d-0b287662d56a None admin] RBAC: Authorizing `identity:get_project(project_id=90e0b1babc6a4f59b9783fd69c68f2ce)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:24.551912 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046cfd7-9b76-4761-bc9d-0b287662d56a None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:24.553877 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 113/229] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:24 2022] GET /identity/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:24.554527 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046cfd7-9b76-4761-bc9d-0b287662d56a None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:24.610482 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c068e1-fd00-40d2-b41a-0e10a1fed533 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:24.611909 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c068e1-fd00-40d2-b41a-0e10a1fed533 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:24.669165 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046cfd7-9b76-4761-bc9d-0b287662d56a None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:24.704731 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365e607-c660-4f1d-ad99-121ccc655325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:24.705743 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365e607-c660-4f1d-ad99-121ccc655325 None admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:24.706025 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365e607-c660-4f1d-ad99-121ccc655325 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:24.706301 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365e607-c660-4f1d-ad99-121ccc655325 None admin] PATH_INFO: `/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce/users/0efbecf6cc184f31b9809d34075af160/roles/82747af757b549cbaa39504334f32f9f` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:24.708566 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365e607-c660-4f1d-ad99-121ccc655325 None admin] RBAC: Authorizing `identity:create_grant(project_id=90e0b1babc6a4f59b9783fd69c68f2ce, user_id=0efbecf6cc184f31b9809d34075af160, role_id=82747af757b549cbaa39504334f32f9f)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:24.710071 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365e607-c660-4f1d-ad99-121ccc655325 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:24.715687 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 117/230] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:01:24.716878 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c068e1-fd00-40d2-b41a-0e10a1fed533 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:24.786523 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 114/231] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Mar 29 20:01:24 2022] PUT /identity/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce/users/0efbecf6cc184f31b9809d34075af160/roles/82747af757b549cbaa39504334f32f9f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:01:24.787447 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365e607-c660-4f1d-ad99-121ccc655325 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:24.820590 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c068e1-fd00-40d2-b41a-0e10a1fed533 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:24.858711 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79fdd2-e460-48f2-893a-a2aa350c1b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:24.859955 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79fdd2-e460-48f2-893a-a2aa350c1b3a None admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:24.860465 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79fdd2-e460-48f2-893a-a2aa350c1b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:24.860991 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79fdd2-e460-48f2-893a-a2aa350c1b3a None admin] PATH_INFO: `/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce/users/0efbecf6cc184f31b9809d34075af160/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:24.863254 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79fdd2-e460-48f2-893a-a2aa350c1b3a None admin] RBAC: Authorizing `identity:create_grant(project_id=90e0b1babc6a4f59b9783fd69c68f2ce, user_id=0efbecf6cc184f31b9809d34075af160, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:24.864964 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79fdd2-e460-48f2-893a-a2aa350c1b3a None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:24.943244 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 118/232] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Mar 29 20:01:24 2022] PUT /identity/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce/users/0efbecf6cc184f31b9809d34075af160/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:01:24.948922 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365e607-c660-4f1d-ad99-121ccc655325 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:24.988918 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169da2b8-7f33-46d7-8918-0a46f9d18d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:24.989933 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169da2b8-7f33-46d7-8918-0a46f9d18d4f None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:24.990250 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169da2b8-7f33-46d7-8918-0a46f9d18d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:24.990532 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169da2b8-7f33-46d7-8918-0a46f9d18d4f None admin] PATH_INFO: `/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:24.991804 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169da2b8-7f33-46d7-8918-0a46f9d18d4f None admin] RBAC: Authorizing `identity:get_project(project_id=90e0b1babc6a4f59b9783fd69c68f2ce)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:24.993367 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169da2b8-7f33-46d7-8918-0a46f9d18d4f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:24.995361 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 115/233] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:24 2022] GET /identity/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:25.001390 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79fdd2-e460-48f2-893a-a2aa350c1b3a None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:25.138126 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79fdd2-e460-48f2-893a-a2aa350c1b3a None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:25.181188 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c2ade-25a6-48be-99ae-ba259541fcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:25.181879 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c2ade-25a6-48be-99ae-ba259541fcf5 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:25.182210 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c2ade-25a6-48be-99ae-ba259541fcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:25.182440 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c2ade-25a6-48be-99ae-ba259541fcf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:25.183819 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c2ade-25a6-48be-99ae-ba259541fcf5 None admin] RBAC: Adding query filter params (role.id=e49df2a8408b4f5fa7e284575007ce83, scope.project.id=90e0b1babc6a4f59b9783fd69c68f2ce, user.id=fa6855ce28094c438341192a7ef721ad) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:25.184797 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c2ade-25a6-48be-99ae-ba259541fcf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:25.186293 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c2ade-25a6-48be-99ae-ba259541fcf5 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:25.193222 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 119/234] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:01:25 2022] GET /identity/v3/role_assignments?user.id=fa6855ce28094c438341192a7ef721ad&scope.project.id=90e0b1babc6a4f59b9783fd69c68f2ce&role.id=e49df2a8408b4f5fa7e284575007ce83 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:27.082280 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16574b92-7189-49b2-89ac-5b68734dfa67 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:27.083300 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16574b92-7189-49b2-89ac-5b68734dfa67 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:27.083783 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16574b92-7189-49b2-89ac-5b68734dfa67 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:27.086237 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 116/235] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:27.092116 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a8dc4-5a37-42e2-b78a-f6c5b24b0460 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:27.092962 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a8dc4-5a37-42e2-b78a-f6c5b24b0460 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:27.093475 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a8dc4-5a37-42e2-b78a-f6c5b24b0460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:27.118323 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-9e0a8dc4-5a37-42e2-b78a-f6c5b24b0460 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:27.119862 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-9e0a8dc4-5a37-42e2-b78a-f6c5b24b0460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:27.209195 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 120/236] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:27.244390 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16574b92-7189-49b2-89ac-5b68734dfa67 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:27.372410 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16574b92-7189-49b2-89ac-5b68734dfa67 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:27.419519 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab140087-2264-4b25-9886-c766d15cef77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:27.420703 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab140087-2264-4b25-9886-c766d15cef77 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:27.421197 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab140087-2264-4b25-9886-c766d15cef77 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:27.421685 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab140087-2264-4b25-9886-c766d15cef77 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:27.430948 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f80cbd-5e2a-4cf5-be45-552efb2df08f None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:27.431518 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f80cbd-5e2a-4cf5-be45-552efb2df08f None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:27.432009 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f80cbd-5e2a-4cf5-be45-552efb2df08f None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:27.435527 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 121/237] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:27.440396 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd96ba-806f-44ca-96d5-1f6639459a73 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:27.440692 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd96ba-806f-44ca-96d5-1f6639459a73 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:27.440973 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd96ba-806f-44ca-96d5-1f6639459a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:27.451328 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab140087-2264-4b25-9886-c766d15cef77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:27.462838 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-ab140087-2264-4b25-9886-c766d15cef77 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 29 20:01:27.465117 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 117/238] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:27.466597 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d6d99-71d6-4221-9af0-eec93816ecaa None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:27.467124 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d6d99-71d6-4221-9af0-eec93816ecaa None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:27.467627 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d6d99-71d6-4221-9af0-eec93816ecaa None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:27.473422 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-73cd96ba-806f-44ca-96d5-1f6639459a73 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:27.473422 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-73cd96ba-806f-44ca-96d5-1f6639459a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:27.473766 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 118/239] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:27.474742 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d6d99-71d6-4221-9af0-eec93816ecaa None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:27.562561 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 122/240] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:27.564267 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea60f1-bf6a-40c6-9a60-836a359bb2ac None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:27.564555 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea60f1-bf6a-40c6-9a60-836a359bb2ac None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:27.564834 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea60f1-bf6a-40c6-9a60-836a359bb2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:27.585730 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-6fea60f1-bf6a-40c6-9a60-836a359bb2ac None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:27.586904 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d6d99-71d6-4221-9af0-eec93816ecaa None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:27.587035 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-6fea60f1-bf6a-40c6-9a60-836a359bb2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:27.628608 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b4d5a-2ca3-4c19-a23e-167c6a1fa3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:27.629281 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b4d5a-2ca3-4c19-a23e-167c6a1fa3ba None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:27.629593 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b4d5a-2ca3-4c19-a23e-167c6a1fa3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:27.629876 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b4d5a-2ca3-4c19-a23e-167c6a1fa3ba None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:27.630640 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b4d5a-2ca3-4c19-a23e-167c6a1fa3ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:27.630950 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b4d5a-2ca3-4c19-a23e-167c6a1fa3ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:27.632325 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b4d5a-2ca3-4c19-a23e-167c6a1fa3ba None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:27.641675 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 119/241] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:27.642408 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b4d5a-2ca3-4c19-a23e-167c6a1fa3ba None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:27.662156 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 123/242] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:27.670459 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea60f1-bf6a-40c6-9a60-836a359bb2ac None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:27.742221 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b4d5a-2ca3-4c19-a23e-167c6a1fa3ba None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:27.778111 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6443b7-1631-4b4f-9bdf-0b5b15de35d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:27.778932 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6443b7-1631-4b4f-9bdf-0b5b15de35d7 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:27.779216 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6443b7-1631-4b4f-9bdf-0b5b15de35d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:27.779497 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6443b7-1631-4b4f-9bdf-0b5b15de35d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:27.789883 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6443b7-1631-4b4f-9bdf-0b5b15de35d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:27.793488 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea60f1-bf6a-40c6-9a60-836a359bb2ac None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:27.798119 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-4e6443b7-1631-4b4f-9bdf-0b5b15de35d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 29 20:01:27.799337 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 120/243] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Mar 29 20:01:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:27.800120 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6443b7-1631-4b4f-9bdf-0b5b15de35d7 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:27.832375 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e8e05-78e4-4417-ad24-010306b76548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:27.833716 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e8e05-78e4-4417-ad24-010306b76548 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:27.834221 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e8e05-78e4-4417-ad24-010306b76548 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:27.834689 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e8e05-78e4-4417-ad24-010306b76548 None admin] PATH_INFO: `/v3/users/c38d7c0cf2964094bf8b8e94f3391eb2` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:27.850457 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e8e05-78e4-4417-ad24-010306b76548 None admin] RBAC: Authorizing `identity:get_user(user_id=c38d7c0cf2964094bf8b8e94f3391eb2)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:27.852259 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e8e05-78e4-4417-ad24-010306b76548 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:27.854299 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 124/244] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:27 2022] GET /identity/v3/users/c38d7c0cf2964094bf8b8e94f3391eb2 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:27.855475 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e8e05-78e4-4417-ad24-010306b76548 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:27.905403 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6443b7-1631-4b4f-9bdf-0b5b15de35d7 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:27.940760 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cfada-d5a1-4457-a059-a68b0c9ab136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:27.943865 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cfada-d5a1-4457-a059-a68b0c9ab136 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:27.943865 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cfada-d5a1-4457-a059-a68b0c9ab136 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:27.943865 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cfada-d5a1-4457-a059-a68b0c9ab136 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:27.943865 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cfada-d5a1-4457-a059-a68b0c9ab136 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:27.944839 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cfada-d5a1-4457-a059-a68b0c9ab136 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:27.946504 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 121/245] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:01:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:27.952106 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cfada-d5a1-4457-a059-a68b0c9ab136 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:27.972949 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e8e05-78e4-4417-ad24-010306b76548 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:28.006703 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d82d10-036a-4473-920c-ef8ce0617392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:28.007294 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d82d10-036a-4473-920c-ef8ce0617392 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:28.007579 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d82d10-036a-4473-920c-ef8ce0617392 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:28.007856 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d82d10-036a-4473-920c-ef8ce0617392 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:28.008601 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d82d10-036a-4473-920c-ef8ce0617392 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:28.008910 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d82d10-036a-4473-920c-ef8ce0617392 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:28.010328 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d82d10-036a-4473-920c-ef8ce0617392 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:28.019400 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 125/246] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:01:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:28.020682 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3d154-2ac5-4639-aa2d-f6c9938e19e9 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:28.020975 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3d154-2ac5-4639-aa2d-f6c9938e19e9 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:28.021270 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3d154-2ac5-4639-aa2d-f6c9938e19e9 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:28.023113 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 126/247] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:28.027904 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3d154-2ac5-4639-aa2d-f6c9938e19e9 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:28.075238 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cfada-d5a1-4457-a059-a68b0c9ab136 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:28.111888 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944f09d-61ab-4b4f-8f31-265671997951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:28.112776 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944f09d-61ab-4b4f-8f31-265671997951 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:28.112863 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944f09d-61ab-4b4f-8f31-265671997951 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:28.113104 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944f09d-61ab-4b4f-8f31-265671997951 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:28.134023 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3d154-2ac5-4639-aa2d-f6c9938e19e9 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:28.170327 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a56657-c90d-4839-882c-0c826e1d599f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:28.171238 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a56657-c90d-4839-882c-0c826e1d599f None admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:28.171519 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a56657-c90d-4839-882c-0c826e1d599f None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:28.171792 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a56657-c90d-4839-882c-0c826e1d599f None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:28.172494 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a56657-c90d-4839-882c-0c826e1d599f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:28.174004 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a56657-c90d-4839-882c-0c826e1d599f None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:28.184823 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944f09d-61ab-4b4f-8f31-265671997951 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:28.186434 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944f09d-61ab-4b4f-8f31-265671997951 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:28.259365 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 127/248] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Mar 29 20:01:28 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:01:28.260136 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a56657-c90d-4839-882c-0c826e1d599f None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:28.283956 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 122/249] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:01:28.285414 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccd042-3678-4a3b-a5e3-655a2b739f11 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:28.285776 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccd042-3678-4a3b-a5e3-655a2b739f11 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:28.286000 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccd042-3678-4a3b-a5e3-655a2b739f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:28.305085 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-e0ccd042-3678-4a3b-a5e3-655a2b739f11 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:28.306659 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-e0ccd042-3678-4a3b-a5e3-655a2b739f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:28.382251 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 123/250] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:28.383627 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7fd2c-35b1-4dfe-8d7f-ae622603f39a None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:28.383921 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7fd2c-35b1-4dfe-8d7f-ae622603f39a None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:28.384205 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7fd2c-35b1-4dfe-8d7f-ae622603f39a None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:28.384941 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a56657-c90d-4839-882c-0c826e1d599f None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:28.389331 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 124/251] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:28.389331 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7fd2c-35b1-4dfe-8d7f-ae622603f39a None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:28.428985 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149834d-d643-4a03-ba55-544cffb78893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:28.430016 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149834d-d643-4a03-ba55-544cffb78893 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:28.430302 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149834d-d643-4a03-ba55-544cffb78893 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:28.430591 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149834d-d643-4a03-ba55-544cffb78893 None admin] PATH_INFO: `/v3/users/0efbecf6cc184f31b9809d34075af160` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:28.434269 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149834d-d643-4a03-ba55-544cffb78893 None admin] RBAC: Authorizing `identity:get_user(user_id=0efbecf6cc184f31b9809d34075af160)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:28.435801 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149834d-d643-4a03-ba55-544cffb78893 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:28.442030 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 128/252] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:28 2022] GET /identity/v3/users/0efbecf6cc184f31b9809d34075af160 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:28.442030 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd355b81-01d6-410a-a5ce-a627fd7d1f16 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:28.442030 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd355b81-01d6-410a-a5ce-a627fd7d1f16 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:28.442030 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd355b81-01d6-410a-a5ce-a627fd7d1f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:28.456892 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-cd355b81-01d6-410a-a5ce-a627fd7d1f16 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:28.458143 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-cd355b81-01d6-410a-a5ce-a627fd7d1f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:28.515583 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7fd2c-35b1-4dfe-8d7f-ae622603f39a None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:28.536051 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 129/253] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:28.537346 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd355b81-01d6-410a-a5ce-a627fd7d1f16 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:28.566263 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156043e8-9c4c-4e46-b6c4-557f7d43bb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:28.567304 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156043e8-9c4c-4e46-b6c4-557f7d43bb59 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:28.567621 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156043e8-9c4c-4e46-b6c4-557f7d43bb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:28.568252 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156043e8-9c4c-4e46-b6c4-557f7d43bb59 None admin] PATH_INFO: `/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:28.569501 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156043e8-9c4c-4e46-b6c4-557f7d43bb59 None admin] RBAC: Authorizing `identity:get_project(project_id=90e0b1babc6a4f59b9783fd69c68f2ce)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:28.570970 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156043e8-9c4c-4e46-b6c4-557f7d43bb59 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:28.572847 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 125/254] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:28 2022] GET /identity/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:28.575599 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156043e8-9c4c-4e46-b6c4-557f7d43bb59 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:28.676236 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd355b81-01d6-410a-a5ce-a627fd7d1f16 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:28.691959 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156043e8-9c4c-4e46-b6c4-557f7d43bb59 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:28.725598 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fc8da-eddb-4cea-b965-33674c7eb04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:28.727186 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fc8da-eddb-4cea-b965-33674c7eb04d None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:28.727567 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fc8da-eddb-4cea-b965-33674c7eb04d None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:28.727856 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fc8da-eddb-4cea-b965-33674c7eb04d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:28.738332 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16294e48-0e9d-40f0-8e01-6593428dedc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:28.740455 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16294e48-0e9d-40f0-8e01-6593428dedc1 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:28.740455 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16294e48-0e9d-40f0-8e01-6593428dedc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:28.740455 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16294e48-0e9d-40f0-8e01-6593428dedc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:28.743921 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260fc8da-eddb-4cea-b965-33674c7eb04d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:28.752093 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-260fc8da-eddb-4cea-b965-33674c7eb04d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 20:01:28.753819 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 130/255] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:28.754802 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fc8da-eddb-4cea-b965-33674c7eb04d None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:28.815357 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16294e48-0e9d-40f0-8e01-6593428dedc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:28.816769 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16294e48-0e9d-40f0-8e01-6593428dedc1 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:28.879996 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fc8da-eddb-4cea-b965-33674c7eb04d None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:28.957325 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65b59a-1000-4575-84f0-e8db9c27fbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:28.957546 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 126/256] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:01:28.957546 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16294e48-0e9d-40f0-8e01-6593428dedc1 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:28.958798 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65b59a-1000-4575-84f0-e8db9c27fbac None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:28.959290 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65b59a-1000-4575-84f0-e8db9c27fbac None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:28.959775 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65b59a-1000-4575-84f0-e8db9c27fbac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:28.973462 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65b59a-1000-4575-84f0-e8db9c27fbac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:28.988323 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-ee65b59a-1000-4575-84f0-e8db9c27fbac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:01:28.989931 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 131/257] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:01:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:28.991029 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65b59a-1000-4575-84f0-e8db9c27fbac None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:29.177623 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16294e48-0e9d-40f0-8e01-6593428dedc1 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:29.220613 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65b59a-1000-4575-84f0-e8db9c27fbac None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:29.248315 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e1805-68e3-445b-885d-c7f955aea137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:29.248999 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e1805-68e3-445b-885d-c7f955aea137 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:29.249283 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e1805-68e3-445b-885d-c7f955aea137 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:29.249588 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e1805-68e3-445b-885d-c7f955aea137 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:29.250832 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e1805-68e3-445b-885d-c7f955aea137 None admin] RBAC: Adding query filter params (role.id=cd320364ae634461bc6ce03abdb40fa8, scope.project.id=90e0b1babc6a4f59b9783fd69c68f2ce, user.id=c38d7c0cf2964094bf8b8e94f3391eb2) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:29.250832 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e1805-68e3-445b-885d-c7f955aea137 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:29.252895 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e1805-68e3-445b-885d-c7f955aea137 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:29.266930 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89461437-00ed-499d-8582-69924a856159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:29.267984 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89461437-00ed-499d-8582-69924a856159 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:29.268460 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89461437-00ed-499d-8582-69924a856159 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:29.268986 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89461437-00ed-499d-8582-69924a856159 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:29.270595 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89461437-00ed-499d-8582-69924a856159 None admin] RBAC: Adding query filter params (name=member) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:29.271413 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89461437-00ed-499d-8582-69924a856159 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:29.273050 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89461437-00ed-499d-8582-69924a856159 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:29.273837 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 127/258] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:01:28 2022] GET /identity/v3/role_assignments?user.id=c38d7c0cf2964094bf8b8e94f3391eb2&scope.project.id=90e0b1babc6a4f59b9783fd69c68f2ce&role.id=cd320364ae634461bc6ce03abdb40fa8 => generated 259 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:29.278507 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e1805-68e3-445b-885d-c7f955aea137 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:29.284865 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 132/259] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:29.286121 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89461437-00ed-499d-8582-69924a856159 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:29.499881 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e1805-68e3-445b-885d-c7f955aea137 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:29.513272 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89461437-00ed-499d-8582-69924a856159 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:29.558553 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874232f7-12b4-44a4-9487-cddf54c54198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:29.559626 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874232f7-12b4-44a4-9487-cddf54c54198 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:29.559938 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874232f7-12b4-44a4-9487-cddf54c54198 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:29.560191 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874232f7-12b4-44a4-9487-cddf54c54198 None admin] PATH_INFO: `/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:29.561698 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9262a22-3ce0-4581-a504-c9e03fdcbb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:29.561987 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874232f7-12b4-44a4-9487-cddf54c54198 None admin] RBAC: Authorizing `identity:get_project(project_id=90e0b1babc6a4f59b9783fd69c68f2ce)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:29.563096 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9262a22-3ce0-4581-a504-c9e03fdcbb6a None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:29.563592 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9262a22-3ce0-4581-a504-c9e03fdcbb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:29.563981 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874232f7-12b4-44a4-9487-cddf54c54198 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:29.564700 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9262a22-3ce0-4581-a504-c9e03fdcbb6a None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:29.566276 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9262a22-3ce0-4581-a504-c9e03fdcbb6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:29.567060 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9262a22-3ce0-4581-a504-c9e03fdcbb6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:29.573637 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 128/260] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:29 2022] GET /identity/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:29.573637 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874232f7-12b4-44a4-9487-cddf54c54198 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:29.574985 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9262a22-3ce0-4581-a504-c9e03fdcbb6a None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:29.588456 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 133/261] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:29.590785 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9262a22-3ce0-4581-a504-c9e03fdcbb6a None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:29.686794 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874232f7-12b4-44a4-9487-cddf54c54198 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:29.724579 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9262a22-3ce0-4581-a504-c9e03fdcbb6a None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:29.763765 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0756b-7e80-4109-b643-4e573b166c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:29.764587 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0756b-7e80-4109-b643-4e573b166c0b None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:29.764874 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0756b-7e80-4109-b643-4e573b166c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:29.765154 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0756b-7e80-4109-b643-4e573b166c0b None admin] PATH_INFO: `/v3/users/fa6855ce28094c438341192a7ef721ad` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:29.770076 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0756b-7e80-4109-b643-4e573b166c0b None admin] RBAC: Authorizing `identity:get_user(user_id=fa6855ce28094c438341192a7ef721ad)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:29.771579 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0756b-7e80-4109-b643-4e573b166c0b None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:29.773312 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 129/262] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:29 2022] GET /identity/v3/users/fa6855ce28094c438341192a7ef721ad => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:29.774137 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0756b-7e80-4109-b643-4e573b166c0b None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:29.774925 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b287ae-3e6a-4372-8e00-22fa64550232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:29.775802 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b287ae-3e6a-4372-8e00-22fa64550232 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:29.776277 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b287ae-3e6a-4372-8e00-22fa64550232 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:29.777478 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b287ae-3e6a-4372-8e00-22fa64550232 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:29.778758 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b287ae-3e6a-4372-8e00-22fa64550232 None admin] RBAC: Adding query filter params (role.id=82747af757b549cbaa39504334f32f9f, scope.project.id=90e0b1babc6a4f59b9783fd69c68f2ce, user.id=0efbecf6cc184f31b9809d34075af160) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:29.779287 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b287ae-3e6a-4372-8e00-22fa64550232 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:29.780916 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b287ae-3e6a-4372-8e00-22fa64550232 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:29.787634 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 134/263] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:01:29 2022] GET /identity/v3/role_assignments?user.id=0efbecf6cc184f31b9809d34075af160&scope.project.id=90e0b1babc6a4f59b9783fd69c68f2ce&role.id=82747af757b549cbaa39504334f32f9f => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:29.788672 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b287ae-3e6a-4372-8e00-22fa64550232 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:29.950095 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b287ae-3e6a-4372-8e00-22fa64550232 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:30.011101 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98603c9-c5e7-4da9-8690-f93d911289ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:30.012538 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98603c9-c5e7-4da9-8690-f93d911289ba None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:30.013351 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98603c9-c5e7-4da9-8690-f93d911289ba None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:30.013923 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98603c9-c5e7-4da9-8690-f93d911289ba None admin] PATH_INFO: `/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:30.018568 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98603c9-c5e7-4da9-8690-f93d911289ba None admin] RBAC: Authorizing `identity:get_project(project_id=90e0b1babc6a4f59b9783fd69c68f2ce)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:30.020706 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98603c9-c5e7-4da9-8690-f93d911289ba None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:30.022997 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 135/264] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:29 2022] GET /identity/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:30.030099 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98603c9-c5e7-4da9-8690-f93d911289ba None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:30.039520 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0756b-7e80-4109-b643-4e573b166c0b None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:30.106859 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a8b1b-5941-488f-a8a2-6d10846e3906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:30.107880 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a8b1b-5941-488f-a8a2-6d10846e3906 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:30.108161 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a8b1b-5941-488f-a8a2-6d10846e3906 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:30.108435 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a8b1b-5941-488f-a8a2-6d10846e3906 None admin] PATH_INFO: `/v3/users/0efbecf6cc184f31b9809d34075af160` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:30.109835 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a8b1b-5941-488f-a8a2-6d10846e3906 None admin] RBAC: Authorizing `identity:get_user(user_id=0efbecf6cc184f31b9809d34075af160)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:30.111916 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a8b1b-5941-488f-a8a2-6d10846e3906 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:30.114220 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 130/265] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:29 2022] GET /identity/v3/users/0efbecf6cc184f31b9809d34075af160 => generated 283 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:30.119446 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a8b1b-5941-488f-a8a2-6d10846e3906 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:30.179488 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98603c9-c5e7-4da9-8690-f93d911289ba None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:30.224223 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f67a7-e86b-4091-ab05-4af869fbc625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:30.225249 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f67a7-e86b-4091-ab05-4af869fbc625 None admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:30.225562 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f67a7-e86b-4091-ab05-4af869fbc625 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:30.225842 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f67a7-e86b-4091-ab05-4af869fbc625 None admin] PATH_INFO: `/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce/users/fa6855ce28094c438341192a7ef721ad/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:30.228419 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f67a7-e86b-4091-ab05-4af869fbc625 None admin] RBAC: Authorizing `identity:create_grant(project_id=90e0b1babc6a4f59b9783fd69c68f2ce, user_id=fa6855ce28094c438341192a7ef721ad, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:30.231413 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f67a7-e86b-4091-ab05-4af869fbc625 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:30.238210 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a8b1b-5941-488f-a8a2-6d10846e3906 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:30.280668 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fdbd7-0438-4507-87a6-b9d75b1ca589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:30.281255 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fdbd7-0438-4507-87a6-b9d75b1ca589 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:30.281657 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fdbd7-0438-4507-87a6-b9d75b1ca589 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:30.281934 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fdbd7-0438-4507-87a6-b9d75b1ca589 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:30.308550 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 136/266] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Mar 29 20:01:30 2022] PUT /identity/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce/users/fa6855ce28094c438341192a7ef721ad/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:01:30.381412 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796fdbd7-0438-4507-87a6-b9d75b1ca589 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:30.382899 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796fdbd7-0438-4507-87a6-b9d75b1ca589 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:30.515422 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 131/267] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:01:30.520586 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f67a7-e86b-4091-ab05-4af869fbc625 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:30.628026 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f67a7-e86b-4091-ab05-4af869fbc625 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:30.663667 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6277fbd-b248-4b3d-9ab5-9e9be1311438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:30.664548 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6277fbd-b248-4b3d-9ab5-9e9be1311438 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:30.664828 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6277fbd-b248-4b3d-9ab5-9e9be1311438 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:30.665845 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6277fbd-b248-4b3d-9ab5-9e9be1311438 None admin] PATH_INFO: `/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:30.666315 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6277fbd-b248-4b3d-9ab5-9e9be1311438 None admin] RBAC: Authorizing `identity:get_project(project_id=90e0b1babc6a4f59b9783fd69c68f2ce)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:30.668697 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6277fbd-b248-4b3d-9ab5-9e9be1311438 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:30.670911 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 137/268] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:30 2022] GET /identity/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:01:30.678401 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fdbd7-0438-4507-87a6-b9d75b1ca589 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:30.820129 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fdbd7-0438-4507-87a6-b9d75b1ca589 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:30.861217 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51eeb4b-6c8e-492f-a3e7-0cf649315b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:30.861921 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eeb4b-6c8e-492f-a3e7-0cf649315b15 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:30.862239 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eeb4b-6c8e-492f-a3e7-0cf649315b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:30.862471 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eeb4b-6c8e-492f-a3e7-0cf649315b15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:30.863322 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51eeb4b-6c8e-492f-a3e7-0cf649315b15 None admin] RBAC: Adding query filter params (role.id=8cfa924df1a1400986d9ecc9686a7f52, scope.project.id=90e0b1babc6a4f59b9783fd69c68f2ce, user.id=0efbecf6cc184f31b9809d34075af160) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:30.863640 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51eeb4b-6c8e-492f-a3e7-0cf649315b15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:30.865124 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51eeb4b-6c8e-492f-a3e7-0cf649315b15 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:30.872507 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 132/269] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:01:30 2022] GET /identity/v3/role_assignments?user.id=0efbecf6cc184f31b9809d34075af160&scope.project.id=90e0b1babc6a4f59b9783fd69c68f2ce&role.id=8cfa924df1a1400986d9ecc9686a7f52 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:31.297152 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc8886-467b-4221-b0ab-74062b69cdd8 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:31.297706 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc8886-467b-4221-b0ab-74062b69cdd8 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:31.297813 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc8886-467b-4221-b0ab-74062b69cdd8 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:31.299546 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 138/270] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:31.306051 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd542338-45cb-48dc-be13-b54d4e06cd98 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:31.306469 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd542338-45cb-48dc-be13-b54d4e06cd98 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:31.306607 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd542338-45cb-48dc-be13-b54d4e06cd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:31.325120 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-bd542338-45cb-48dc-be13-b54d4e06cd98 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:31.326366 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-bd542338-45cb-48dc-be13-b54d4e06cd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:31.399860 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 133/271] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:31.420991 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc8886-467b-4221-b0ab-74062b69cdd8 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:31.530126 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc8886-467b-4221-b0ab-74062b69cdd8 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:31.564079 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05806657-5d6f-4e76-92c9-34d3879205f6 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:31.564372 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05806657-5d6f-4e76-92c9-34d3879205f6 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:31.564570 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05806657-5d6f-4e76-92c9-34d3879205f6 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:31.566511 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 134/272] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:01:31.568501 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c0a22-21b9-411a-a264-8b13a1f4582f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:31.569315 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c0a22-21b9-411a-a264-8b13a1f4582f None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:31.569603 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c0a22-21b9-411a-a264-8b13a1f4582f None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:31.569881 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c0a22-21b9-411a-a264-8b13a1f4582f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:31.571051 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c0a22-21b9-411a-a264-8b13a1f4582f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:31.572600 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c0a22-21b9-411a-a264-8b13a1f4582f None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:31.575137 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9d261-aa36-4597-a3d6-a9e528a05ac2 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:31.575356 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 139/273] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:01:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:31.575828 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9d261-aa36-4597-a3d6-a9e528a05ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:31.576237 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9d261-aa36-4597-a3d6-a9e528a05ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:31.580246 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c0a22-21b9-411a-a264-8b13a1f4582f None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:31.603766 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-93e9d261-aa36-4597-a3d6-a9e528a05ac2 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:31.605764 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-93e9d261-aa36-4597-a3d6-a9e528a05ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:31.678187 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 135/274] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 20:01:31.703301 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9d261-aa36-4597-a3d6-a9e528a05ac2 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:31.712949 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c0a22-21b9-411a-a264-8b13a1f4582f None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:31.755183 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14646aae-171a-4767-a488-7da00eea2519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:31.755983 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14646aae-171a-4767-a488-7da00eea2519 None admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:31.756331 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14646aae-171a-4767-a488-7da00eea2519 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:31.756673 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14646aae-171a-4767-a488-7da00eea2519 None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:31.757645 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14646aae-171a-4767-a488-7da00eea2519 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:31.759117 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14646aae-171a-4767-a488-7da00eea2519 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:31.819265 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9d261-aa36-4597-a3d6-a9e528a05ac2 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:31.854204 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffe8af-fdb4-4d8a-85ed-72b1d7db1901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:31.856181 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffe8af-fdb4-4d8a-85ed-72b1d7db1901 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:31.856469 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffe8af-fdb4-4d8a-85ed-72b1d7db1901 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:31.856739 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffe8af-fdb4-4d8a-85ed-72b1d7db1901 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:31.872454 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ffe8af-fdb4-4d8a-85ed-72b1d7db1901 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:31.877618 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 140/275] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Mar 29 20:01:31 2022] POST /identity/v3/users => generated 293 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:01:31.881774 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-f6ffe8af-fdb4-4d8a-85ed-72b1d7db1901 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 20:01:31.883830 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 136/276] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:01:31.890239 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14646aae-171a-4767-a488-7da00eea2519 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:32.009121 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14646aae-171a-4767-a488-7da00eea2519 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:32.049790 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af88651-2181-4242-bc84-e823e5e6a8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:32.051014 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af88651-2181-4242-bc84-e823e5e6a8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:32.051506 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af88651-2181-4242-bc84-e823e5e6a8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:32.052064 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af88651-2181-4242-bc84-e823e5e6a8f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:32.053039 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af88651-2181-4242-bc84-e823e5e6a8f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:32.053710 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af88651-2181-4242-bc84-e823e5e6a8f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:32.055351 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af88651-2181-4242-bc84-e823e5e6a8f5 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:32.066007 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 141/277] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:32.075860 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffe8af-fdb4-4d8a-85ed-72b1d7db1901 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:32.108092 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d190dc-876c-4ccf-b50d-b85ec7f78474 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:32.108624 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d190dc-876c-4ccf-b50d-b85ec7f78474 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:32.108911 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d190dc-876c-4ccf-b50d-b85ec7f78474 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:32.111091 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 142/278] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:32.116450 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6227af3-2826-4088-b76b-f7449c0ba1be None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:32.116742 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6227af3-2826-4088-b76b-f7449c0ba1be None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:32.117032 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6227af3-2826-4088-b76b-f7449c0ba1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:32.136640 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-a6227af3-2826-4088-b76b-f7449c0ba1be None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:32.138195 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a6227af3-2826-4088-b76b-f7449c0ba1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:32.204673 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffe8af-fdb4-4d8a-85ed-72b1d7db1901 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:32.220416 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 143/279] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 20:01:32.245688 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43729ad3-0400-4afa-ba33-5578b3b810c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:32.246562 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6227af3-2826-4088-b76b-f7449c0ba1be None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:32.246669 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43729ad3-0400-4afa-ba33-5578b3b810c0 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:32.246924 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43729ad3-0400-4afa-ba33-5578b3b810c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:32.247143 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43729ad3-0400-4afa-ba33-5578b3b810c0 None admin] PATH_INFO: `/v3/users/81df957fbbb645fea5b8b7c7c46ff79d` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:32.264345 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43729ad3-0400-4afa-ba33-5578b3b810c0 None admin] RBAC: Authorizing `identity:get_user(user_id=81df957fbbb645fea5b8b7c7c46ff79d)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:32.265980 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43729ad3-0400-4afa-ba33-5578b3b810c0 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:32.267891 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 137/280] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:32 2022] GET /identity/v3/users/81df957fbbb645fea5b8b7c7c46ff79d => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:32.274786 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43729ad3-0400-4afa-ba33-5578b3b810c0 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:32.363420 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6227af3-2826-4088-b76b-f7449c0ba1be None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:32.385095 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43729ad3-0400-4afa-ba33-5578b3b810c0 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:32.400006 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e533255-7d3d-4882-8ef5-16ee859e74f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:32.401152 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e533255-7d3d-4882-8ef5-16ee859e74f7 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:32.402229 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e533255-7d3d-4882-8ef5-16ee859e74f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:32.402706 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e533255-7d3d-4882-8ef5-16ee859e74f7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:32.413441 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e533255-7d3d-4882-8ef5-16ee859e74f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:32.421502 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-1e533255-7d3d-4882-8ef5-16ee859e74f7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 29 20:01:32.422196 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18ef29-c63d-43d3-b9e7-5f9d170a25e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:32.422857 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18ef29-c63d-43d3-b9e7-5f9d170a25e4 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:32.423138 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18ef29-c63d-43d3-b9e7-5f9d170a25e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:32.423414 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18ef29-c63d-43d3-b9e7-5f9d170a25e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:32.424250 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18ef29-c63d-43d3-b9e7-5f9d170a25e4 None admin] RBAC: Adding query filter params (role.id=e49df2a8408b4f5fa7e284575007ce83, user.id=81df957fbbb645fea5b8b7c7c46ff79d, scope.system=all) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:32.424367 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 144/281] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:01:32.424562 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18ef29-c63d-43d3-b9e7-5f9d170a25e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:32.426229 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18ef29-c63d-43d3-b9e7-5f9d170a25e4 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:32.430530 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e533255-7d3d-4882-8ef5-16ee859e74f7 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:32.433211 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 138/282] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Mar 29 20:01:32 2022] GET /identity/v3/role_assignments?user.id=81df957fbbb645fea5b8b7c7c46ff79d&scope.system=all&role.id=e49df2a8408b4f5fa7e284575007ce83 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:32.542706 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e533255-7d3d-4882-8ef5-16ee859e74f7 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:32.582668 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93fd78-753e-4bda-88b0-cfcc52d46616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:32.583743 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93fd78-753e-4bda-88b0-cfcc52d46616 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:32.584234 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93fd78-753e-4bda-88b0-cfcc52d46616 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:32.584713 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93fd78-753e-4bda-88b0-cfcc52d46616 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:32.585775 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93fd78-753e-4bda-88b0-cfcc52d46616 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:32.586305 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93fd78-753e-4bda-88b0-cfcc52d46616 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:32.587994 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93fd78-753e-4bda-88b0-cfcc52d46616 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:32.597970 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 145/283] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:32.605800 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18ef29-c63d-43d3-b9e7-5f9d170a25e4 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:32.739254 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18ef29-c63d-43d3-b9e7-5f9d170a25e4 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:32.774454 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f01adc-738e-45fa-b9c9-3f8c4a445909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:32.775372 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f01adc-738e-45fa-b9c9-3f8c4a445909 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:32.775703 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f01adc-738e-45fa-b9c9-3f8c4a445909 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:32.775983 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f01adc-738e-45fa-b9c9-3f8c4a445909 None admin] PATH_INFO: `/v3/users/c38d7c0cf2964094bf8b8e94f3391eb2` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:32.777845 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f01adc-738e-45fa-b9c9-3f8c4a445909 None admin] RBAC: Authorizing `identity:get_user(user_id=c38d7c0cf2964094bf8b8e94f3391eb2)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:32.779286 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f01adc-738e-45fa-b9c9-3f8c4a445909 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:32.780960 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 139/284] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:32 2022] GET /identity/v3/users/c38d7c0cf2964094bf8b8e94f3391eb2 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:32.790397 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93fd78-753e-4bda-88b0-cfcc52d46616 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:32.936912 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93fd78-753e-4bda-88b0-cfcc52d46616 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:32.992244 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f3d72-b3e8-4fc1-a198-ff5abf4d507a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:32.993553 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f3d72-b3e8-4fc1-a198-ff5abf4d507a None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:32.994034 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f3d72-b3e8-4fc1-a198-ff5abf4d507a None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:32.994528 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f3d72-b3e8-4fc1-a198-ff5abf4d507a None admin] PATH_INFO: `/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:32.996465 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f3d72-b3e8-4fc1-a198-ff5abf4d507a None admin] RBAC: Authorizing `identity:get_project(project_id=90e0b1babc6a4f59b9783fd69c68f2ce)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:32.998153 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f3d72-b3e8-4fc1-a198-ff5abf4d507a None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:33.000049 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 146/285] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:32 2022] GET /identity/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:33.006074 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f01adc-738e-45fa-b9c9-3f8c4a445909 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:33.069926 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32c2ca-a5ac-4e71-8852-f8c5a4885a73 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:33.070595 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32c2ca-a5ac-4e71-8852-f8c5a4885a73 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:33.071078 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32c2ca-a5ac-4e71-8852-f8c5a4885a73 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:33.077479 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 147/286] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:33.079760 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548328f0-c6a8-43c8-bca5-bc3622c3ead4 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:33.080235 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548328f0-c6a8-43c8-bca5-bc3622c3ead4 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:33.080718 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548328f0-c6a8-43c8-bca5-bc3622c3ead4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:33.106717 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-548328f0-c6a8-43c8-bca5-bc3622c3ead4 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:33.108333 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-548328f0-c6a8-43c8-bca5-bc3622c3ead4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:33.159469 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f01adc-738e-45fa-b9c9-3f8c4a445909 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:33.211749 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 148/287] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 20:01:33.224393 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798aa6a-b9bf-4114-ac00-31ac590200dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:33.225373 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798aa6a-b9bf-4114-ac00-31ac590200dd None admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:33.225662 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798aa6a-b9bf-4114-ac00-31ac590200dd None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:33.225941 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798aa6a-b9bf-4114-ac00-31ac590200dd None admin] PATH_INFO: `/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce/users/c38d7c0cf2964094bf8b8e94f3391eb2/roles/cd320364ae634461bc6ce03abdb40fa8` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:33.231219 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8798aa6a-b9bf-4114-ac00-31ac590200dd None admin] RBAC: Authorizing `identity:create_grant(project_id=90e0b1babc6a4f59b9783fd69c68f2ce, user_id=c38d7c0cf2964094bf8b8e94f3391eb2, role_id=cd320364ae634461bc6ce03abdb40fa8)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:33.232679 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8798aa6a-b9bf-4114-ac00-31ac590200dd None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:33.236942 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548328f0-c6a8-43c8-bca5-bc3622c3ead4 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:33.315551 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 140/288] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Mar 29 20:01:33 2022] PUT /identity/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce/users/c38d7c0cf2964094bf8b8e94f3391eb2/roles/cd320364ae634461bc6ce03abdb40fa8 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:01:33.341673 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548328f0-c6a8-43c8-bca5-bc3622c3ead4 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:33.386725 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeee571-c18a-43ba-8a8f-bfd2b420aca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:33.387403 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeee571-c18a-43ba-8a8f-bfd2b420aca3 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:33.387677 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeee571-c18a-43ba-8a8f-bfd2b420aca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:33.388018 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeee571-c18a-43ba-8a8f-bfd2b420aca3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:33.405914 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeee571-c18a-43ba-8a8f-bfd2b420aca3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:33.413125 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-cfeee571-c18a-43ba-8a8f-bfd2b420aca3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 20:01:33.414623 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 149/289] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:01:33.421426 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798aa6a-b9bf-4114-ac00-31ac590200dd None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:33.556160 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798aa6a-b9bf-4114-ac00-31ac590200dd None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:33.597329 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8d8c2-4c64-4fe2-b34f-aa63025d2032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:33.597951 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8d8c2-4c64-4fe2-b34f-aa63025d2032 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:33.598238 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8d8c2-4c64-4fe2-b34f-aa63025d2032 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:33.598520 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8d8c2-4c64-4fe2-b34f-aa63025d2032 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:33.599277 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8d8c2-4c64-4fe2-b34f-aa63025d2032 None admin] RBAC: Adding query filter params (name=member) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:33.599589 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8d8c2-4c64-4fe2-b34f-aa63025d2032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:33.600990 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8d8c2-4c64-4fe2-b34f-aa63025d2032 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:33.612426 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 141/290] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:33.617851 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeee571-c18a-43ba-8a8f-bfd2b420aca3 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:33.761572 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeee571-c18a-43ba-8a8f-bfd2b420aca3 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:33.808378 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b4b87-283a-4565-8d51-b24dacefefc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:33.809726 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b4b87-283a-4565-8d51-b24dacefefc1 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:33.810244 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b4b87-283a-4565-8d51-b24dacefefc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:33.810717 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b4b87-283a-4565-8d51-b24dacefefc1 None admin] PATH_INFO: `/v3/users/fa6855ce28094c438341192a7ef721ad` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:33.812154 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b4b87-283a-4565-8d51-b24dacefefc1 None admin] RBAC: Authorizing `identity:get_user(user_id=fa6855ce28094c438341192a7ef721ad)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:33.813902 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b4b87-283a-4565-8d51-b24dacefefc1 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:33.816011 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 150/291] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:33 2022] GET /identity/v3/users/fa6855ce28094c438341192a7ef721ad => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:33.821111 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8d8c2-4c64-4fe2-b34f-aa63025d2032 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:33.969269 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8d8c2-4c64-4fe2-b34f-aa63025d2032 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:34.018974 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077919f-ca6f-4048-afac-08316ff255cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:34.019643 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077919f-ca6f-4048-afac-08316ff255cc None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:34.019933 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077919f-ca6f-4048-afac-08316ff255cc None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:34.020213 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077919f-ca6f-4048-afac-08316ff255cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:34.118091 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077919f-ca6f-4048-afac-08316ff255cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:34.119549 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077919f-ca6f-4048-afac-08316ff255cc None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:34.245623 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 142/292] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:01:34.251479 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b4b87-283a-4565-8d51-b24dacefefc1 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:34.405740 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b4b87-283a-4565-8d51-b24dacefefc1 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:34.452869 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4f18f-8d30-4d92-a7c8-18bf4d690ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:34.453766 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4f18f-8d30-4d92-a7c8-18bf4d690ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:34.454046 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4f18f-8d30-4d92-a7c8-18bf4d690ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:34.454324 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4f18f-8d30-4d92-a7c8-18bf4d690ee6 None admin] PATH_INFO: `/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:34.455522 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4f18f-8d30-4d92-a7c8-18bf4d690ee6 None admin] RBAC: Authorizing `identity:get_project(project_id=90e0b1babc6a4f59b9783fd69c68f2ce)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:34.456987 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4f18f-8d30-4d92-a7c8-18bf4d690ee6 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:34.458685 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 151/293] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:34 2022] GET /identity/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:34.464480 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077919f-ca6f-4048-afac-08316ff255cc None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:34.615812 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077919f-ca6f-4048-afac-08316ff255cc None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:34.665170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053742c8-88f1-4794-9178-9f885b5f9892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:34.665933 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053742c8-88f1-4794-9178-9f885b5f9892 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:34.666225 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053742c8-88f1-4794-9178-9f885b5f9892 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:34.666506 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053742c8-88f1-4794-9178-9f885b5f9892 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:34.667462 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053742c8-88f1-4794-9178-9f885b5f9892 None admin] RBAC: Adding query filter params (role.id=e49df2a8408b4f5fa7e284575007ce83, scope.project.id=90e0b1babc6a4f59b9783fd69c68f2ce, user.id=fa6855ce28094c438341192a7ef721ad) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:34.667785 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053742c8-88f1-4794-9178-9f885b5f9892 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:34.669426 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053742c8-88f1-4794-9178-9f885b5f9892 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:34.682349 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 143/294] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:01:34 2022] GET /identity/v3/role_assignments?user.id=fa6855ce28094c438341192a7ef721ad&scope.project.id=90e0b1babc6a4f59b9783fd69c68f2ce&role.id=e49df2a8408b4f5fa7e284575007ce83 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:35.057274 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341bfe5c-eae6-44f9-bb99-4870637c6c2a None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:35.058588 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341bfe5c-eae6-44f9-bb99-4870637c6c2a None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:35.059084 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341bfe5c-eae6-44f9-bb99-4870637c6c2a None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:35.061096 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 152/295] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:35.067387 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0267908-6b66-4132-9a19-0102da659b90 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:35.067955 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0267908-6b66-4132-9a19-0102da659b90 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:35.068435 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0267908-6b66-4132-9a19-0102da659b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:35.086810 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-d0267908-6b66-4132-9a19-0102da659b90 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:35.088332 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-d0267908-6b66-4132-9a19-0102da659b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:35.164196 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 144/296] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:35.188518 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341bfe5c-eae6-44f9-bb99-4870637c6c2a None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:35.254437 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578dc0b-0699-4a84-ac58-b31dbdbb7916 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:35.254728 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578dc0b-0699-4a84-ac58-b31dbdbb7916 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:35.255009 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578dc0b-0699-4a84-ac58-b31dbdbb7916 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:35.256913 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 145/297] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:35.263027 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7f041-95e2-4f39-b040-42aa7ec8fe8b None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:35.263316 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7f041-95e2-4f39-b040-42aa7ec8fe8b None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:35.263595 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7f041-95e2-4f39-b040-42aa7ec8fe8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:35.282531 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-9ec7f041-95e2-4f39-b040-42aa7ec8fe8b None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:35.284915 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9ec7f041-95e2-4f39-b040-42aa7ec8fe8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:35.297352 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341bfe5c-eae6-44f9-bb99-4870637c6c2a None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:35.340726 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7082f1-0c89-4dc3-80af-658b805080bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:35.342057 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7082f1-0c89-4dc3-80af-658b805080bb None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:35.342893 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7082f1-0c89-4dc3-80af-658b805080bb None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:35.343411 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7082f1-0c89-4dc3-80af-658b805080bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:35.354667 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7082f1-0c89-4dc3-80af-658b805080bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:35.362204 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-1d7082f1-0c89-4dc3-80af-658b805080bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 29 20:01:35.363626 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 153/298] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:35.365022 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3779c9-dd88-4c92-834b-2e6f9defcb63 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:35.365514 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3779c9-dd88-4c92-834b-2e6f9defcb63 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:35.366067 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3779c9-dd88-4c92-834b-2e6f9defcb63 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:35.367935 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 154/299] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:35.372142 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3779c9-dd88-4c92-834b-2e6f9defcb63 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:35.375170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 146/300] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:35.376756 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274bf27-957f-4f19-942f-eab528e87319 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:35.377251 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274bf27-957f-4f19-942f-eab528e87319 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:35.377788 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274bf27-957f-4f19-942f-eab528e87319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:35.396583 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-f274bf27-957f-4f19-942f-eab528e87319 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:35.398221 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-f274bf27-957f-4f19-942f-eab528e87319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:35.483209 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3779c9-dd88-4c92-834b-2e6f9defcb63 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:35.519568 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178f43d-b30b-474b-8da1-4becfd8c1310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:35.520258 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178f43d-b30b-474b-8da1-4becfd8c1310 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:35.520544 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178f43d-b30b-474b-8da1-4becfd8c1310 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:35.520825 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178f43d-b30b-474b-8da1-4becfd8c1310 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:35.521618 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178f43d-b30b-474b-8da1-4becfd8c1310 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:35.521933 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178f43d-b30b-474b-8da1-4becfd8c1310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:35.523387 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178f43d-b30b-474b-8da1-4becfd8c1310 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:35.538263 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 155/301] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:35.538263 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178f43d-b30b-474b-8da1-4becfd8c1310 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:35.592041 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 147/302] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:35.593612 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274bf27-957f-4f19-942f-eab528e87319 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:35.643260 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178f43d-b30b-474b-8da1-4becfd8c1310 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:35.677917 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdef610-140a-42fd-938d-4606b61c9178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:35.678724 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdef610-140a-42fd-938d-4606b61c9178 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:35.679011 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdef610-140a-42fd-938d-4606b61c9178 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:35.679287 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdef610-140a-42fd-938d-4606b61c9178 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:35.680465 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdef610-140a-42fd-938d-4606b61c9178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:35.681942 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdef610-140a-42fd-938d-4606b61c9178 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:35.688281 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 156/303] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:01:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:35.688281 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdef610-140a-42fd-938d-4606b61c9178 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:35.709208 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274bf27-957f-4f19-942f-eab528e87319 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:35.742182 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6eb2b-f4b8-4217-a0ad-e6d5b7774aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:35.743052 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6eb2b-f4b8-4217-a0ad-e6d5b7774aec None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:35.743334 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6eb2b-f4b8-4217-a0ad-e6d5b7774aec None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:35.743618 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6eb2b-f4b8-4217-a0ad-e6d5b7774aec None admin] PATH_INFO: `/v3/users/a1b98d581d154aa1bf884f89aad5e2e5` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:35.756879 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6eb2b-f4b8-4217-a0ad-e6d5b7774aec None admin] RBAC: Authorizing `identity:get_user(user_id=a1b98d581d154aa1bf884f89aad5e2e5)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:35.758357 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6eb2b-f4b8-4217-a0ad-e6d5b7774aec None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:35.760204 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 148/304] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:35 2022] GET /identity/v3/users/a1b98d581d154aa1bf884f89aad5e2e5 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:35.761521 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6eb2b-f4b8-4217-a0ad-e6d5b7774aec None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:35.801225 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdef610-140a-42fd-938d-4606b61c9178 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:35.836119 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccc405-b197-45ca-9faa-fbb4f4d71387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:35.837194 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccc405-b197-45ca-9faa-fbb4f4d71387 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:35.837640 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccc405-b197-45ca-9faa-fbb4f4d71387 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:35.838054 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccc405-b197-45ca-9faa-fbb4f4d71387 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:35.849375 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eccc405-b197-45ca-9faa-fbb4f4d71387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:35.856934 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-8eccc405-b197-45ca-9faa-fbb4f4d71387 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 20:01:35.858160 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 157/305] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:35.858921 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccc405-b197-45ca-9faa-fbb4f4d71387 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:35.868752 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6eb2b-f4b8-4217-a0ad-e6d5b7774aec None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:35.902236 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f15953-9247-4dd9-a18b-8657cec68288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:35.902998 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f15953-9247-4dd9-a18b-8657cec68288 None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:35.903330 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f15953-9247-4dd9-a18b-8657cec68288 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:35.903615 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f15953-9247-4dd9-a18b-8657cec68288 None admin] PATH_INFO: `/v3/groups` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:35.904306 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f15953-9247-4dd9-a18b-8657cec68288 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:35.905770 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f15953-9247-4dd9-a18b-8657cec68288 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:35.957402 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccc405-b197-45ca-9faa-fbb4f4d71387 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:35.986983 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 149/306] 10.222.0.43 () {60 vars in 1134 bytes} [Tue Mar 29 20:01:35 2022] POST /identity/v3/groups => generated 229 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:01:35.987935 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f15953-9247-4dd9-a18b-8657cec68288 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:35.990850 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c45cf-4a48-4b6c-ad5e-9b1178217025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:35.991524 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c45cf-4a48-4b6c-ad5e-9b1178217025 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:35.991807 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c45cf-4a48-4b6c-ad5e-9b1178217025 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:35.992087 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c45cf-4a48-4b6c-ad5e-9b1178217025 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:35.993013 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c45cf-4a48-4b6c-ad5e-9b1178217025 None admin] RBAC: Adding query filter params (role.id=cd320364ae634461bc6ce03abdb40fa8, user.id=a1b98d581d154aa1bf884f89aad5e2e5, scope.system=all) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:35.993268 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c45cf-4a48-4b6c-ad5e-9b1178217025 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:35.994803 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c45cf-4a48-4b6c-ad5e-9b1178217025 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:36.001450 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 158/307] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Mar 29 20:01:35 2022] GET /identity/v3/role_assignments?user.id=a1b98d581d154aa1bf884f89aad5e2e5&scope.system=all&role.id=cd320364ae634461bc6ce03abdb40fa8 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:36.003127 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d43e9-1487-41e0-818d-fe27dc9df2bc None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:36.003423 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d43e9-1487-41e0-818d-fe27dc9df2bc None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:36.003705 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d43e9-1487-41e0-818d-fe27dc9df2bc None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:36.005810 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 159/308] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:36.012769 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56938d-04dd-4ec6-bde8-e25141c19fab None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:36.013318 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56938d-04dd-4ec6-bde8-e25141c19fab None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:36.013827 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56938d-04dd-4ec6-bde8-e25141c19fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:36.033976 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-4a56938d-04dd-4ec6-bde8-e25141c19fab None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:36.035256 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-4a56938d-04dd-4ec6-bde8-e25141c19fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:36.121738 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 160/309] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 20:01:36.123506 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f15953-9247-4dd9-a18b-8657cec68288 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:36.137263 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56938d-04dd-4ec6-bde8-e25141c19fab None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:36.165016 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01847545-297a-4ec7-a18a-971d5935cda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:36.166104 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01847545-297a-4ec7-a18a-971d5935cda9 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:36.166641 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01847545-297a-4ec7-a18a-971d5935cda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:36.167167 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01847545-297a-4ec7-a18a-971d5935cda9 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:36.168149 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01847545-297a-4ec7-a18a-971d5935cda9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:36.168661 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01847545-297a-4ec7-a18a-971d5935cda9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:36.170410 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01847545-297a-4ec7-a18a-971d5935cda9 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:36.180465 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 150/310] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:36.193318 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01847545-297a-4ec7-a18a-971d5935cda9 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:36.269387 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56938d-04dd-4ec6-bde8-e25141c19fab None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:36.318798 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01847545-297a-4ec7-a18a-971d5935cda9 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:36.320802 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b8613-74df-4a02-a841-cc8efae81305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:36.322220 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b8613-74df-4a02-a841-cc8efae81305 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:36.322511 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b8613-74df-4a02-a841-cc8efae81305 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:36.322789 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b8613-74df-4a02-a841-cc8efae81305 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:36.338037 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b8613-74df-4a02-a841-cc8efae81305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:36.348338 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-0f0b8613-74df-4a02-a841-cc8efae81305 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 29 20:01:36.350890 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 161/311] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:01:36.357043 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b8613-74df-4a02-a841-cc8efae81305 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:36.359542 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30329fe6-4436-4f31-8efb-557b28418d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:36.360665 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30329fe6-4436-4f31-8efb-557b28418d95 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:36.361167 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30329fe6-4436-4f31-8efb-557b28418d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:36.361665 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30329fe6-4436-4f31-8efb-557b28418d95 None admin] PATH_INFO: `/v3/users/81df957fbbb645fea5b8b7c7c46ff79d` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:36.363078 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30329fe6-4436-4f31-8efb-557b28418d95 None admin] RBAC: Authorizing `identity:get_user(user_id=81df957fbbb645fea5b8b7c7c46ff79d)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:36.364770 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30329fe6-4436-4f31-8efb-557b28418d95 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:36.366926 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 151/312] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:36 2022] GET /identity/v3/users/81df957fbbb645fea5b8b7c7c46ff79d => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:36.373264 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30329fe6-4436-4f31-8efb-557b28418d95 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:36.473077 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b8613-74df-4a02-a841-cc8efae81305 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:36.492627 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30329fe6-4436-4f31-8efb-557b28418d95 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:36.508642 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c5d4c-f8c2-49e5-9627-e3d4aa7dcc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:36.509981 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c5d4c-f8c2-49e5-9627-e3d4aa7dcc20 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:36.510485 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c5d4c-f8c2-49e5-9627-e3d4aa7dcc20 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:36.511638 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c5d4c-f8c2-49e5-9627-e3d4aa7dcc20 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:36.512606 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c5d4c-f8c2-49e5-9627-e3d4aa7dcc20 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:36.513106 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c5d4c-f8c2-49e5-9627-e3d4aa7dcc20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:36.514718 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c5d4c-f8c2-49e5-9627-e3d4aa7dcc20 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:36.525636 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 162/313] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:36.532805 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c5d4c-f8c2-49e5-9627-e3d4aa7dcc20 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:36.535539 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc87aff-03db-499b-8dc3-6d3c5c6f600c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:36.536404 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc87aff-03db-499b-8dc3-6d3c5c6f600c None admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:36.536688 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc87aff-03db-499b-8dc3-6d3c5c6f600c None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:36.536966 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc87aff-03db-499b-8dc3-6d3c5c6f600c None admin] PATH_INFO: `/v3/system/users/81df957fbbb645fea5b8b7c7c46ff79d/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:36.539025 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc87aff-03db-499b-8dc3-6d3c5c6f600c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=81df957fbbb645fea5b8b7c7c46ff79d, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:36.540375 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc87aff-03db-499b-8dc3-6d3c5c6f600c None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:36.631297 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c5d4c-f8c2-49e5-9627-e3d4aa7dcc20 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:36.664061 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20515d01-ffff-4e59-ac8e-3ecfb9c30d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:36.665321 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20515d01-ffff-4e59-ac8e-3ecfb9c30d9a None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:36.665803 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20515d01-ffff-4e59-ac8e-3ecfb9c30d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:36.666331 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20515d01-ffff-4e59-ac8e-3ecfb9c30d9a None admin] PATH_INFO: `/v3/users/c38d7c0cf2964094bf8b8e94f3391eb2` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:36.667952 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20515d01-ffff-4e59-ac8e-3ecfb9c30d9a None admin] RBAC: Authorizing `identity:get_user(user_id=c38d7c0cf2964094bf8b8e94f3391eb2)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:36.674744 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20515d01-ffff-4e59-ac8e-3ecfb9c30d9a None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:36.674744 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 163/315] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:36 2022] GET /identity/v3/users/c38d7c0cf2964094bf8b8e94f3391eb2 => generated 297 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:36.674951 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 152/315] 10.222.0.43 () {58 vars in 1334 bytes} [Tue Mar 29 20:01:36 2022] PUT /identity/v3/system/users/81df957fbbb645fea5b8b7c7c46ff79d/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:01:36.687683 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20515d01-ffff-4e59-ac8e-3ecfb9c30d9a None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:36.805898 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20515d01-ffff-4e59-ac8e-3ecfb9c30d9a None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:36.844829 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71541567-2169-44e0-8fac-3704147d4d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:36.845522 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71541567-2169-44e0-8fac-3704147d4d16 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:36.845808 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71541567-2169-44e0-8fac-3704147d4d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:36.846087 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71541567-2169-44e0-8fac-3704147d4d16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:36.922079 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71541567-2169-44e0-8fac-3704147d4d16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:36.923561 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71541567-2169-44e0-8fac-3704147d4d16 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:37.087420 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 164/316] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:01:37.093981 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc87aff-03db-499b-8dc3-6d3c5c6f600c None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:37.206235 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc87aff-03db-499b-8dc3-6d3c5c6f600c None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:37.241859 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0e064-fab9-4f05-8073-24213fb18058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:37.242719 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0e064-fab9-4f05-8073-24213fb18058 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:37.242998 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0e064-fab9-4f05-8073-24213fb18058 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:37.243271 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0e064-fab9-4f05-8073-24213fb18058 None admin] PATH_INFO: `/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:37.244480 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0e064-fab9-4f05-8073-24213fb18058 None admin] RBAC: Authorizing `identity:get_project(project_id=90e0b1babc6a4f59b9783fd69c68f2ce)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:37.246610 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0e064-fab9-4f05-8073-24213fb18058 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:37.248599 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 153/317] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:37 2022] GET /identity/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:37.254506 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71541567-2169-44e0-8fac-3704147d4d16 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:37.357899 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71541567-2169-44e0-8fac-3704147d4d16 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:37.392505 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81305ba8-c517-45d7-af66-46c49f2a1def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:37.393164 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81305ba8-c517-45d7-af66-46c49f2a1def None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:37.393478 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81305ba8-c517-45d7-af66-46c49f2a1def None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:37.393757 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81305ba8-c517-45d7-af66-46c49f2a1def None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:37.394581 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81305ba8-c517-45d7-af66-46c49f2a1def None admin] RBAC: Adding query filter params (role.id=cd320364ae634461bc6ce03abdb40fa8, scope.project.id=90e0b1babc6a4f59b9783fd69c68f2ce, user.id=c38d7c0cf2964094bf8b8e94f3391eb2) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:37.394893 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81305ba8-c517-45d7-af66-46c49f2a1def None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:37.396319 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81305ba8-c517-45d7-af66-46c49f2a1def None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:37.402848 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 165/318] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:01:37 2022] GET /identity/v3/role_assignments?user.id=c38d7c0cf2964094bf8b8e94f3391eb2&scope.project.id=90e0b1babc6a4f59b9783fd69c68f2ce&role.id=cd320364ae634461bc6ce03abdb40fa8 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:38.369319 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0ae82-acc4-4a17-834b-5cc3fcaf5b9a None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:38.369861 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0ae82-acc4-4a17-834b-5cc3fcaf5b9a None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:38.369861 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0ae82-acc4-4a17-834b-5cc3fcaf5b9a None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:38.372484 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 154/319] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:38.377459 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c969f-a6d2-4d5b-a65a-a4982ca1650f None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:38.377859 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c969f-a6d2-4d5b-a65a-a4982ca1650f None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:38.378049 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c969f-a6d2-4d5b-a65a-a4982ca1650f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:38.395000 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-2d4c969f-a6d2-4d5b-a65a-a4982ca1650f None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:38.396179 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-2d4c969f-a6d2-4d5b-a65a-a4982ca1650f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:38.461040 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 166/320] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:38.472356 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e0a09-cf8a-4fe6-9945-e8f926716d26 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:38.472650 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e0a09-cf8a-4fe6-9945-e8f926716d26 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:38.472931 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e0a09-cf8a-4fe6-9945-e8f926716d26 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:38.474847 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 155/321] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:38.480742 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bd72a-efe9-4227-bdd6-88ddfd6738f0 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:38.481034 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bd72a-efe9-4227-bdd6-88ddfd6738f0 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:38.481330 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bd72a-efe9-4227-bdd6-88ddfd6738f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:38.483834 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e0a09-cf8a-4fe6-9945-e8f926716d26 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:38.498660 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-2e5bd72a-efe9-4227-bdd6-88ddfd6738f0 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:38.499786 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-2e5bd72a-efe9-4227-bdd6-88ddfd6738f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:38.592144 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e0a09-cf8a-4fe6-9945-e8f926716d26 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:38.628561 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efd704-0d70-4c05-9b5a-7102e8faf911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:38.629323 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efd704-0d70-4c05-9b5a-7102e8faf911 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:38.629604 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efd704-0d70-4c05-9b5a-7102e8faf911 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:38.629881 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efd704-0d70-4c05-9b5a-7102e8faf911 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:38.641829 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93efd704-0d70-4c05-9b5a-7102e8faf911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:38.649083 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-93efd704-0d70-4c05-9b5a-7102e8faf911 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 29 20:01:38.650616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 156/322] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:01:38.657251 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efd704-0d70-4c05-9b5a-7102e8faf911 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:38.688582 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 167/323] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:38.712678 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bd72a-efe9-4227-bdd6-88ddfd6738f0 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:38.761930 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efd704-0d70-4c05-9b5a-7102e8faf911 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:38.796561 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c10ed-e5c8-44aa-ba56-b0f296c6c95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:38.797234 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c10ed-e5c8-44aa-ba56-b0f296c6c95b None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:38.797556 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c10ed-e5c8-44aa-ba56-b0f296c6c95b None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:38.797839 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c10ed-e5c8-44aa-ba56-b0f296c6c95b None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:38.798585 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c10ed-e5c8-44aa-ba56-b0f296c6c95b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:38.798897 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c10ed-e5c8-44aa-ba56-b0f296c6c95b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:38.800298 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c10ed-e5c8-44aa-ba56-b0f296c6c95b None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:38.808630 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 157/324] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:01:38.813645 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bd72a-efe9-4227-bdd6-88ddfd6738f0 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:38.814450 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c10ed-e5c8-44aa-ba56-b0f296c6c95b None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:38.847032 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370f588-6b3a-48ff-8fbe-edd549adb7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:38.847833 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370f588-6b3a-48ff-8fbe-edd549adb7ef None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:38.848117 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370f588-6b3a-48ff-8fbe-edd549adb7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:38.848398 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370f588-6b3a-48ff-8fbe-edd549adb7ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:38.849581 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370f588-6b3a-48ff-8fbe-edd549adb7ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:38.851003 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370f588-6b3a-48ff-8fbe-edd549adb7ef None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:38.852762 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 168/325] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:01:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:38.859125 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370f588-6b3a-48ff-8fbe-edd549adb7ef None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:38.930925 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c10ed-e5c8-44aa-ba56-b0f296c6c95b None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:38.958496 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0aba6-f6d8-4b51-9885-731973181830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:38.959370 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0aba6-f6d8-4b51-9885-731973181830 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:38.959653 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0aba6-f6d8-4b51-9885-731973181830 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:38.959931 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0aba6-f6d8-4b51-9885-731973181830 None admin] PATH_INFO: `/v3/users/a1b98d581d154aa1bf884f89aad5e2e5` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:38.961119 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0aba6-f6d8-4b51-9885-731973181830 None admin] RBAC: Authorizing `identity:get_user(user_id=a1b98d581d154aa1bf884f89aad5e2e5)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:38.962586 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0aba6-f6d8-4b51-9885-731973181830 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:38.963201 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370f588-6b3a-48ff-8fbe-edd549adb7ef None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:38.964829 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 158/326] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:38 2022] GET /identity/v3/users/a1b98d581d154aa1bf884f89aad5e2e5 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:01:38.970259 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0aba6-f6d8-4b51-9885-731973181830 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:39.003391 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c806eac-d7ab-4637-825a-deeb9ab3cf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:39.004074 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c806eac-d7ab-4637-825a-deeb9ab3cf8e None admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:39.004358 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c806eac-d7ab-4637-825a-deeb9ab3cf8e None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:39.004744 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c806eac-d7ab-4637-825a-deeb9ab3cf8e None admin] PATH_INFO: `/v3/groups` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:39.005341 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c806eac-d7ab-4637-825a-deeb9ab3cf8e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:39.006778 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c806eac-d7ab-4637-825a-deeb9ab3cf8e None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:39.069157 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0aba6-f6d8-4b51-9885-731973181830 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:39.102627 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cbd0e-38a0-4870-9390-f30e3f20e172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:39.103484 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cbd0e-38a0-4870-9390-f30e3f20e172 None admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:39.103776 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cbd0e-38a0-4870-9390-f30e3f20e172 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:39.104055 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cbd0e-38a0-4870-9390-f30e3f20e172 None admin] PATH_INFO: `/v3/system/users/a1b98d581d154aa1bf884f89aad5e2e5/roles/cd320364ae634461bc6ce03abdb40fa8` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:39.105611 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803cbd0e-38a0-4870-9390-f30e3f20e172 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a1b98d581d154aa1bf884f89aad5e2e5, role_id=cd320364ae634461bc6ce03abdb40fa8)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:39.107940 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803cbd0e-38a0-4870-9390-f30e3f20e172 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:39.108042 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 169/327] 10.222.0.43 () {60 vars in 1134 bytes} [Tue Mar 29 20:01:38 2022] POST /identity/v3/groups => generated 226 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:01:39.108850 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed2f66-5e92-4c02-819a-153566056fbd None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:39.109153 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed2f66-5e92-4c02-819a-153566056fbd None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:39.109460 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed2f66-5e92-4c02-819a-153566056fbd None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:39.111147 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 170/328] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:39.116809 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c611c3e-5dc9-4a62-9d59-b724fca7526e None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:39.117106 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c611c3e-5dc9-4a62-9d59-b724fca7526e None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:39.117452 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c611c3e-5dc9-4a62-9d59-b724fca7526e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:39.136465 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-8c611c3e-5dc9-4a62-9d59-b724fca7526e None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:39.137850 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-8c611c3e-5dc9-4a62-9d59-b724fca7526e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:39.159403 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 159/329] 10.222.0.43 () {58 vars in 1334 bytes} [Tue Mar 29 20:01:38 2022] PUT /identity/v3/system/users/a1b98d581d154aa1bf884f89aad5e2e5/roles/cd320364ae634461bc6ce03abdb40fa8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:01:39.217601 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 171/330] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 20:01:39.240289 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cbd0e-38a0-4870-9390-f30e3f20e172 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:39.355330 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cbd0e-38a0-4870-9390-f30e3f20e172 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:39.391153 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c66c74-e41c-4f3d-88ce-293ee85d11fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:39.392692 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c66c74-e41c-4f3d-88ce-293ee85d11fa None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:39.393159 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c66c74-e41c-4f3d-88ce-293ee85d11fa None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:39.393635 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c66c74-e41c-4f3d-88ce-293ee85d11fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:39.405221 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c66c74-e41c-4f3d-88ce-293ee85d11fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:39.412724 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-20c66c74-e41c-4f3d-88ce-293ee85d11fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 20:01:39.414156 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 160/331] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:39.420682 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c611c3e-5dc9-4a62-9d59-b724fca7526e None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:39.525888 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c611c3e-5dc9-4a62-9d59-b724fca7526e None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:39.561439 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52dba46-dfa7-4b84-9ba5-ed70a416c080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:39.562119 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dba46-dfa7-4b84-9ba5-ed70a416c080 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:39.562462 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dba46-dfa7-4b84-9ba5-ed70a416c080 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:39.562738 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dba46-dfa7-4b84-9ba5-ed70a416c080 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:39.563488 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52dba46-dfa7-4b84-9ba5-ed70a416c080 None admin] RBAC: Adding query filter params (name=member) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:39.563794 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52dba46-dfa7-4b84-9ba5-ed70a416c080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:39.565178 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52dba46-dfa7-4b84-9ba5-ed70a416c080 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:39.575052 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 172/332] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:39.580319 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c66c74-e41c-4f3d-88ce-293ee85d11fa None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:39.688093 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c66c74-e41c-4f3d-88ce-293ee85d11fa None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:39.725925 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31e203-b184-4fe4-a880-a7eb1d021f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:39.726818 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31e203-b184-4fe4-a880-a7eb1d021f3e None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:39.727110 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31e203-b184-4fe4-a880-a7eb1d021f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:39.727394 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31e203-b184-4fe4-a880-a7eb1d021f3e None admin] PATH_INFO: `/v3/users/81df957fbbb645fea5b8b7c7c46ff79d` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:39.728604 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31e203-b184-4fe4-a880-a7eb1d021f3e None admin] RBAC: Authorizing `identity:get_user(user_id=81df957fbbb645fea5b8b7c7c46ff79d)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:39.730616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31e203-b184-4fe4-a880-a7eb1d021f3e None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:39.732246 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 161/333] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:39 2022] GET /identity/v3/users/81df957fbbb645fea5b8b7c7c46ff79d => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:01:39.738044 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52dba46-dfa7-4b84-9ba5-ed70a416c080 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:39.856259 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52dba46-dfa7-4b84-9ba5-ed70a416c080 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:39.893532 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779103a-c731-4c62-a00c-97321669c17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:39.894189 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779103a-c731-4c62-a00c-97321669c17f None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:39.894471 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779103a-c731-4c62-a00c-97321669c17f None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:39.894743 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779103a-c731-4c62-a00c-97321669c17f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:39.895558 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2779103a-c731-4c62-a00c-97321669c17f None admin] RBAC: Adding query filter params (role.id=e49df2a8408b4f5fa7e284575007ce83, user.id=81df957fbbb645fea5b8b7c7c46ff79d, scope.system=all) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:39.895865 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2779103a-c731-4c62-a00c-97321669c17f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:39.897412 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2779103a-c731-4c62-a00c-97321669c17f None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:39.912277 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 173/334] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Mar 29 20:01:39 2022] GET /identity/v3/role_assignments?user.id=81df957fbbb645fea5b8b7c7c46ff79d&scope.system=all&role.id=e49df2a8408b4f5fa7e284575007ce83 => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:41.794430 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358b431-d7ca-4091-a1b2-afa92fca0647 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:41.795463 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358b431-d7ca-4091-a1b2-afa92fca0647 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:41.795951 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358b431-d7ca-4091-a1b2-afa92fca0647 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:41.798198 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 162/335] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:41.806041 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358f57c-6bd9-4ffc-8ed0-bdb63c830f04 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:41.806930 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358f57c-6bd9-4ffc-8ed0-bdb63c830f04 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:41.807626 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358f57c-6bd9-4ffc-8ed0-bdb63c830f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:41.825078 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-0358f57c-6bd9-4ffc-8ed0-bdb63c830f04 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:41.827224 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-0358f57c-6bd9-4ffc-8ed0-bdb63c830f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:41.896057 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 174/336] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:41.941975 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358b431-d7ca-4091-a1b2-afa92fca0647 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:42.159053 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358b431-d7ca-4091-a1b2-afa92fca0647 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:42.196311 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8e31d-97a7-4c21-98da-b5ece61a81a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:42.197202 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8e31d-97a7-4c21-98da-b5ece61a81a8 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:42.197525 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8e31d-97a7-4c21-98da-b5ece61a81a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:42.197830 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8e31d-97a7-4c21-98da-b5ece61a81a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:42.212957 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8e31d-97a7-4c21-98da-b5ece61a81a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:42.221023 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-f8f8e31d-97a7-4c21-98da-b5ece61a81a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 20:01:42.222552 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 163/337] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:42.222664 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a74cc-eea0-42e7-86e0-d806c4bcec9f None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:42.223141 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a74cc-eea0-42e7-86e0-d806c4bcec9f None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:42.223641 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a74cc-eea0-42e7-86e0-d806c4bcec9f None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:42.225661 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 175/338] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:01:42.228364 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8e31d-97a7-4c21-98da-b5ece61a81a8 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:42.235093 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4664f-f2c6-4563-8173-30f21138d60f None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:42.235093 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4664f-f2c6-4563-8173-30f21138d60f None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:42.235093 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4664f-f2c6-4563-8173-30f21138d60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:42.255459 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-e3c4664f-f2c6-4563-8173-30f21138d60f None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:42.256774 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e3c4664f-f2c6-4563-8173-30f21138d60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:42.359869 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 176/339] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:42.405695 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8e31d-97a7-4c21-98da-b5ece61a81a8 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:42.406287 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4664f-f2c6-4563-8173-30f21138d60f None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:42.447914 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370ef29-8247-443c-8ad5-1035a4194fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:42.449436 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370ef29-8247-443c-8ad5-1035a4194fde None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:42.449886 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370ef29-8247-443c-8ad5-1035a4194fde None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:42.450372 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370ef29-8247-443c-8ad5-1035a4194fde None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:42.451343 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370ef29-8247-443c-8ad5-1035a4194fde None admin] RBAC: Adding query filter params (name=member) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:42.451820 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370ef29-8247-443c-8ad5-1035a4194fde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:42.453366 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370ef29-8247-443c-8ad5-1035a4194fde None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:42.466571 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 164/340] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:42.471616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370ef29-8247-443c-8ad5-1035a4194fde None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:42.557886 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4664f-f2c6-4563-8173-30f21138d60f None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:42.626468 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8df3f9-e966-4dcc-93d5-171f515127fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:42.627297 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8df3f9-e966-4dcc-93d5-171f515127fd None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:42.627589 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8df3f9-e966-4dcc-93d5-171f515127fd None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:42.627873 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8df3f9-e966-4dcc-93d5-171f515127fd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:42.646697 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8df3f9-e966-4dcc-93d5-171f515127fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:42.654990 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-cb8df3f9-e966-4dcc-93d5-171f515127fd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 29 20:01:42.656689 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 177/341] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:01:42.662759 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8df3f9-e966-4dcc-93d5-171f515127fd None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:42.681061 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370ef29-8247-443c-8ad5-1035a4194fde None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:42.752873 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f161b05-f788-4d57-b8a3-0b9effe0fbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:42.753857 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f161b05-f788-4d57-b8a3-0b9effe0fbaf None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:42.754318 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f161b05-f788-4d57-b8a3-0b9effe0fbaf None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:42.754768 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f161b05-f788-4d57-b8a3-0b9effe0fbaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:42.834473 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8df3f9-e966-4dcc-93d5-171f515127fd None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:42.856985 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f161b05-f788-4d57-b8a3-0b9effe0fbaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:42.860507 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f161b05-f788-4d57-b8a3-0b9effe0fbaf None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:42.889516 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd5279-aa7a-49dc-9c73-0cabfde37f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:42.890266 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd5279-aa7a-49dc-9c73-0cabfde37f7f None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:42.890553 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd5279-aa7a-49dc-9c73-0cabfde37f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:42.890851 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd5279-aa7a-49dc-9c73-0cabfde37f7f None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:42.891670 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd5279-aa7a-49dc-9c73-0cabfde37f7f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:42.891987 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd5279-aa7a-49dc-9c73-0cabfde37f7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:42.893418 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd5279-aa7a-49dc-9c73-0cabfde37f7f None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:42.903086 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 178/342] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:42.904417 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7084d2-8f69-4dcf-a577-c7c5d6fbbec8 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:42.904711 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7084d2-8f69-4dcf-a577-c7c5d6fbbec8 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:42.904997 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7084d2-8f69-4dcf-a577-c7c5d6fbbec8 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:42.910457 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 179/343] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:42.912299 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7084d2-8f69-4dcf-a577-c7c5d6fbbec8 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:42.989133 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 165/344] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:01:42.991386 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1140ad-84c6-4bcf-b680-b5ce77b3ed1f None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:42.991869 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1140ad-84c6-4bcf-b680-b5ce77b3ed1f None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:42.992321 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1140ad-84c6-4bcf-b680-b5ce77b3ed1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:43.015337 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-6b1140ad-84c6-4bcf-b680-b5ce77b3ed1f None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:43.016825 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-6b1140ad-84c6-4bcf-b680-b5ce77b3ed1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:43.060782 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7084d2-8f69-4dcf-a577-c7c5d6fbbec8 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:43.098117 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b744cd-a97b-4c6b-8444-f1c514d5309d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:43.099290 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b744cd-a97b-4c6b-8444-f1c514d5309d None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:43.099770 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b744cd-a97b-4c6b-8444-f1c514d5309d None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:43.100215 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b744cd-a97b-4c6b-8444-f1c514d5309d None admin] PATH_INFO: `/v3/users/a1b98d581d154aa1bf884f89aad5e2e5` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:43.101615 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b744cd-a97b-4c6b-8444-f1c514d5309d None admin] RBAC: Authorizing `identity:get_user(user_id=a1b98d581d154aa1bf884f89aad5e2e5)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:43.103418 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b744cd-a97b-4c6b-8444-f1c514d5309d None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:43.106523 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 180/345] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:01:42 2022] GET /identity/v3/users/a1b98d581d154aa1bf884f89aad5e2e5 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:01:43.107505 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b744cd-a97b-4c6b-8444-f1c514d5309d None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:43.170012 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 166/346] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:43.172961 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1140ad-84c6-4bcf-b680-b5ce77b3ed1f None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:43.235983 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b744cd-a97b-4c6b-8444-f1c514d5309d None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:43.275851 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728807c-bd24-4c69-8197-2474784c829c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:43.276781 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728807c-bd24-4c69-8197-2474784c829c None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:43.277068 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728807c-bd24-4c69-8197-2474784c829c None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:43.277379 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728807c-bd24-4c69-8197-2474784c829c None admin] PATH_INFO: `/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:43.279498 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728807c-bd24-4c69-8197-2474784c829c None admin] RBAC: Authorizing `identity:get_project(project_id=fec2338df2a64a9a9b5d8a9b527bbf26)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:43.281043 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728807c-bd24-4c69-8197-2474784c829c None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:43.283148 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 181/347] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:43 2022] GET /identity/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:43.284519 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070feb36-b619-48a5-8d9c-184845bb3abc None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:43.284767 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070feb36-b619-48a5-8d9c-184845bb3abc None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:43.285053 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070feb36-b619-48a5-8d9c-184845bb3abc None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:43.287962 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 182/348] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:43.287962 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070feb36-b619-48a5-8d9c-184845bb3abc None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:43.290166 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1140ad-84c6-4bcf-b680-b5ce77b3ed1f None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:43.326414 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1d633-a55f-4e1d-a79e-feae483bf3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:43.327419 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1d633-a55f-4e1d-a79e-feae483bf3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:43.327915 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1d633-a55f-4e1d-a79e-feae483bf3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:43.328418 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1d633-a55f-4e1d-a79e-feae483bf3b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:43.329477 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1d633-a55f-4e1d-a79e-feae483bf3b5 None admin] RBAC: Adding query filter params (role.id=cd320364ae634461bc6ce03abdb40fa8, user.id=a1b98d581d154aa1bf884f89aad5e2e5, scope.system=all) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:43.330002 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1d633-a55f-4e1d-a79e-feae483bf3b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:43.331619 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1d633-a55f-4e1d-a79e-feae483bf3b5 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:43.344092 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 167/349] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Mar 29 20:01:43 2022] GET /identity/v3/role_assignments?user.id=a1b98d581d154aa1bf884f89aad5e2e5&scope.system=all&role.id=cd320364ae634461bc6ce03abdb40fa8 => generated 510 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:43.345781 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782723c-5ec1-491c-b1a6-e346137c2287 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:43.346267 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782723c-5ec1-491c-b1a6-e346137c2287 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:43.346886 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782723c-5ec1-491c-b1a6-e346137c2287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:43.365806 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-f782723c-5ec1-491c-b1a6-e346137c2287 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:43.367452 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-f782723c-5ec1-491c-b1a6-e346137c2287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:43.429143 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070feb36-b619-48a5-8d9c-184845bb3abc None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:43.450329 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 168/350] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:43.451489 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782723c-5ec1-491c-b1a6-e346137c2287 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:43.534221 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c38f0-613f-4c3c-8ba8-1fbb01f1395c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:43.534991 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c38f0-613f-4c3c-8ba8-1fbb01f1395c None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:43.535278 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c38f0-613f-4c3c-8ba8-1fbb01f1395c None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:43.535560 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c38f0-613f-4c3c-8ba8-1fbb01f1395c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:43.565608 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c38f0-613f-4c3c-8ba8-1fbb01f1395c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:43.565997 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782723c-5ec1-491c-b1a6-e346137c2287 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:43.582251 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-3d6c38f0-613f-4c3c-8ba8-1fbb01f1395c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 29 20:01:43.583586 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 183/351] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Mar 29 20:01:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:43.584439 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c38f0-613f-4c3c-8ba8-1fbb01f1395c None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:43.605248 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5186583-1aef-45ce-9269-86125212fa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:43.606392 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5186583-1aef-45ce-9269-86125212fa7d None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:43.606822 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5186583-1aef-45ce-9269-86125212fa7d None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:43.607271 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5186583-1aef-45ce-9269-86125212fa7d None admin] PATH_INFO: `/v3/groups/7af94451ae87418797e4a02fa0325f83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:43.614046 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5186583-1aef-45ce-9269-86125212fa7d None admin] RBAC: Authorizing `identity:get_group(group_id=7af94451ae87418797e4a02fa0325f83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:43.615712 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5186583-1aef-45ce-9269-86125212fa7d None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:43.617724 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 169/352] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Mar 29 20:01:43 2022] GET /identity/v3/groups/7af94451ae87418797e4a02fa0325f83 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:43.618718 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5186583-1aef-45ce-9269-86125212fa7d None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:43.743443 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5186583-1aef-45ce-9269-86125212fa7d None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:43.764883 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c38f0-613f-4c3c-8ba8-1fbb01f1395c None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:43.797153 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98dd4b8-619d-4b3f-9411-133657a827d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:43.798083 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dd4b8-619d-4b3f-9411-133657a827d4 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:43.798502 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dd4b8-619d-4b3f-9411-133657a827d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:43.798883 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dd4b8-619d-4b3f-9411-133657a827d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:43.799939 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98dd4b8-619d-4b3f-9411-133657a827d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:43.800254 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98dd4b8-619d-4b3f-9411-133657a827d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:43.802141 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98dd4b8-619d-4b3f-9411-133657a827d4 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:43.817053 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 170/353] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:01:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:43.817053 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98dd4b8-619d-4b3f-9411-133657a827d4 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:43.818862 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e1896-8eb4-4395-9127-1a1841d7f742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:43.819674 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e1896-8eb4-4395-9127-1a1841d7f742 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:43.819955 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e1896-8eb4-4395-9127-1a1841d7f742 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:43.820226 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e1896-8eb4-4395-9127-1a1841d7f742 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:43.831838 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e1896-8eb4-4395-9127-1a1841d7f742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:43.839225 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-7f6e1896-8eb4-4395-9127-1a1841d7f742 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 20:01:43.840608 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 184/354] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:43.841757 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0db401-c3f9-4adf-a8f1-37b164f22017 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:43.842041 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0db401-c3f9-4adf-a8f1-37b164f22017 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:43.842316 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0db401-c3f9-4adf-a8f1-37b164f22017 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:43.843977 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 185/355] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:43.844672 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0db401-c3f9-4adf-a8f1-37b164f22017 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:43.941046 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98dd4b8-619d-4b3f-9411-133657a827d4 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:43.984443 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0db401-c3f9-4adf-a8f1-37b164f22017 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:43.991264 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb00dbe-5c35-451b-b79c-e5f2c640a9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:43.991922 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb00dbe-5c35-451b-b79c-e5f2c640a9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:43.992205 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb00dbe-5c35-451b-b79c-e5f2c640a9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:43.992482 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb00dbe-5c35-451b-b79c-e5f2c640a9a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:43.993326 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb00dbe-5c35-451b-b79c-e5f2c640a9a8 None admin] RBAC: Adding query filter params (group.id=7af94451ae87418797e4a02fa0325f83, role.id=e49df2a8408b4f5fa7e284575007ce83, scope.project.id=fec2338df2a64a9a9b5d8a9b527bbf26) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:43.993647 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb00dbe-5c35-451b-b79c-e5f2c640a9a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:43.995257 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb00dbe-5c35-451b-b79c-e5f2c640a9a8 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:44.002153 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 171/356] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Mar 29 20:01:43 2022] GET /identity/v3/role_assignments?group.id=7af94451ae87418797e4a02fa0325f83&scope.project.id=fec2338df2a64a9a9b5d8a9b527bbf26&role.id=e49df2a8408b4f5fa7e284575007ce83 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:44.002973 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb00dbe-5c35-451b-b79c-e5f2c640a9a8 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:44.022126 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b96439-3551-4f6b-ac45-e9a1a83a9acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:44.022795 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b96439-3551-4f6b-ac45-e9a1a83a9acd None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:44.023126 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b96439-3551-4f6b-ac45-e9a1a83a9acd None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:44.023407 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b96439-3551-4f6b-ac45-e9a1a83a9acd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:44.110796 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b96439-3551-4f6b-ac45-e9a1a83a9acd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:44.112581 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b96439-3551-4f6b-ac45-e9a1a83a9acd None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:44.143493 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb00dbe-5c35-451b-b79c-e5f2c640a9a8 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:44.191587 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f82e53-bb83-49cc-934b-680b4eb99632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:44.192403 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f82e53-bb83-49cc-934b-680b4eb99632 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:44.192758 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f82e53-bb83-49cc-934b-680b4eb99632 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:44.193113 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f82e53-bb83-49cc-934b-680b4eb99632 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:44.193983 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f82e53-bb83-49cc-934b-680b4eb99632 None admin] RBAC: Adding query filter params (name=member) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:44.194371 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f82e53-bb83-49cc-934b-680b4eb99632 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:44.195888 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f82e53-bb83-49cc-934b-680b4eb99632 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:44.207540 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 172/357] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:44.208807 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29333781-a446-4517-8299-b34a55fc23d0 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:44.209174 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29333781-a446-4517-8299-b34a55fc23d0 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:44.214278 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29333781-a446-4517-8299-b34a55fc23d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:44.225767 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 186/358] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:01:44.226903 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b96439-3551-4f6b-ac45-e9a1a83a9acd None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:44.232946 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-29333781-a446-4517-8299-b34a55fc23d0 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:44.234275 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-29333781-a446-4517-8299-b34a55fc23d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:44.304489 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 173/359] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:44.305383 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29333781-a446-4517-8299-b34a55fc23d0 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:44.348525 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b96439-3551-4f6b-ac45-e9a1a83a9acd None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:44.398030 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03118e66-320e-49f7-9ad1-0822520dcb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:44.398692 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03118e66-320e-49f7-9ad1-0822520dcb5f None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:44.398984 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03118e66-320e-49f7-9ad1-0822520dcb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:44.399264 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03118e66-320e-49f7-9ad1-0822520dcb5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:44.414054 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29333781-a446-4517-8299-b34a55fc23d0 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:44.451883 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d4609-9188-4833-bac3-349736801dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:44.452749 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d4609-9188-4833-bac3-349736801dab None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:44.453032 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d4609-9188-4833-bac3-349736801dab None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:44.453328 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d4609-9188-4833-bac3-349736801dab None admin] PATH_INFO: `/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:44.454541 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d4609-9188-4833-bac3-349736801dab None admin] RBAC: Authorizing `identity:get_project(project_id=fec2338df2a64a9a9b5d8a9b527bbf26)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:44.456070 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d4609-9188-4833-bac3-349736801dab None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:44.459279 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 174/360] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:44 2022] GET /identity/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:44.460381 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7641ee6-848b-476e-8e7f-46e0a283c397 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:44.460673 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7641ee6-848b-476e-8e7f-46e0a283c397 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:44.460948 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7641ee6-848b-476e-8e7f-46e0a283c397 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:44.465425 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 175/361] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:44.466595 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7641ee6-848b-476e-8e7f-46e0a283c397 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:44.494815 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03118e66-320e-49f7-9ad1-0822520dcb5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:44.496281 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03118e66-320e-49f7-9ad1-0822520dcb5f None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:44.596811 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7641ee6-848b-476e-8e7f-46e0a283c397 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:44.618820 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 187/362] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:01:44.620048 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03118e66-320e-49f7-9ad1-0822520dcb5f None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:44.645319 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a0eab3-a218-4399-9dd6-09e5c4441940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:44.646235 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0eab3-a218-4399-9dd6-09e5c4441940 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:44.646518 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0eab3-a218-4399-9dd6-09e5c4441940 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:44.646799 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0eab3-a218-4399-9dd6-09e5c4441940 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:44.659799 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a0eab3-a218-4399-9dd6-09e5c4441940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:44.668165 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-59a0eab3-a218-4399-9dd6-09e5c4441940 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 29 20:01:44.669911 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 176/363] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Mar 29 20:01:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:44.670565 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b104ae0-0bdb-4b5d-b076-dfce61b39d16 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:44.670849 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b104ae0-0bdb-4b5d-b076-dfce61b39d16 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:44.671123 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b104ae0-0bdb-4b5d-b076-dfce61b39d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:44.689712 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-3b104ae0-0bdb-4b5d-b076-dfce61b39d16 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:44.691576 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-3b104ae0-0bdb-4b5d-b076-dfce61b39d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:44.751483 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03118e66-320e-49f7-9ad1-0822520dcb5f None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:44.786518 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 177/364] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:44.787453 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b104ae0-0bdb-4b5d-b076-dfce61b39d16 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:44.801086 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a523e-e095-49b7-a014-dbe1629f6080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:44.802435 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a523e-e095-49b7-a014-dbe1629f6080 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:44.802809 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a523e-e095-49b7-a014-dbe1629f6080 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:44.803340 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a523e-e095-49b7-a014-dbe1629f6080 None admin] PATH_INFO: `/v3/groups/7af94451ae87418797e4a02fa0325f83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:44.804944 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a523e-e095-49b7-a014-dbe1629f6080 None admin] RBAC: Authorizing `identity:get_group(group_id=7af94451ae87418797e4a02fa0325f83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:44.806865 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a523e-e095-49b7-a014-dbe1629f6080 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:44.809356 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 188/365] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Mar 29 20:01:44 2022] GET /identity/v3/groups/7af94451ae87418797e4a02fa0325f83 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:44.809934 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a523e-e095-49b7-a014-dbe1629f6080 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:44.924011 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b104ae0-0bdb-4b5d-b076-dfce61b39d16 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:44.947186 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a523e-e095-49b7-a014-dbe1629f6080 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:44.971909 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521e2d9-f1e9-4a96-bc0e-9b9a0dd650a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:44.972890 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521e2d9-f1e9-4a96-bc0e-9b9a0dd650a6 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:44.973181 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521e2d9-f1e9-4a96-bc0e-9b9a0dd650a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:44.973521 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521e2d9-f1e9-4a96-bc0e-9b9a0dd650a6 None admin] PATH_INFO: `/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:44.975168 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521e2d9-f1e9-4a96-bc0e-9b9a0dd650a6 None admin] RBAC: Authorizing `identity:get_project(project_id=90e0b1babc6a4f59b9783fd69c68f2ce)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:44.977076 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521e2d9-f1e9-4a96-bc0e-9b9a0dd650a6 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:44.981841 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 178/366] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:44 2022] GET /identity/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:44.981841 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521e2d9-f1e9-4a96-bc0e-9b9a0dd650a6 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:44.998202 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb820be4-e7ee-4859-b295-fff24fc86880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:44.999225 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb820be4-e7ee-4859-b295-fff24fc86880 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:44.999722 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb820be4-e7ee-4859-b295-fff24fc86880 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:45.000006 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb820be4-e7ee-4859-b295-fff24fc86880 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:45.001118 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb820be4-e7ee-4859-b295-fff24fc86880 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:45.002312 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb820be4-e7ee-4859-b295-fff24fc86880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:45.003293 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb820be4-e7ee-4859-b295-fff24fc86880 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:45.016557 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 189/367] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:01:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:45.017454 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb820be4-e7ee-4859-b295-fff24fc86880 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:45.099901 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521e2d9-f1e9-4a96-bc0e-9b9a0dd650a6 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:45.152374 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb820be4-e7ee-4859-b295-fff24fc86880 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:45.152563 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9eadf-7d0b-4c34-94d7-540c2abd1184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:45.152928 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9eadf-7d0b-4c34-94d7-540c2abd1184 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:45.154096 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9eadf-7d0b-4c34-94d7-540c2abd1184 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:45.154389 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9eadf-7d0b-4c34-94d7-540c2abd1184 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:45.155238 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9eadf-7d0b-4c34-94d7-540c2abd1184 None admin] RBAC: Adding query filter params (group.id=7af94451ae87418797e4a02fa0325f83, role.id=82747af757b549cbaa39504334f32f9f, scope.project.id=fec2338df2a64a9a9b5d8a9b527bbf26) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:45.155557 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9eadf-7d0b-4c34-94d7-540c2abd1184 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:45.156990 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9eadf-7d0b-4c34-94d7-540c2abd1184 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:45.165114 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 179/368] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Mar 29 20:01:44 2022] GET /identity/v3/role_assignments?group.id=7af94451ae87418797e4a02fa0325f83&scope.project.id=fec2338df2a64a9a9b5d8a9b527bbf26&role.id=82747af757b549cbaa39504334f32f9f => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:45.169548 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9eadf-7d0b-4c34-94d7-540c2abd1184 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:45.197419 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9abdc-e684-43e0-a359-7bd329c675bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:45.198585 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9abdc-e684-43e0-a359-7bd329c675bd None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:45.198872 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9abdc-e684-43e0-a359-7bd329c675bd None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:45.199154 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9abdc-e684-43e0-a359-7bd329c675bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:45.211336 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9abdc-e684-43e0-a359-7bd329c675bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:45.220108 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-2fd9abdc-e684-43e0-a359-7bd329c675bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:01:45.221718 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 190/369] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:01:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:45.222536 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9abdc-e684-43e0-a359-7bd329c675bd None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:45.305777 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9eadf-7d0b-4c34-94d7-540c2abd1184 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:45.346509 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28e75a-5f94-4588-82b2-c0b42b567bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:45.347386 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28e75a-5f94-4588-82b2-c0b42b567bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:45.347669 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28e75a-5f94-4588-82b2-c0b42b567bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:45.347946 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28e75a-5f94-4588-82b2-c0b42b567bf9 None admin] PATH_INFO: `/v3/groups/7af94451ae87418797e4a02fa0325f83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:45.349163 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28e75a-5f94-4588-82b2-c0b42b567bf9 None admin] RBAC: Authorizing `identity:get_group(group_id=7af94451ae87418797e4a02fa0325f83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:45.350757 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28e75a-5f94-4588-82b2-c0b42b567bf9 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:45.352836 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 180/370] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Mar 29 20:01:45 2022] GET /identity/v3/groups/7af94451ae87418797e4a02fa0325f83 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:45.353679 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28e75a-5f94-4588-82b2-c0b42b567bf9 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:45.357817 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9abdc-e684-43e0-a359-7bd329c675bd None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:45.401668 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2af38-f396-4e3a-8e25-96ca97cad58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:45.402382 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2af38-f396-4e3a-8e25-96ca97cad58d None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:45.402667 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2af38-f396-4e3a-8e25-96ca97cad58d None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:45.402964 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2af38-f396-4e3a-8e25-96ca97cad58d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:45.484455 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28e75a-5f94-4588-82b2-c0b42b567bf9 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:45.496207 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2af38-f396-4e3a-8e25-96ca97cad58d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:45.497984 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2af38-f396-4e3a-8e25-96ca97cad58d None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:45.527378 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ace0b-00cc-4527-8975-f539c52bafa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:45.528628 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ace0b-00cc-4527-8975-f539c52bafa9 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:45.528918 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ace0b-00cc-4527-8975-f539c52bafa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:45.529201 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ace0b-00cc-4527-8975-f539c52bafa9 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:45.530155 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ace0b-00cc-4527-8975-f539c52bafa9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:45.530768 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ace0b-00cc-4527-8975-f539c52bafa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:45.532432 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ace0b-00cc-4527-8975-f539c52bafa9 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:45.544020 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 181/371] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:45.544935 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ace0b-00cc-4527-8975-f539c52bafa9 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:45.610699 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 191/372] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:01:45.611670 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2af38-f396-4e3a-8e25-96ca97cad58d None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:45.659761 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ace0b-00cc-4527-8975-f539c52bafa9 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:45.693347 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c659f7-745e-4ba3-ae11-2c97912d8cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:45.694014 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c659f7-745e-4ba3-ae11-2c97912d8cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:45.694301 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c659f7-745e-4ba3-ae11-2c97912d8cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:45.694583 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c659f7-745e-4ba3-ae11-2c97912d8cd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:45.695419 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c659f7-745e-4ba3-ae11-2c97912d8cd5 None admin] RBAC: Adding query filter params (group.id=7af94451ae87418797e4a02fa0325f83, role.id=e49df2a8408b4f5fa7e284575007ce83, scope.project.id=90e0b1babc6a4f59b9783fd69c68f2ce) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:45.695737 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c659f7-745e-4ba3-ae11-2c97912d8cd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:45.697304 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c659f7-745e-4ba3-ae11-2c97912d8cd5 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:45.703884 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 182/373] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Mar 29 20:01:45 2022] GET /identity/v3/role_assignments?group.id=7af94451ae87418797e4a02fa0325f83&scope.project.id=90e0b1babc6a4f59b9783fd69c68f2ce&role.id=e49df2a8408b4f5fa7e284575007ce83 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:45.704685 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c659f7-745e-4ba3-ae11-2c97912d8cd5 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:45.727171 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2af38-f396-4e3a-8e25-96ca97cad58d None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:45.784988 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cead87-3cac-485a-8d35-ce979e9a22a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:45.786072 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cead87-3cac-485a-8d35-ce979e9a22a6 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:45.786558 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cead87-3cac-485a-8d35-ce979e9a22a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:45.787035 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cead87-3cac-485a-8d35-ce979e9a22a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:45.890286 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cead87-3cac-485a-8d35-ce979e9a22a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:45.891776 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cead87-3cac-485a-8d35-ce979e9a22a6 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:45.903786 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c659f7-745e-4ba3-ae11-2c97912d8cd5 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:45.949329 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac06174-046f-427f-b63a-d9fd7db9ceb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:45.949329 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac06174-046f-427f-b63a-d9fd7db9ceb4 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:45.950122 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac06174-046f-427f-b63a-d9fd7db9ceb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:45.950438 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac06174-046f-427f-b63a-d9fd7db9ceb4 None admin] PATH_INFO: `/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:45.951721 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac06174-046f-427f-b63a-d9fd7db9ceb4 None admin] RBAC: Authorizing `identity:get_project(project_id=90e0b1babc6a4f59b9783fd69c68f2ce)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:45.953169 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac06174-046f-427f-b63a-d9fd7db9ceb4 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:45.955311 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 183/374] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:45 2022] GET /identity/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:45.960862 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac06174-046f-427f-b63a-d9fd7db9ceb4 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:46.034174 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 192/375] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:01:46.039691 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cead87-3cac-485a-8d35-ce979e9a22a6 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:46.074221 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac06174-046f-427f-b63a-d9fd7db9ceb4 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:46.108873 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e54dd5-8948-416f-9f40-6f4bba58a876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:46.109828 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e54dd5-8948-416f-9f40-6f4bba58a876 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:46.110120 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e54dd5-8948-416f-9f40-6f4bba58a876 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:46.110403 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e54dd5-8948-416f-9f40-6f4bba58a876 None admin] PATH_INFO: `/v3/groups/7af94451ae87418797e4a02fa0325f83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:46.111625 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e54dd5-8948-416f-9f40-6f4bba58a876 None admin] RBAC: Authorizing `identity:get_group(group_id=7af94451ae87418797e4a02fa0325f83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:46.113080 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e54dd5-8948-416f-9f40-6f4bba58a876 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:46.114744 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 184/376] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Mar 29 20:01:45 2022] GET /identity/v3/groups/7af94451ae87418797e4a02fa0325f83 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:01:46.121656 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e54dd5-8948-416f-9f40-6f4bba58a876 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:46.146560 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cead87-3cac-485a-8d35-ce979e9a22a6 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:46.185541 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e1250-6643-463b-902e-88875c6a18a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:46.186645 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e1250-6643-463b-902e-88875c6a18a4 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:46.187169 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e1250-6643-463b-902e-88875c6a18a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:46.187588 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e1250-6643-463b-902e-88875c6a18a4 None admin] PATH_INFO: `/v3/projects/a15fd3ff4f1b47218a3a97159af6b6bb` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:46.188927 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e1250-6643-463b-902e-88875c6a18a4 None admin] RBAC: Authorizing `identity:get_project(project_id=a15fd3ff4f1b47218a3a97159af6b6bb)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:46.191173 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e1250-6643-463b-902e-88875c6a18a4 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:46.197020 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 193/377] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:46 2022] GET /identity/v3/projects/a15fd3ff4f1b47218a3a97159af6b6bb => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:46.201904 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e1250-6643-463b-902e-88875c6a18a4 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:46.232543 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e54dd5-8948-416f-9f40-6f4bba58a876 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:46.274260 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46869d68-7c52-4fa0-9e8d-d4924a295d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:46.274932 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46869d68-7c52-4fa0-9e8d-d4924a295d2f None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:46.275221 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46869d68-7c52-4fa0-9e8d-d4924a295d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:46.275502 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46869d68-7c52-4fa0-9e8d-d4924a295d2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:46.276576 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46869d68-7c52-4fa0-9e8d-d4924a295d2f None admin] RBAC: Adding query filter params (group.id=7af94451ae87418797e4a02fa0325f83, role.id=82747af757b549cbaa39504334f32f9f, scope.project.id=90e0b1babc6a4f59b9783fd69c68f2ce) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:46.276894 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46869d68-7c52-4fa0-9e8d-d4924a295d2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:46.278769 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46869d68-7c52-4fa0-9e8d-d4924a295d2f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:46.284970 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 185/378] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Mar 29 20:01:46 2022] GET /identity/v3/role_assignments?group.id=7af94451ae87418797e4a02fa0325f83&scope.project.id=90e0b1babc6a4f59b9783fd69c68f2ce&role.id=82747af757b549cbaa39504334f32f9f => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:46.313025 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e1250-6643-463b-902e-88875c6a18a4 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:46.351114 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed89ac-43d9-4853-bce7-49f7b7dc2972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:46.352348 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed89ac-43d9-4853-bce7-49f7b7dc2972 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:46.352827 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed89ac-43d9-4853-bce7-49f7b7dc2972 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:46.353333 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed89ac-43d9-4853-bce7-49f7b7dc2972 None admin] PATH_INFO: `/v3/groups/35c6500b4cda4a92a4a2a412986f1ee8` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:46.361339 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed89ac-43d9-4853-bce7-49f7b7dc2972 None admin] RBAC: Authorizing `identity:get_group(group_id=35c6500b4cda4a92a4a2a412986f1ee8)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:46.363277 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed89ac-43d9-4853-bce7-49f7b7dc2972 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:46.365209 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 194/379] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Mar 29 20:01:46 2022] GET /identity/v3/groups/35c6500b4cda4a92a4a2a412986f1ee8 => generated 229 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:01:46.373351 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46869d68-7c52-4fa0-9e8d-d4924a295d2f None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:46.497045 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46869d68-7c52-4fa0-9e8d-d4924a295d2f None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:46.538497 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0094f54-d765-4fc3-85db-f2ff35308fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:46.539169 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0094f54-d765-4fc3-85db-f2ff35308fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:46.539458 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0094f54-d765-4fc3-85db-f2ff35308fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:46.539898 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0094f54-d765-4fc3-85db-f2ff35308fa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:46.540742 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0094f54-d765-4fc3-85db-f2ff35308fa3 None admin] RBAC: Adding query filter params (group.id=35c6500b4cda4a92a4a2a412986f1ee8, role.id=8cfa924df1a1400986d9ecc9686a7f52, scope.project.id=a15fd3ff4f1b47218a3a97159af6b6bb) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:46.541063 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0094f54-d765-4fc3-85db-f2ff35308fa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:46.543238 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0094f54-d765-4fc3-85db-f2ff35308fa3 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:46.549657 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 186/380] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Mar 29 20:01:46 2022] GET /identity/v3/role_assignments?group.id=35c6500b4cda4a92a4a2a412986f1ee8&scope.project.id=a15fd3ff4f1b47218a3a97159af6b6bb&role.id=8cfa924df1a1400986d9ecc9686a7f52 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:46.661688 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2ef19-9b0e-4681-86c0-de30919f9a25 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:46.662217 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2ef19-9b0e-4681-86c0-de30919f9a25 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:46.662644 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2ef19-9b0e-4681-86c0-de30919f9a25 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:46.664808 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 195/381] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:46.671657 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dc78c-9e32-46b2-b982-f5797ced6faf None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:46.671957 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dc78c-9e32-46b2-b982-f5797ced6faf None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:46.672247 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dc78c-9e32-46b2-b982-f5797ced6faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:46.694817 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-aa4dc78c-9e32-46b2-b982-f5797ced6faf None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:46.696001 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-aa4dc78c-9e32-46b2-b982-f5797ced6faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:46.779335 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 187/382] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:46.803624 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2ef19-9b0e-4681-86c0-de30919f9a25 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:46.934301 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2ef19-9b0e-4681-86c0-de30919f9a25 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:46.972040 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bd388-7de9-4dfb-8da9-55dc5fae4014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:46.972848 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bd388-7de9-4dfb-8da9-55dc5fae4014 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:46.973131 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bd388-7de9-4dfb-8da9-55dc5fae4014 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:46.973463 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bd388-7de9-4dfb-8da9-55dc5fae4014 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:46.988572 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352bd388-7de9-4dfb-8da9-55dc5fae4014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:46.996501 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-352bd388-7de9-4dfb-8da9-55dc5fae4014 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 20:01:46.998120 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 196/383] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:47.003677 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dc78c-9e32-46b2-b982-f5797ced6faf None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:47.153612 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dc78c-9e32-46b2-b982-f5797ced6faf None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:47.205237 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdf553-a867-443f-8bd1-6aa5ac603023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:47.206278 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdf553-a867-443f-8bd1-6aa5ac603023 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:47.206770 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdf553-a867-443f-8bd1-6aa5ac603023 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:47.207236 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdf553-a867-443f-8bd1-6aa5ac603023 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:47.208188 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdf553-a867-443f-8bd1-6aa5ac603023 None admin] RBAC: Adding query filter params (name=member) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:47.208697 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdf553-a867-443f-8bd1-6aa5ac603023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:47.210294 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdf553-a867-443f-8bd1-6aa5ac603023 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:47.224792 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 188/384] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:47.232317 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bd388-7de9-4dfb-8da9-55dc5fae4014 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:47.341389 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bd388-7de9-4dfb-8da9-55dc5fae4014 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:47.379922 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec83429-42fc-4c89-b53c-9d945cbcd77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:47.381232 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec83429-42fc-4c89-b53c-9d945cbcd77e None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:47.394453 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec83429-42fc-4c89-b53c-9d945cbcd77e None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:47.394453 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec83429-42fc-4c89-b53c-9d945cbcd77e None admin] PATH_INFO: `/v3/groups/7af94451ae87418797e4a02fa0325f83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:47.394453 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec83429-42fc-4c89-b53c-9d945cbcd77e None admin] RBAC: Authorizing `identity:get_group(group_id=7af94451ae87418797e4a02fa0325f83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:47.394453 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec83429-42fc-4c89-b53c-9d945cbcd77e None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:47.394453 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 197/385] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Mar 29 20:01:47 2022] GET /identity/v3/groups/7af94451ae87418797e4a02fa0325f83 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:47.394820 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdf553-a867-443f-8bd1-6aa5ac603023 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:47.534680 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdf553-a867-443f-8bd1-6aa5ac603023 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:47.568708 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09434f-14be-4738-ac98-4b05e1160099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:47.569632 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09434f-14be-4738-ac98-4b05e1160099 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:47.569918 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09434f-14be-4738-ac98-4b05e1160099 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:47.570198 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09434f-14be-4738-ac98-4b05e1160099 None admin] PATH_INFO: `/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:47.571397 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09434f-14be-4738-ac98-4b05e1160099 None admin] RBAC: Authorizing `identity:get_project(project_id=fec2338df2a64a9a9b5d8a9b527bbf26)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:47.573249 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09434f-14be-4738-ac98-4b05e1160099 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:47.575191 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 189/386] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:47 2022] GET /identity/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:47.580745 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec83429-42fc-4c89-b53c-9d945cbcd77e None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:47.703556 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec83429-42fc-4c89-b53c-9d945cbcd77e None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:47.739671 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9ddf1-6971-4a48-b6f6-0854b1ad7761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:47.740563 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9ddf1-6971-4a48-b6f6-0854b1ad7761 None admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:47.740848 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9ddf1-6971-4a48-b6f6-0854b1ad7761 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:47.741123 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9ddf1-6971-4a48-b6f6-0854b1ad7761 None admin] PATH_INFO: `/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26/groups/7af94451ae87418797e4a02fa0325f83/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:47.743122 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9ddf1-6971-4a48-b6f6-0854b1ad7761 None admin] RBAC: Authorizing `identity:create_grant(project_id=fec2338df2a64a9a9b5d8a9b527bbf26, group_id=7af94451ae87418797e4a02fa0325f83, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:47.744833 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9ddf1-6971-4a48-b6f6-0854b1ad7761 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:47.819449 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 198/387] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Mar 29 20:01:47 2022] PUT /identity/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26/groups/7af94451ae87418797e4a02fa0325f83/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:01:48.228501 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a39a4-528a-41cb-94c1-3a7e845c5b59 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:48.230289 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a39a4-528a-41cb-94c1-3a7e845c5b59 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:48.230289 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a39a4-528a-41cb-94c1-3a7e845c5b59 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:48.232288 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 190/388] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:48.238036 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286beeca-4d62-499b-8464-c70c3512ceef None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:48.238492 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286beeca-4d62-499b-8464-c70c3512ceef None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:48.238683 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286beeca-4d62-499b-8464-c70c3512ceef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:48.256147 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-286beeca-4d62-499b-8464-c70c3512ceef None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:48.257726 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-286beeca-4d62-499b-8464-c70c3512ceef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:48.332654 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 199/389] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:48.355563 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a39a4-528a-41cb-94c1-3a7e845c5b59 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:48.495120 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a39a4-528a-41cb-94c1-3a7e845c5b59 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:48.540593 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526893d9-520a-4a6f-9197-12701f169d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:48.541563 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526893d9-520a-4a6f-9197-12701f169d0e None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:48.541851 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526893d9-520a-4a6f-9197-12701f169d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:48.542320 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526893d9-520a-4a6f-9197-12701f169d0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:48.558629 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526893d9-520a-4a6f-9197-12701f169d0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:48.566055 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-526893d9-520a-4a6f-9197-12701f169d0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 29 20:01:48.567275 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 191/390] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Mar 29 20:01:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:48.574094 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286beeca-4d62-499b-8464-c70c3512ceef None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:48.733509 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286beeca-4d62-499b-8464-c70c3512ceef None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:48.780424 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef919d58-50ec-421f-b7d0-acf93c3d6ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:48.781025 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef919d58-50ec-421f-b7d0-acf93c3d6ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:48.781389 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef919d58-50ec-421f-b7d0-acf93c3d6ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:48.781673 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef919d58-50ec-421f-b7d0-acf93c3d6ea9 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:48.782475 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef919d58-50ec-421f-b7d0-acf93c3d6ea9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:48.782790 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef919d58-50ec-421f-b7d0-acf93c3d6ea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:48.784165 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef919d58-50ec-421f-b7d0-acf93c3d6ea9 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:48.792821 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 200/391] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:01:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:48.798212 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526893d9-520a-4a6f-9197-12701f169d0e None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:48.974466 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526893d9-520a-4a6f-9197-12701f169d0e None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:49.013547 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd5435-8751-4f65-94db-77d2b38dc417 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:49.013882 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd5435-8751-4f65-94db-77d2b38dc417 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:49.014120 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd5435-8751-4f65-94db-77d2b38dc417 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:49.016242 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 201/392] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:49.021856 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f7984-126a-4eb2-b5eb-4546e8323c57 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:49.022243 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f0d3a-da51-4b31-a7a9-bb7b37e93408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:49.022464 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f7984-126a-4eb2-b5eb-4546e8323c57 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:49.022904 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f7984-126a-4eb2-b5eb-4546e8323c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:49.023720 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f0d3a-da51-4b31-a7a9-bb7b37e93408 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:49.024206 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f0d3a-da51-4b31-a7a9-bb7b37e93408 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:49.024680 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f0d3a-da51-4b31-a7a9-bb7b37e93408 None admin] PATH_INFO: `/v3/groups/7af94451ae87418797e4a02fa0325f83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:49.026943 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f0d3a-da51-4b31-a7a9-bb7b37e93408 None admin] RBAC: Authorizing `identity:get_group(group_id=7af94451ae87418797e4a02fa0325f83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:49.028665 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f0d3a-da51-4b31-a7a9-bb7b37e93408 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:49.030792 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 192/393] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Mar 29 20:01:48 2022] GET /identity/v3/groups/7af94451ae87418797e4a02fa0325f83 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:49.036256 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f0d3a-da51-4b31-a7a9-bb7b37e93408 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:49.050325 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-a82f7984-126a-4eb2-b5eb-4546e8323c57 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:49.051556 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a82f7984-126a-4eb2-b5eb-4546e8323c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:49.134416 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 202/394] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 20:01:49.159416 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f7984-126a-4eb2-b5eb-4546e8323c57 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:49.192698 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f0d3a-da51-4b31-a7a9-bb7b37e93408 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:49.264627 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9214e-8111-4596-933a-0e9ac6b2c881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:49.265589 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9214e-8111-4596-933a-0e9ac6b2c881 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:49.266036 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9214e-8111-4596-933a-0e9ac6b2c881 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:49.266472 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9214e-8111-4596-933a-0e9ac6b2c881 None admin] PATH_INFO: `/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:49.267898 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9214e-8111-4596-933a-0e9ac6b2c881 None admin] RBAC: Authorizing `identity:get_project(project_id=fec2338df2a64a9a9b5d8a9b527bbf26)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:49.269505 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9214e-8111-4596-933a-0e9ac6b2c881 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:49.276286 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 193/395] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:49 2022] GET /identity/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:01:49.277725 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9214e-8111-4596-933a-0e9ac6b2c881 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:49.340966 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f7984-126a-4eb2-b5eb-4546e8323c57 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:49.386649 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9214e-8111-4596-933a-0e9ac6b2c881 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:49.422139 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7c104-0e20-4384-8b12-dda85889b1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:49.423446 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7c104-0e20-4384-8b12-dda85889b1f2 None admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:49.423941 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7c104-0e20-4384-8b12-dda85889b1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:49.424466 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7c104-0e20-4384-8b12-dda85889b1f2 None admin] PATH_INFO: `/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26/groups/7af94451ae87418797e4a02fa0325f83/roles/82747af757b549cbaa39504334f32f9f` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:49.425483 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f4f33-55b6-41d9-badb-1d5aaf0cd6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:49.426288 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f4f33-55b6-41d9-badb-1d5aaf0cd6e3 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:49.426574 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f4f33-55b6-41d9-badb-1d5aaf0cd6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:49.426869 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f4f33-55b6-41d9-badb-1d5aaf0cd6e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:49.427702 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7c104-0e20-4384-8b12-dda85889b1f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=fec2338df2a64a9a9b5d8a9b527bbf26, group_id=7af94451ae87418797e4a02fa0325f83, role_id=82747af757b549cbaa39504334f32f9f)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:49.429389 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7c104-0e20-4384-8b12-dda85889b1f2 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:49.444521 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f4f33-55b6-41d9-badb-1d5aaf0cd6e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:49.452988 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-cb0f4f33-55b6-41d9-badb-1d5aaf0cd6e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 20:01:49.459360 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 203/396] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:01:49.460669 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f4f33-55b6-41d9-badb-1d5aaf0cd6e3 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:49.501722 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 194/397] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Mar 29 20:01:49 2022] PUT /identity/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26/groups/7af94451ae87418797e4a02fa0325f83/roles/82747af757b549cbaa39504334f32f9f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:01:49.563070 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86117f6-80de-4846-a9bf-e0ea1d6cc7bf None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:49.563626 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86117f6-80de-4846-a9bf-e0ea1d6cc7bf None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:49.564052 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86117f6-80de-4846-a9bf-e0ea1d6cc7bf None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:49.566292 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 195/398] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:49.574009 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b2232-7c1d-46cf-8410-3acc9d8db830 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:49.574500 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b2232-7c1d-46cf-8410-3acc9d8db830 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:49.574952 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b2232-7c1d-46cf-8410-3acc9d8db830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:49.607441 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-8e8b2232-7c1d-46cf-8410-3acc9d8db830 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:49.608738 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-8e8b2232-7c1d-46cf-8410-3acc9d8db830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:49.613666 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f4f33-55b6-41d9-badb-1d5aaf0cd6e3 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:49.656152 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1878fe-a6ee-472f-8d7c-ebd93f91f784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:49.657118 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1878fe-a6ee-472f-8d7c-ebd93f91f784 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:49.657578 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1878fe-a6ee-472f-8d7c-ebd93f91f784 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:49.657997 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1878fe-a6ee-472f-8d7c-ebd93f91f784 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:49.658912 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1878fe-a6ee-472f-8d7c-ebd93f91f784 None admin] RBAC: Adding query filter params (name=member) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:49.659381 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1878fe-a6ee-472f-8d7c-ebd93f91f784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:49.661046 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1878fe-a6ee-472f-8d7c-ebd93f91f784 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:49.675819 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 204/399] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:49.677646 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1878fe-a6ee-472f-8d7c-ebd93f91f784 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:49.771664 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 196/400] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 20:01:49.793617 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1878fe-a6ee-472f-8d7c-ebd93f91f784 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:49.797801 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b2232-7c1d-46cf-8410-3acc9d8db830 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:49.832582 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac8c12-6f6a-4825-9b5d-4a3f4bedf863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:49.833472 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac8c12-6f6a-4825-9b5d-4a3f4bedf863 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:49.833752 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac8c12-6f6a-4825-9b5d-4a3f4bedf863 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:49.834027 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac8c12-6f6a-4825-9b5d-4a3f4bedf863 None admin] PATH_INFO: `/v3/groups/7af94451ae87418797e4a02fa0325f83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:49.835205 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac8c12-6f6a-4825-9b5d-4a3f4bedf863 None admin] RBAC: Authorizing `identity:get_group(group_id=7af94451ae87418797e4a02fa0325f83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:49.836643 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac8c12-6f6a-4825-9b5d-4a3f4bedf863 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:49.841484 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 205/401] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Mar 29 20:01:49 2022] GET /identity/v3/groups/7af94451ae87418797e4a02fa0325f83 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:01:49.841484 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd165f61-2d1c-4482-999e-32e1e77906e1 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:49.841484 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd165f61-2d1c-4482-999e-32e1e77906e1 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:49.841484 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd165f61-2d1c-4482-999e-32e1e77906e1 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:49.843571 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 206/402] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:49.848517 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd165f61-2d1c-4482-999e-32e1e77906e1 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:49.913970 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b2232-7c1d-46cf-8410-3acc9d8db830 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:49.960303 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd165f61-2d1c-4482-999e-32e1e77906e1 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:49.960608 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64ef0b-ea92-4370-a4cc-c92e9eff333e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:49.961401 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64ef0b-ea92-4370-a4cc-c92e9eff333e None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:49.961685 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64ef0b-ea92-4370-a4cc-c92e9eff333e None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:49.961957 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64ef0b-ea92-4370-a4cc-c92e9eff333e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:49.972617 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64ef0b-ea92-4370-a4cc-c92e9eff333e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:49.980144 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-ea64ef0b-ea92-4370-a4cc-c92e9eff333e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:01:49.986149 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 197/403] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:01:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:01:49.987442 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d729f44-63a3-49e1-ae93-46bdd4ad639b None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:49.987734 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d729f44-63a3-49e1-ae93-46bdd4ad639b None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:49.988012 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d729f44-63a3-49e1-ae93-46bdd4ad639b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:50.000867 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe422e8c-3667-46d4-8646-ebca08b6bb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:50.002276 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe422e8c-3667-46d4-8646-ebca08b6bb11 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:50.002813 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe422e8c-3667-46d4-8646-ebca08b6bb11 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:50.003356 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe422e8c-3667-46d4-8646-ebca08b6bb11 None admin] PATH_INFO: `/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:50.004896 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe422e8c-3667-46d4-8646-ebca08b6bb11 None admin] RBAC: Authorizing `identity:get_project(project_id=90e0b1babc6a4f59b9783fd69c68f2ce)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:50.005625 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-0d729f44-63a3-49e1-ae93-46bdd4ad639b None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:50.006796 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-0d729f44-63a3-49e1-ae93-46bdd4ad639b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:50.007154 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe422e8c-3667-46d4-8646-ebca08b6bb11 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:50.009495 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 207/404] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:49 2022] GET /identity/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:50.012391 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe422e8c-3667-46d4-8646-ebca08b6bb11 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:50.089317 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 198/405] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:50.089317 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d729f44-63a3-49e1-ae93-46bdd4ad639b None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:50.139406 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe422e8c-3667-46d4-8646-ebca08b6bb11 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:50.175317 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e766c-2986-46ff-8849-28f4e7272cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:50.176366 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e766c-2986-46ff-8849-28f4e7272cda None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:50.176910 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e766c-2986-46ff-8849-28f4e7272cda None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:50.177434 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e766c-2986-46ff-8849-28f4e7272cda None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:50.178376 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e766c-2986-46ff-8849-28f4e7272cda None admin] RBAC: Adding query filter params (name=admin) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:50.178897 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e766c-2986-46ff-8849-28f4e7272cda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:50.179971 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d729f44-63a3-49e1-ae93-46bdd4ad639b None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:50.180716 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e766c-2986-46ff-8849-28f4e7272cda None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:50.189884 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 208/406] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:50.191077 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e766c-2986-46ff-8849-28f4e7272cda None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:50.220850 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f5450-3037-45bf-91d8-a69ac7f2a8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:50.221796 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f5450-3037-45bf-91d8-a69ac7f2a8fe None admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:50.222076 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f5450-3037-45bf-91d8-a69ac7f2a8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:50.222367 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f5450-3037-45bf-91d8-a69ac7f2a8fe None admin] PATH_INFO: `/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce/groups/7af94451ae87418797e4a02fa0325f83/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:50.224534 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f5450-3037-45bf-91d8-a69ac7f2a8fe None admin] RBAC: Authorizing `identity:create_grant(project_id=90e0b1babc6a4f59b9783fd69c68f2ce, group_id=7af94451ae87418797e4a02fa0325f83, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:50.225951 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f5450-3037-45bf-91d8-a69ac7f2a8fe None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:50.298087 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e766c-2986-46ff-8849-28f4e7272cda None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:50.325328 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 199/407] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Mar 29 20:01:50 2022] PUT /identity/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce/groups/7af94451ae87418797e4a02fa0325f83/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:01:50.329475 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f5450-3037-45bf-91d8-a69ac7f2a8fe None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:50.349042 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc25f4-4793-4414-bbe8-3835cf41994e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:50.349906 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc25f4-4793-4414-bbe8-3835cf41994e None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:50.350189 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc25f4-4793-4414-bbe8-3835cf41994e None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:50.350467 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc25f4-4793-4414-bbe8-3835cf41994e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:50.373225 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc25f4-4793-4414-bbe8-3835cf41994e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:50.386768 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-20bc25f4-4793-4414-bbe8-3835cf41994e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 29 20:01:50.394269 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 209/408] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Mar 29 20:01:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:50.395847 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc25f4-4793-4414-bbe8-3835cf41994e None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:50.489782 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f5450-3037-45bf-91d8-a69ac7f2a8fe None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:50.545553 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95eddf-9781-4fa6-952c-7d59cd9926f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:50.546783 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95eddf-9781-4fa6-952c-7d59cd9926f1 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:50.547287 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95eddf-9781-4fa6-952c-7d59cd9926f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:50.547739 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95eddf-9781-4fa6-952c-7d59cd9926f1 None admin] PATH_INFO: `/v3/groups/35c6500b4cda4a92a4a2a412986f1ee8` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:50.549116 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95eddf-9781-4fa6-952c-7d59cd9926f1 None admin] RBAC: Authorizing `identity:get_group(group_id=35c6500b4cda4a92a4a2a412986f1ee8)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:50.550733 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95eddf-9781-4fa6-952c-7d59cd9926f1 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:50.561344 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 200/409] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Mar 29 20:01:50 2022] GET /identity/v3/groups/35c6500b4cda4a92a4a2a412986f1ee8 => generated 229 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:50.562674 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95eddf-9781-4fa6-952c-7d59cd9926f1 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:50.564024 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc25f4-4793-4414-bbe8-3835cf41994e None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:50.606635 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59928830-166b-4b04-b794-ac2779216cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:50.607319 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59928830-166b-4b04-b794-ac2779216cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:50.607606 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59928830-166b-4b04-b794-ac2779216cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:50.607888 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59928830-166b-4b04-b794-ac2779216cf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:50.608646 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59928830-166b-4b04-b794-ac2779216cf9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:50.608957 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59928830-166b-4b04-b794-ac2779216cf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:50.610419 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59928830-166b-4b04-b794-ac2779216cf9 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:50.622382 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 210/410] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:01:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:50.622382 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6871a0-cd1f-45d4-b500-815e7fa87bc3 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:50.622382 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6871a0-cd1f-45d4-b500-815e7fa87bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:50.622710 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6871a0-cd1f-45d4-b500-815e7fa87bc3 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:50.624425 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 211/411] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:50.628993 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6871a0-cd1f-45d4-b500-815e7fa87bc3 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:50.695124 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95eddf-9781-4fa6-952c-7d59cd9926f1 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:50.731521 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e74c60-ee01-471c-ae43-5e372fe0a66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:50.732792 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e74c60-ee01-471c-ae43-5e372fe0a66b None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:50.733268 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e74c60-ee01-471c-ae43-5e372fe0a66b None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:50.733793 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e74c60-ee01-471c-ae43-5e372fe0a66b None admin] PATH_INFO: `/v3/projects/a15fd3ff4f1b47218a3a97159af6b6bb` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:50.735189 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e74c60-ee01-471c-ae43-5e372fe0a66b None admin] RBAC: Authorizing `identity:get_project(project_id=a15fd3ff4f1b47218a3a97159af6b6bb)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:50.736850 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e74c60-ee01-471c-ae43-5e372fe0a66b None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:50.738851 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 201/412] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:50 2022] GET /identity/v3/projects/a15fd3ff4f1b47218a3a97159af6b6bb => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:50.740327 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fff503-22a2-4f5c-84b3-118dfcb8ca2a None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:50.740818 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fff503-22a2-4f5c-84b3-118dfcb8ca2a None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:50.741385 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fff503-22a2-4f5c-84b3-118dfcb8ca2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:50.758871 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-a9fff503-22a2-4f5c-84b3-118dfcb8ca2a None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:50.759047 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6871a0-cd1f-45d4-b500-815e7fa87bc3 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:50.761451 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-a9fff503-22a2-4f5c-84b3-118dfcb8ca2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:50.800894 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7268e7-ed44-4fee-9a0c-d2b6a33be32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:50.802016 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7268e7-ed44-4fee-9a0c-d2b6a33be32b None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:50.803262 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7268e7-ed44-4fee-9a0c-d2b6a33be32b None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:50.803551 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7268e7-ed44-4fee-9a0c-d2b6a33be32b None admin] PATH_INFO: `/v3/groups/7af94451ae87418797e4a02fa0325f83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:50.804907 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7268e7-ed44-4fee-9a0c-d2b6a33be32b None admin] RBAC: Authorizing `identity:get_group(group_id=7af94451ae87418797e4a02fa0325f83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:50.806499 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7268e7-ed44-4fee-9a0c-d2b6a33be32b None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:50.809010 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 212/413] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Mar 29 20:01:50 2022] GET /identity/v3/groups/7af94451ae87418797e4a02fa0325f83 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:50.809750 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7268e7-ed44-4fee-9a0c-d2b6a33be32b None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:50.845337 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 202/414] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:50.846400 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fff503-22a2-4f5c-84b3-118dfcb8ca2a None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:50.923952 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7268e7-ed44-4fee-9a0c-d2b6a33be32b None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:50.965185 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6e986-e9e8-432e-a65d-4933435af34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:50.966428 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6e986-e9e8-432e-a65d-4933435af34a None admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:50.966804 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6e986-e9e8-432e-a65d-4933435af34a None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:50.967155 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6e986-e9e8-432e-a65d-4933435af34a None admin] PATH_INFO: `/v3/projects/a15fd3ff4f1b47218a3a97159af6b6bb/groups/35c6500b4cda4a92a4a2a412986f1ee8/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:50.970029 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb6e986-e9e8-432e-a65d-4933435af34a None admin] RBAC: Authorizing `identity:create_grant(project_id=a15fd3ff4f1b47218a3a97159af6b6bb, group_id=35c6500b4cda4a92a4a2a412986f1ee8, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:50.971602 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb6e986-e9e8-432e-a65d-4933435af34a None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:50.972111 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fff503-22a2-4f5c-84b3-118dfcb8ca2a None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:51.006923 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009950b7-9007-42ae-b793-c9ca18e24c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:51.008042 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009950b7-9007-42ae-b793-c9ca18e24c61 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:51.008466 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009950b7-9007-42ae-b793-c9ca18e24c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:51.008918 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009950b7-9007-42ae-b793-c9ca18e24c61 None admin] PATH_INFO: `/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:51.010899 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009950b7-9007-42ae-b793-c9ca18e24c61 None admin] RBAC: Authorizing `identity:get_project(project_id=90e0b1babc6a4f59b9783fd69c68f2ce)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:51.012506 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009950b7-9007-42ae-b793-c9ca18e24c61 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:51.014863 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 203/415] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:50 2022] GET /identity/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:51.015740 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009950b7-9007-42ae-b793-c9ca18e24c61 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:51.071572 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 213/416] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Mar 29 20:01:50 2022] PUT /identity/v3/projects/a15fd3ff4f1b47218a3a97159af6b6bb/groups/35c6500b4cda4a92a4a2a412986f1ee8/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:01:51.072714 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6e986-e9e8-432e-a65d-4933435af34a None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:51.199377 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009950b7-9007-42ae-b793-c9ca18e24c61 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:51.273029 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479046ee-3c6b-4fa6-9dff-8f25fa706087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:51.274108 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479046ee-3c6b-4fa6-9dff-8f25fa706087 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:51.277075 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479046ee-3c6b-4fa6-9dff-8f25fa706087 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:51.277552 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479046ee-3c6b-4fa6-9dff-8f25fa706087 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:51.292365 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6e986-e9e8-432e-a65d-4933435af34a None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:51.300256 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479046ee-3c6b-4fa6-9dff-8f25fa706087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:51.308249 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-479046ee-3c6b-4fa6-9dff-8f25fa706087 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 20:01:51.309846 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 204/417] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:51.315607 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479046ee-3c6b-4fa6-9dff-8f25fa706087 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:51.328093 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8291e-1784-482e-bbd0-608a0a07e7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:51.329278 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8291e-1784-482e-bbd0-608a0a07e7b6 None admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:51.329785 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8291e-1784-482e-bbd0-608a0a07e7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:51.330241 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8291e-1784-482e-bbd0-608a0a07e7b6 None admin] PATH_INFO: `/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce/groups/7af94451ae87418797e4a02fa0325f83/roles/82747af757b549cbaa39504334f32f9f` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:51.332639 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa8291e-1784-482e-bbd0-608a0a07e7b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=90e0b1babc6a4f59b9783fd69c68f2ce, group_id=7af94451ae87418797e4a02fa0325f83, role_id=82747af757b549cbaa39504334f32f9f)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:51.334298 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa8291e-1784-482e-bbd0-608a0a07e7b6 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:51.410580 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 214/418] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Mar 29 20:01:51 2022] PUT /identity/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce/groups/7af94451ae87418797e4a02fa0325f83/roles/82747af757b549cbaa39504334f32f9f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:01:51.431456 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479046ee-3c6b-4fa6-9dff-8f25fa706087 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:51.469025 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd1289-6962-47e8-8a70-b64199a4d608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:51.469738 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd1289-6962-47e8-8a70-b64199a4d608 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:51.470069 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd1289-6962-47e8-8a70-b64199a4d608 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:51.470349 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd1289-6962-47e8-8a70-b64199a4d608 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:51.471153 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd1289-6962-47e8-8a70-b64199a4d608 None admin] RBAC: Adding query filter params (name=member) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:51.471465 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd1289-6962-47e8-8a70-b64199a4d608 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:51.472894 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd1289-6962-47e8-8a70-b64199a4d608 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:51.483221 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 205/419] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:01:51.488830 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8291e-1784-482e-bbd0-608a0a07e7b6 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:51.596440 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8291e-1784-482e-bbd0-608a0a07e7b6 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:51.632984 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3878d-1ca0-45aa-8370-c9d877298ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:51.633672 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3878d-1ca0-45aa-8370-c9d877298ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:51.633953 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3878d-1ca0-45aa-8370-c9d877298ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:51.634228 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3878d-1ca0-45aa-8370-c9d877298ba9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:51.712587 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3878d-1ca0-45aa-8370-c9d877298ba9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:51.714825 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3878d-1ca0-45aa-8370-c9d877298ba9 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:51.818731 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 215/420] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:01:51.825417 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd1289-6962-47e8-8a70-b64199a4d608 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:51.965042 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd1289-6962-47e8-8a70-b64199a4d608 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:52.006988 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644a448-9756-45fc-800c-80c689fbfcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:52.007861 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644a448-9756-45fc-800c-80c689fbfcce None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:52.008140 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644a448-9756-45fc-800c-80c689fbfcce None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:52.008415 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644a448-9756-45fc-800c-80c689fbfcce None admin] PATH_INFO: `/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:52.009658 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644a448-9756-45fc-800c-80c689fbfcce None admin] RBAC: Authorizing `identity:get_project(project_id=fec2338df2a64a9a9b5d8a9b527bbf26)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:52.011339 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644a448-9756-45fc-800c-80c689fbfcce None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:52.013343 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 206/421] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:51 2022] GET /identity/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:52.018759 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3878d-1ca0-45aa-8370-c9d877298ba9 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:52.120201 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3878d-1ca0-45aa-8370-c9d877298ba9 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:52.154358 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73426e1b-b0b1-499c-9a8e-b385ec8abb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:52.155211 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73426e1b-b0b1-499c-9a8e-b385ec8abb4d None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:52.155490 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73426e1b-b0b1-499c-9a8e-b385ec8abb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:52.155855 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73426e1b-b0b1-499c-9a8e-b385ec8abb4d None admin] PATH_INFO: `/v3/groups/7af94451ae87418797e4a02fa0325f83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:52.157064 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73426e1b-b0b1-499c-9a8e-b385ec8abb4d None admin] RBAC: Authorizing `identity:get_group(group_id=7af94451ae87418797e4a02fa0325f83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:52.158570 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73426e1b-b0b1-499c-9a8e-b385ec8abb4d None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:52.160457 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 216/422] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Mar 29 20:01:52 2022] GET /identity/v3/groups/7af94451ae87418797e4a02fa0325f83 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:52.166341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644a448-9756-45fc-800c-80c689fbfcce None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:52.274421 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a17c2-6253-4906-8146-a07a461d4a2f None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:52.274749 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a17c2-6253-4906-8146-a07a461d4a2f None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:52.274976 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a17c2-6253-4906-8146-a07a461d4a2f None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:52.277265 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 217/423] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:01:52.282645 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d9740-7add-406d-9ee6-b16c6ba8a4b4 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:52.282940 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d9740-7add-406d-9ee6-b16c6ba8a4b4 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:52.283226 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d9740-7add-406d-9ee6-b16c6ba8a4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:52.286987 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644a448-9756-45fc-800c-80c689fbfcce None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:52.310248 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-743d9740-7add-406d-9ee6-b16c6ba8a4b4 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:52.311694 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-743d9740-7add-406d-9ee6-b16c6ba8a4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:52.355313 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae7900-73e0-4237-acb9-b6ea5e688c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:52.355985 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae7900-73e0-4237-acb9-b6ea5e688c6a None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:52.356275 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae7900-73e0-4237-acb9-b6ea5e688c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:52.356557 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae7900-73e0-4237-acb9-b6ea5e688c6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:52.357425 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae7900-73e0-4237-acb9-b6ea5e688c6a None admin] RBAC: Adding query filter params (group.id=7af94451ae87418797e4a02fa0325f83, role.id=e49df2a8408b4f5fa7e284575007ce83, scope.project.id=fec2338df2a64a9a9b5d8a9b527bbf26) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:52.357746 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae7900-73e0-4237-acb9-b6ea5e688c6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:52.359178 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae7900-73e0-4237-acb9-b6ea5e688c6a None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:52.377319 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 207/424] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Mar 29 20:01:52 2022] GET /identity/v3/role_assignments?group.id=7af94451ae87418797e4a02fa0325f83&scope.project.id=fec2338df2a64a9a9b5d8a9b527bbf26&role.id=e49df2a8408b4f5fa7e284575007ce83 => generated 611 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:52.388123 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 218/425] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:52.426893 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae7900-73e0-4237-acb9-b6ea5e688c6a None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:52.569387 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae7900-73e0-4237-acb9-b6ea5e688c6a None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:52.604553 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a37c47-4774-411e-be97-7ce2c99fd62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:52.605578 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a37c47-4774-411e-be97-7ce2c99fd62b None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:52.605875 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a37c47-4774-411e-be97-7ce2c99fd62b None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:52.606159 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a37c47-4774-411e-be97-7ce2c99fd62b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:52.618590 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a37c47-4774-411e-be97-7ce2c99fd62b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:52.626757 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-76a37c47-4774-411e-be97-7ce2c99fd62b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 29 20:01:52.628304 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 208/426] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Mar 29 20:01:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:52.633984 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d9740-7add-406d-9ee6-b16c6ba8a4b4 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:52.755889 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d9740-7add-406d-9ee6-b16c6ba8a4b4 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:52.795530 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b5b6e-8347-4c51-812f-6dbd48953ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:52.796469 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b5b6e-8347-4c51-812f-6dbd48953ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:52.796965 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b5b6e-8347-4c51-812f-6dbd48953ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:52.797435 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b5b6e-8347-4c51-812f-6dbd48953ad8 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:52.798317 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b5b6e-8347-4c51-812f-6dbd48953ad8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:52.798793 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b5b6e-8347-4c51-812f-6dbd48953ad8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:52.800286 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b5b6e-8347-4c51-812f-6dbd48953ad8 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:52.809679 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 219/427] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:01:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:52.815036 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a37c47-4774-411e-be97-7ce2c99fd62b None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:52.943126 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a37c47-4774-411e-be97-7ce2c99fd62b None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:52.983325 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e56a5-5156-4e3c-8497-4f7fda17afb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:52.983985 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e56a5-5156-4e3c-8497-4f7fda17afb9 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:52.984271 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e56a5-5156-4e3c-8497-4f7fda17afb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:52.984554 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e56a5-5156-4e3c-8497-4f7fda17afb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:53.062170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e56a5-5156-4e3c-8497-4f7fda17afb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:53.063623 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e56a5-5156-4e3c-8497-4f7fda17afb9 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:53.146865 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7c77d-e7bc-4e9f-9eb7-b25913ee9d6c None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:53.147181 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7c77d-e7bc-4e9f-9eb7-b25913ee9d6c None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:53.147447 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7c77d-e7bc-4e9f-9eb7-b25913ee9d6c None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:53.149509 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 220/428] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:53.159038 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffd4b4-09bc-4a15-90c6-3a5c549be930 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:53.159369 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffd4b4-09bc-4a15-90c6-3a5c549be930 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:53.159600 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffd4b4-09bc-4a15-90c6-3a5c549be930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:53.168520 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 209/429] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:01:53.174179 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e56a5-5156-4e3c-8497-4f7fda17afb9 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:53.189088 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-ecffd4b4-09bc-4a15-90c6-3a5c549be930 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:53.190680 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-ecffd4b4-09bc-4a15-90c6-3a5c549be930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:53.263806 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 221/430] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:53.275106 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e56a5-5156-4e3c-8497-4f7fda17afb9 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:53.288737 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffd4b4-09bc-4a15-90c6-3a5c549be930 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:53.310774 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63234b-17de-4e2c-b827-d29241f92735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:53.311711 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63234b-17de-4e2c-b827-d29241f92735 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:53.311920 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63234b-17de-4e2c-b827-d29241f92735 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:53.312200 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63234b-17de-4e2c-b827-d29241f92735 None admin] PATH_INFO: `/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:53.313431 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63234b-17de-4e2c-b827-d29241f92735 None admin] RBAC: Authorizing `identity:get_project(project_id=fec2338df2a64a9a9b5d8a9b527bbf26)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:53.314887 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63234b-17de-4e2c-b827-d29241f92735 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:53.316893 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 210/431] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:53 2022] GET /identity/v3/projects/fec2338df2a64a9a9b5d8a9b527bbf26 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:01:53.324163 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63234b-17de-4e2c-b827-d29241f92735 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:53.423714 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffd4b4-09bc-4a15-90c6-3a5c549be930 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:53.443299 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63234b-17de-4e2c-b827-d29241f92735 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:53.469219 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170444d-c0d3-4bff-b2d4-42c165758c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:53.470438 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170444d-c0d3-4bff-b2d4-42c165758c31 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:53.470872 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170444d-c0d3-4bff-b2d4-42c165758c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:53.471608 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170444d-c0d3-4bff-b2d4-42c165758c31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:53.479553 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84c7e8-565c-454b-b825-e9ed414c89e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:53.480675 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84c7e8-565c-454b-b825-e9ed414c89e6 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:53.481159 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84c7e8-565c-454b-b825-e9ed414c89e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:53.481669 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84c7e8-565c-454b-b825-e9ed414c89e6 None admin] PATH_INFO: `/v3/groups/7af94451ae87418797e4a02fa0325f83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:53.483080 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84c7e8-565c-454b-b825-e9ed414c89e6 None admin] RBAC: Authorizing `identity:get_group(group_id=7af94451ae87418797e4a02fa0325f83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:53.483857 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d170444d-c0d3-4bff-b2d4-42c165758c31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:53.485007 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84c7e8-565c-454b-b825-e9ed414c89e6 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:53.487170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 211/432] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Mar 29 20:01:53 2022] GET /identity/v3/groups/7af94451ae87418797e4a02fa0325f83 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:53.491091 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-d170444d-c0d3-4bff-b2d4-42c165758c31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 20:01:53.492544 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84c7e8-565c-454b-b825-e9ed414c89e6 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:53.492858 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 222/433] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:01:53.498972 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170444d-c0d3-4bff-b2d4-42c165758c31 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:53.603643 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170444d-c0d3-4bff-b2d4-42c165758c31 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:53.625199 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84c7e8-565c-454b-b825-e9ed414c89e6 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:53.643641 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c1a58-5e29-4749-8cb7-4189a8d5055e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:53.645025 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c1a58-5e29-4749-8cb7-4189a8d5055e None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:53.645637 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c1a58-5e29-4749-8cb7-4189a8d5055e None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:53.646071 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c1a58-5e29-4749-8cb7-4189a8d5055e None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:53.647267 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c1a58-5e29-4749-8cb7-4189a8d5055e None admin] RBAC: Adding query filter params (name=member) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:53.647733 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c1a58-5e29-4749-8cb7-4189a8d5055e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:53.649279 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c1a58-5e29-4749-8cb7-4189a8d5055e None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:53.662281 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 223/434] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:01:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:53.664199 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1cefb-3a4c-4d99-b88e-6991c40d3a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:53.665082 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1cefb-3a4c-4d99-b88e-6991c40d3a74 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:53.665608 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1cefb-3a4c-4d99-b88e-6991c40d3a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:53.666264 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1cefb-3a4c-4d99-b88e-6991c40d3a74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:53.667621 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c1a58-5e29-4749-8cb7-4189a8d5055e None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:53.668580 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1cefb-3a4c-4d99-b88e-6991c40d3a74 None admin] RBAC: Adding query filter params (group.id=7af94451ae87418797e4a02fa0325f83, role.id=82747af757b549cbaa39504334f32f9f, scope.project.id=fec2338df2a64a9a9b5d8a9b527bbf26) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:53.668900 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1cefb-3a4c-4d99-b88e-6991c40d3a74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:53.670367 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1cefb-3a4c-4d99-b88e-6991c40d3a74 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:53.677893 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 212/435] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Mar 29 20:01:53 2022] GET /identity/v3/role_assignments?group.id=7af94451ae87418797e4a02fa0325f83&scope.project.id=fec2338df2a64a9a9b5d8a9b527bbf26&role.id=82747af757b549cbaa39504334f32f9f => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:53.793803 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c1a58-5e29-4749-8cb7-4189a8d5055e None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:53.832425 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313fb6d-7f33-4f3c-b51e-d3f7936f695f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:53.833421 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313fb6d-7f33-4f3c-b51e-d3f7936f695f None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:53.833874 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313fb6d-7f33-4f3c-b51e-d3f7936f695f None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:53.834291 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313fb6d-7f33-4f3c-b51e-d3f7936f695f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:53.909439 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313fb6d-7f33-4f3c-b51e-d3f7936f695f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:53.911133 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313fb6d-7f33-4f3c-b51e-d3f7936f695f None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:53.959701 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a9afa-7e45-4933-9f58-5553ef2c35fb None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:53.960034 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a9afa-7e45-4933-9f58-5553ef2c35fb None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:53.960278 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a9afa-7e45-4933-9f58-5553ef2c35fb None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:53.962126 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 213/436] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:53.967454 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913daeb-99bb-4600-9c02-84f8ef6b83ca None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:53.967754 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913daeb-99bb-4600-9c02-84f8ef6b83ca None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:53.968039 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913daeb-99bb-4600-9c02-84f8ef6b83ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:53.986819 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-f913daeb-99bb-4600-9c02-84f8ef6b83ca None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:53.988045 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-f913daeb-99bb-4600-9c02-84f8ef6b83ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:54.028156 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 224/437] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 29 20:01:54.034145 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313fb6d-7f33-4f3c-b51e-d3f7936f695f None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:54.077404 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 214/438] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 20:01:54.096963 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913daeb-99bb-4600-9c02-84f8ef6b83ca None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:54.160607 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313fb6d-7f33-4f3c-b51e-d3f7936f695f None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:54.194067 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c59a6-77fb-44c8-b3ad-e474a8caecbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:54.194919 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c59a6-77fb-44c8-b3ad-e474a8caecbf None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:54.195197 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c59a6-77fb-44c8-b3ad-e474a8caecbf None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:54.195468 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c59a6-77fb-44c8-b3ad-e474a8caecbf None admin] PATH_INFO: `/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:54.196617 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c59a6-77fb-44c8-b3ad-e474a8caecbf None admin] RBAC: Authorizing `identity:get_project(project_id=90e0b1babc6a4f59b9783fd69c68f2ce)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:54.198918 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c59a6-77fb-44c8-b3ad-e474a8caecbf None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:54.200576 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 225/439] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:54 2022] GET /identity/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:01:54.201825 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6d475-e12a-45ea-b6ab-8a0eceb098c1 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:54.202123 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6d475-e12a-45ea-b6ab-8a0eceb098c1 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:54.202397 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6d475-e12a-45ea-b6ab-8a0eceb098c1 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:54.204160 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 226/440] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:54.204964 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913daeb-99bb-4600-9c02-84f8ef6b83ca None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:54.206352 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6d475-e12a-45ea-b6ab-8a0eceb098c1 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:54.238593 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55813c8-8152-4b16-a1c8-3db0d92de9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:54.239381 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55813c8-8152-4b16-a1c8-3db0d92de9be None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:54.239666 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55813c8-8152-4b16-a1c8-3db0d92de9be None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:54.239944 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55813c8-8152-4b16-a1c8-3db0d92de9be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:54.249758 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55813c8-8152-4b16-a1c8-3db0d92de9be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:54.256640 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-c55813c8-8152-4b16-a1c8-3db0d92de9be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:01:54.257831 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 215/441] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:01:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:01:54.258983 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c24a8-497d-4c40-9dbc-4b7a66de20b6 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:54.259277 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c24a8-497d-4c40-9dbc-4b7a66de20b6 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:54.259561 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c24a8-497d-4c40-9dbc-4b7a66de20b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:54.276066 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-e18c24a8-497d-4c40-9dbc-4b7a66de20b6 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:54.277334 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-e18c24a8-497d-4c40-9dbc-4b7a66de20b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:54.303504 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6d475-e12a-45ea-b6ab-8a0eceb098c1 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:54.335314 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a10f7-5583-432f-9d3c-58786b6c9577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:54.336096 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a10f7-5583-432f-9d3c-58786b6c9577 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:54.336378 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a10f7-5583-432f-9d3c-58786b6c9577 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:54.336652 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a10f7-5583-432f-9d3c-58786b6c9577 None admin] PATH_INFO: `/v3/groups/7af94451ae87418797e4a02fa0325f83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:54.338418 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a10f7-5583-432f-9d3c-58786b6c9577 None admin] RBAC: Authorizing `identity:get_group(group_id=7af94451ae87418797e4a02fa0325f83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:54.339960 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a10f7-5583-432f-9d3c-58786b6c9577 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:54.340577 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 216/442] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:54.341428 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c24a8-497d-4c40-9dbc-4b7a66de20b6 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:54.341883 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 227/443] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Mar 29 20:01:54 2022] GET /identity/v3/groups/7af94451ae87418797e4a02fa0325f83 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:01:54.348282 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a10f7-5583-432f-9d3c-58786b6c9577 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:54.441699 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c24a8-497d-4c40-9dbc-4b7a66de20b6 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:54.444353 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a10f7-5583-432f-9d3c-58786b6c9577 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:54.473437 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf2a1d-c30d-4f92-969c-12f90593a6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:54.474097 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf2a1d-c30d-4f92-969c-12f90593a6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:54.474383 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf2a1d-c30d-4f92-969c-12f90593a6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:54.474661 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf2a1d-c30d-4f92-969c-12f90593a6a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:54.475400 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf2a1d-c30d-4f92-969c-12f90593a6a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:54.475706 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf2a1d-c30d-4f92-969c-12f90593a6a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:54.476004 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b4509-44f3-4e24-9b1b-5cd2148a7656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:54.476644 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b4509-44f3-4e24-9b1b-5cd2148a7656 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:54.476929 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b4509-44f3-4e24-9b1b-5cd2148a7656 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:54.477068 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf2a1d-c30d-4f92-969c-12f90593a6a5 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:54.477202 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b4509-44f3-4e24-9b1b-5cd2148a7656 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:54.478038 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b4509-44f3-4e24-9b1b-5cd2148a7656 None admin] RBAC: Adding query filter params (group.id=7af94451ae87418797e4a02fa0325f83, role.id=e49df2a8408b4f5fa7e284575007ce83, scope.project.id=90e0b1babc6a4f59b9783fd69c68f2ce) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:54.478910 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b4509-44f3-4e24-9b1b-5cd2148a7656 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:54.480597 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b4509-44f3-4e24-9b1b-5cd2148a7656 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:54.485502 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 217/444] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:01:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:54.497664 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 228/445] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Mar 29 20:01:54 2022] GET /identity/v3/role_assignments?group.id=7af94451ae87418797e4a02fa0325f83&scope.project.id=90e0b1babc6a4f59b9783fd69c68f2ce&role.id=e49df2a8408b4f5fa7e284575007ce83 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:54.497869 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf2a1d-c30d-4f92-969c-12f90593a6a5 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:54.497962 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b4509-44f3-4e24-9b1b-5cd2148a7656 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:54.597454 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b4509-44f3-4e24-9b1b-5cd2148a7656 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:54.602533 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf2a1d-c30d-4f92-969c-12f90593a6a5 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:54.634061 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21050d36-0afb-481b-8c78-134c0c8b0875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:54.635311 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21050d36-0afb-481b-8c78-134c0c8b0875 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:54.635593 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21050d36-0afb-481b-8c78-134c0c8b0875 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:54.635871 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21050d36-0afb-481b-8c78-134c0c8b0875 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:54.638062 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a813f-4809-4af8-ae05-ff67b47a284b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:54.638895 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a813f-4809-4af8-ae05-ff67b47a284b None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:54.639178 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a813f-4809-4af8-ae05-ff67b47a284b None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:54.639453 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a813f-4809-4af8-ae05-ff67b47a284b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:54.650689 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a813f-4809-4af8-ae05-ff67b47a284b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:01:54.658387 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-501a813f-4809-4af8-ae05-ff67b47a284b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 29 20:01:54.659828 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 218/446] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Mar 29 20:01:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:54.665367 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a813f-4809-4af8-ae05-ff67b47a284b None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:54.708608 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21050d36-0afb-481b-8c78-134c0c8b0875 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:54.710108 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21050d36-0afb-481b-8c78-134c0c8b0875 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:54.784054 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a813f-4809-4af8-ae05-ff67b47a284b None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:54.820417 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6daca-49d4-447b-aa7f-6e0d6173371f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:54.821360 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6daca-49d4-447b-aa7f-6e0d6173371f None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:54.821488 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 229/447] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 29 20:01:54.821917 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6daca-49d4-447b-aa7f-6e0d6173371f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:54.823136 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6daca-49d4-447b-aa7f-6e0d6173371f None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:54.824060 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e6daca-49d4-447b-aa7f-6e0d6173371f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:54.824359 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e6daca-49d4-447b-aa7f-6e0d6173371f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:54.825791 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e6daca-49d4-447b-aa7f-6e0d6173371f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:54.828487 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21050d36-0afb-481b-8c78-134c0c8b0875 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:54.835494 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 219/448] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:01:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:01:54.842898 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6daca-49d4-447b-aa7f-6e0d6173371f None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:54.933193 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21050d36-0afb-481b-8c78-134c0c8b0875 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:54.945205 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6daca-49d4-447b-aa7f-6e0d6173371f None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:54.964832 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483ecde-04fa-42bc-96ae-effc2eb747da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:54.965869 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483ecde-04fa-42bc-96ae-effc2eb747da None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:54.966156 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483ecde-04fa-42bc-96ae-effc2eb747da None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:54.966436 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483ecde-04fa-42bc-96ae-effc2eb747da None admin] PATH_INFO: `/v3/projects/a15fd3ff4f1b47218a3a97159af6b6bb` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:54.967599 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1483ecde-04fa-42bc-96ae-effc2eb747da None admin] RBAC: Authorizing `identity:get_project(project_id=a15fd3ff4f1b47218a3a97159af6b6bb)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:54.969183 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1483ecde-04fa-42bc-96ae-effc2eb747da None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:54.970878 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 230/449] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:54 2022] GET /identity/v3/projects/a15fd3ff4f1b47218a3a97159af6b6bb => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:54.976346 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483ecde-04fa-42bc-96ae-effc2eb747da None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:54.977968 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc10b11-3bda-4b2a-b8b4-be45794156ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:54.979357 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc10b11-3bda-4b2a-b8b4-be45794156ba None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:54.979645 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc10b11-3bda-4b2a-b8b4-be45794156ba None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:54.979922 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc10b11-3bda-4b2a-b8b4-be45794156ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:55.043668 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc10b11-3bda-4b2a-b8b4-be45794156ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:55.045114 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc10b11-3bda-4b2a-b8b4-be45794156ba None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:55.078259 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483ecde-04fa-42bc-96ae-effc2eb747da None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:55.110121 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9da1e-20b6-4b37-81ab-948fbf8cb127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:55.110977 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9da1e-20b6-4b37-81ab-948fbf8cb127 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:55.111258 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9da1e-20b6-4b37-81ab-948fbf8cb127 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:55.111535 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9da1e-20b6-4b37-81ab-948fbf8cb127 None admin] PATH_INFO: `/v3/groups/35c6500b4cda4a92a4a2a412986f1ee8` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:55.112694 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9da1e-20b6-4b37-81ab-948fbf8cb127 None admin] RBAC: Authorizing `identity:get_group(group_id=35c6500b4cda4a92a4a2a412986f1ee8)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:55.114152 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9da1e-20b6-4b37-81ab-948fbf8cb127 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:55.115744 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 231/450] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Mar 29 20:01:54 2022] GET /identity/v3/groups/35c6500b4cda4a92a4a2a412986f1ee8 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:01:55.121963 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9da1e-20b6-4b37-81ab-948fbf8cb127 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:55.140437 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 220/451] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:01:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 29 20:01:55.145771 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc10b11-3bda-4b2a-b8b4-be45794156ba None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:55.214975 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9da1e-20b6-4b37-81ab-948fbf8cb127 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:55.239199 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc10b11-3bda-4b2a-b8b4-be45794156ba None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:55.246318 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783661d-2bc9-4b46-9fcd-a16713c93148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:55.246967 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783661d-2bc9-4b46-9fcd-a16713c93148 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:55.247258 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783661d-2bc9-4b46-9fcd-a16713c93148 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:55.247536 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783661d-2bc9-4b46-9fcd-a16713c93148 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:55.248351 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783661d-2bc9-4b46-9fcd-a16713c93148 None admin] RBAC: Adding query filter params (group.id=35c6500b4cda4a92a4a2a412986f1ee8, role.id=8cfa924df1a1400986d9ecc9686a7f52, scope.project.id=a15fd3ff4f1b47218a3a97159af6b6bb) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:55.248662 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783661d-2bc9-4b46-9fcd-a16713c93148 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:55.250117 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783661d-2bc9-4b46-9fcd-a16713c93148 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:55.255636 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 232/452] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Mar 29 20:01:55 2022] GET /identity/v3/role_assignments?group.id=35c6500b4cda4a92a4a2a412986f1ee8&scope.project.id=a15fd3ff4f1b47218a3a97159af6b6bb&role.id=8cfa924df1a1400986d9ecc9686a7f52 => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:01:55.272058 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09464326-f4c3-41fc-b7cc-4cb1c9c8617c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:55.272941 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09464326-f4c3-41fc-b7cc-4cb1c9c8617c None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:55.273227 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09464326-f4c3-41fc-b7cc-4cb1c9c8617c None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:55.273550 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09464326-f4c3-41fc-b7cc-4cb1c9c8617c None admin] PATH_INFO: `/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:55.274835 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09464326-f4c3-41fc-b7cc-4cb1c9c8617c None admin] RBAC: Authorizing `identity:get_project(project_id=90e0b1babc6a4f59b9783fd69c68f2ce)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:55.276957 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09464326-f4c3-41fc-b7cc-4cb1c9c8617c None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:55.278764 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 221/453] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:01:55 2022] GET /identity/v3/projects/90e0b1babc6a4f59b9783fd69c68f2ce => generated 302 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:01:55.284459 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783661d-2bc9-4b46-9fcd-a16713c93148 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:55.387052 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783661d-2bc9-4b46-9fcd-a16713c93148 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:55.421490 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefb0ce-8fff-4264-a888-a714d21d45ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:55.422354 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefb0ce-8fff-4264-a888-a714d21d45ad None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:55.422637 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefb0ce-8fff-4264-a888-a714d21d45ad None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:55.422914 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefb0ce-8fff-4264-a888-a714d21d45ad None admin] PATH_INFO: `/v3/groups/7af94451ae87418797e4a02fa0325f83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:55.424106 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbefb0ce-8fff-4264-a888-a714d21d45ad None admin] RBAC: Authorizing `identity:get_group(group_id=7af94451ae87418797e4a02fa0325f83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:55.425597 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbefb0ce-8fff-4264-a888-a714d21d45ad None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:55.427227 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 233/454] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Mar 29 20:01:55 2022] GET /identity/v3/groups/7af94451ae87418797e4a02fa0325f83 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:55.433229 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09464326-f4c3-41fc-b7cc-4cb1c9c8617c None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:55.530172 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09464326-f4c3-41fc-b7cc-4cb1c9c8617c None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:55.562045 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf00a0-f697-43e8-be2a-fafd8cbc9be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:55.562692 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf00a0-f697-43e8-be2a-fafd8cbc9be6 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:55.562971 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf00a0-f697-43e8-be2a-fafd8cbc9be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:55.563307 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf00a0-f697-43e8-be2a-fafd8cbc9be6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:55.564124 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf00a0-f697-43e8-be2a-fafd8cbc9be6 None admin] RBAC: Adding query filter params (group.id=7af94451ae87418797e4a02fa0325f83, role.id=82747af757b549cbaa39504334f32f9f, scope.project.id=90e0b1babc6a4f59b9783fd69c68f2ce) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:55.564435 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf00a0-f697-43e8-be2a-fafd8cbc9be6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:55.565873 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf00a0-f697-43e8-be2a-fafd8cbc9be6 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:55.571318 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 222/455] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Mar 29 20:01:55 2022] GET /identity/v3/role_assignments?group.id=7af94451ae87418797e4a02fa0325f83&scope.project.id=90e0b1babc6a4f59b9783fd69c68f2ce&role.id=82747af757b549cbaa39504334f32f9f => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:58.459267 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01bd39-cc7b-479f-bb15-3f99f954a3cc None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:58.460291 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01bd39-cc7b-479f-bb15-3f99f954a3cc None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:58.460774 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01bd39-cc7b-479f-bb15-3f99f954a3cc None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:58.463149 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 234/456] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:58.468041 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37f0e2-1a2d-46a6-bf4a-a221de2e11b8 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:58.468898 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37f0e2-1a2d-46a6-bf4a-a221de2e11b8 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:58.469416 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37f0e2-1a2d-46a6-bf4a-a221de2e11b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:58.487257 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-ce37f0e2-1a2d-46a6-bf4a-a221de2e11b8 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:58.488761 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-ce37f0e2-1a2d-46a6-bf4a-a221de2e11b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:58.579495 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 223/457] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:58.625985 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01bd39-cc7b-479f-bb15-3f99f954a3cc None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:58.662733 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cca03-50b8-4c03-910e-81cdcbde70da None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:58.663361 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cca03-50b8-4c03-910e-81cdcbde70da None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:58.663839 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cca03-50b8-4c03-910e-81cdcbde70da None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:58.666227 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 224/458] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:01:58.670933 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811811b-aa26-4276-9e90-b91e5433da8e None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:58.671456 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811811b-aa26-4276-9e90-b91e5433da8e None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:58.672099 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811811b-aa26-4276-9e90-b91e5433da8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:58.701847 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-0811811b-aa26-4276-9e90-b91e5433da8e None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:58.703057 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-0811811b-aa26-4276-9e90-b91e5433da8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:58.804846 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01bd39-cc7b-479f-bb15-3f99f954a3cc None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:58.830380 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 225/459] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:58.848015 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668f0d0-aef0-4b23-a967-9cd3ca8bb0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:58.848809 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668f0d0-aef0-4b23-a967-9cd3ca8bb0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:58.849094 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668f0d0-aef0-4b23-a967-9cd3ca8bb0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:58.849405 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668f0d0-aef0-4b23-a967-9cd3ca8bb0c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:58.860422 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668f0d0-aef0-4b23-a967-9cd3ca8bb0c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:58.861922 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668f0d0-aef0-4b23-a967-9cd3ca8bb0c6 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:58.876030 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811811b-aa26-4276-9e90-b91e5433da8e None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:58.879314 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-b668f0d0-aef0-4b23-a967-9cd3ca8bb0c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:01:58.881605 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 235/460] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:01:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:58.889427 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668f0d0-aef0-4b23-a967-9cd3ca8bb0c6 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:59.017775 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811811b-aa26-4276-9e90-b91e5433da8e None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:59.057691 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b2cf7-71cf-457b-91cc-5afaf3bcaf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:59.059024 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b2cf7-71cf-457b-91cc-5afaf3bcaf6c None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:59.059451 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b2cf7-71cf-457b-91cc-5afaf3bcaf6c None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:59.059867 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b2cf7-71cf-457b-91cc-5afaf3bcaf6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:59.071831 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b2cf7-71cf-457b-91cc-5afaf3bcaf6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:59.074281 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b2cf7-71cf-457b-91cc-5afaf3bcaf6c None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:59.094234 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-696b2cf7-71cf-457b-91cc-5afaf3bcaf6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:01:59.095558 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668f0d0-aef0-4b23-a967-9cd3ca8bb0c6 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:59.095816 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 226/461] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:01:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:59.101492 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b2cf7-71cf-457b-91cc-5afaf3bcaf6c None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:59.145192 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd104921-bc85-4feb-8ccf-2676e274a378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:59.146049 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd104921-bc85-4feb-8ccf-2676e274a378 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:59.146387 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd104921-bc85-4feb-8ccf-2676e274a378 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:59.146670 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd104921-bc85-4feb-8ccf-2676e274a378 None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:59.147380 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd104921-bc85-4feb-8ccf-2676e274a378 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:59.147684 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd104921-bc85-4feb-8ccf-2676e274a378 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:59.149038 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd104921-bc85-4feb-8ccf-2676e274a378 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:59.160910 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 236/462] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:59.162535 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d24e6-4eea-486c-893b-5605720b1c50 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:59.162894 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d24e6-4eea-486c-893b-5605720b1c50 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:59.163241 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d24e6-4eea-486c-893b-5605720b1c50 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:59.165083 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 237/463] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:59.166647 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a57c34-2cc3-499b-ae54-6291a4d31bb9 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:59.167001 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a57c34-2cc3-499b-ae54-6291a4d31bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:59.167383 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a57c34-2cc3-499b-ae54-6291a4d31bb9 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:59.173033 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 238/464] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:01:59.173033 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a57c34-2cc3-499b-ae54-6291a4d31bb9 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:59.221636 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b2cf7-71cf-457b-91cc-5afaf3bcaf6c None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:59.257058 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29075cc9-a7d0-4ae1-8338-cc3bb3dd1a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:59.258046 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29075cc9-a7d0-4ae1-8338-cc3bb3dd1a7c None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:59.258483 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29075cc9-a7d0-4ae1-8338-cc3bb3dd1a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:59.258934 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29075cc9-a7d0-4ae1-8338-cc3bb3dd1a7c None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:59.259838 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29075cc9-a7d0-4ae1-8338-cc3bb3dd1a7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:59.260287 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29075cc9-a7d0-4ae1-8338-cc3bb3dd1a7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:59.261782 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29075cc9-a7d0-4ae1-8338-cc3bb3dd1a7c None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:59.278794 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a57c34-2cc3-499b-ae54-6291a4d31bb9 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:59.284534 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 227/465] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:59.284534 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520989f4-a3fe-4bb0-bd22-7f2dd85701b3 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:59.284534 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520989f4-a3fe-4bb0-bd22-7f2dd85701b3 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:59.284534 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520989f4-a3fe-4bb0-bd22-7f2dd85701b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:59.304044 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-520989f4-a3fe-4bb0-bd22-7f2dd85701b3 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:59.305437 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-520989f4-a3fe-4bb0-bd22-7f2dd85701b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:59.317903 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cb285-daee-4275-a919-a9dee4a474db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:59.318425 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cb285-daee-4275-a919-a9dee4a474db None admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:59.318707 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cb285-daee-4275-a919-a9dee4a474db None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:59.318983 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cb285-daee-4275-a919-a9dee4a474db None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:59.319709 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087cb285-daee-4275-a919-a9dee4a474db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:59.321208 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087cb285-daee-4275-a919-a9dee4a474db None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:59.374456 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 228/466] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:59.375797 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b92da-518b-43a0-b745-7611e7ed0bea None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:59.376090 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b92da-518b-43a0-b745-7611e7ed0bea None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:59.376365 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b92da-518b-43a0-b745-7611e7ed0bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:59.392214 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-a46b92da-518b-43a0-b745-7611e7ed0bea None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:01:59.393407 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-a46b92da-518b-43a0-b745-7611e7ed0bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:01:59.437711 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 239/467] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Mar 29 20:01:59 2022] POST /identity/v3/users => generated 246 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:01:59.438517 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cb285-daee-4275-a919-a9dee4a474db None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:59.463553 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 229/468] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:01:59.464946 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b92da-518b-43a0-b745-7611e7ed0bea None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:59.575649 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cb285-daee-4275-a919-a9dee4a474db None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:59.595798 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b92da-518b-43a0-b745-7611e7ed0bea None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:59.616635 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69d0ab-b083-4729-8d70-85f05480cfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:59.617664 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69d0ab-b083-4729-8d70-85f05480cfb7 None admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:59.618088 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69d0ab-b083-4729-8d70-85f05480cfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:59.618574 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69d0ab-b083-4729-8d70-85f05480cfb7 None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:59.620779 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69d0ab-b083-4729-8d70-85f05480cfb7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:59.622487 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69d0ab-b083-4729-8d70-85f05480cfb7 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:59.638526 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902d810-126e-4ea6-8be8-86900ea4557f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:59.639336 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902d810-126e-4ea6-8be8-86900ea4557f None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:59.639625 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902d810-126e-4ea6-8be8-86900ea4557f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:59.639906 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902d810-126e-4ea6-8be8-86900ea4557f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:59.652094 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902d810-126e-4ea6-8be8-86900ea4557f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:59.653738 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902d810-126e-4ea6-8be8-86900ea4557f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:59.671559 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-9902d810-126e-4ea6-8be8-86900ea4557f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:01:59.673020 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 230/469] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:01:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:59.674924 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902d810-126e-4ea6-8be8-86900ea4557f None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:59.709995 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 240/470] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Mar 29 20:01:59 2022] POST /identity/v3/users => generated 248 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:01:59.710960 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69d0ab-b083-4729-8d70-85f05480cfb7 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:59.811935 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902d810-126e-4ea6-8be8-86900ea4557f None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:59.827068 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69d0ab-b083-4729-8d70-85f05480cfb7 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:01:59.856968 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52091229-ac80-4553-a724-12bb72b81e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:59.858042 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52091229-ac80-4553-a724-12bb72b81e60 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:59.858411 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52091229-ac80-4553-a724-12bb72b81e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:59.859042 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52091229-ac80-4553-a724-12bb72b81e60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:59.863628 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbff4bb-9459-432e-8e41-bcfb32266a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:01:59.864643 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbff4bb-9459-432e-8e41-bcfb32266a68 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:01:59.865124 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbff4bb-9459-432e-8e41-bcfb32266a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:01:59.865647 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbff4bb-9459-432e-8e41-bcfb32266a68 None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:01:59.866570 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbff4bb-9459-432e-8e41-bcfb32266a68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:01:59.867158 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbff4bb-9459-432e-8e41-bcfb32266a68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:59.868986 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbff4bb-9459-432e-8e41-bcfb32266a68 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:59.872054 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52091229-ac80-4553-a724-12bb72b81e60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:01:59.873542 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52091229-ac80-4553-a724-12bb72b81e60 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:01:59.891258 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 241/471] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:01:59.897885 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-52091229-ac80-4553-a724-12bb72b81e60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:01:59.899687 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 231/472] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:01:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:01:59.901058 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbff4bb-9459-432e-8e41-bcfb32266a68 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:01:59.904861 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52091229-ac80-4553-a724-12bb72b81e60 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:00.031906 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbff4bb-9459-432e-8e41-bcfb32266a68 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:00.074209 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f4c8c-e6ab-49cd-b22f-3ca7a4bddef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:00.074885 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f4c8c-e6ab-49cd-b22f-3ca7a4bddef5 None admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:00.075166 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f4c8c-e6ab-49cd-b22f-3ca7a4bddef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:00.075444 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f4c8c-e6ab-49cd-b22f-3ca7a4bddef5 None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:00.076160 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f4c8c-e6ab-49cd-b22f-3ca7a4bddef5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:00.077677 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f4c8c-e6ab-49cd-b22f-3ca7a4bddef5 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:00.096524 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52091229-ac80-4553-a724-12bb72b81e60 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:00.137426 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd6866-be6c-4bfb-88b4-e91141aee606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:00.138076 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd6866-be6c-4bfb-88b4-e91141aee606 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:00.138413 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd6866-be6c-4bfb-88b4-e91141aee606 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:00.138934 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd6866-be6c-4bfb-88b4-e91141aee606 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:00.139385 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd6866-be6c-4bfb-88b4-e91141aee606 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:00.139707 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd6866-be6c-4bfb-88b4-e91141aee606 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:00.141054 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd6866-be6c-4bfb-88b4-e91141aee606 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:00.153685 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 232/473] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:00.154980 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaf8e9-239c-4547-924b-0ff67813ba9e None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:00.155272 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaf8e9-239c-4547-924b-0ff67813ba9e None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:00.155556 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaf8e9-239c-4547-924b-0ff67813ba9e None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:00.157459 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 233/474] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:00.159201 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaf8e9-239c-4547-924b-0ff67813ba9e None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:00.181776 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 242/475] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Mar 29 20:01:59 2022] POST /identity/v3/users => generated 249 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:02:00.183386 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe7ed1-faf2-432c-9bad-e3cb5f8cff48 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:00.183681 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe7ed1-faf2-432c-9bad-e3cb5f8cff48 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:00.186711 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe7ed1-faf2-432c-9bad-e3cb5f8cff48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:00.207064 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-59fe7ed1-faf2-432c-9bad-e3cb5f8cff48 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:00.208330 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-59fe7ed1-faf2-432c-9bad-e3cb5f8cff48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:00.290291 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaf8e9-239c-4547-924b-0ff67813ba9e None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:00.291676 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 243/476] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:02:00.316867 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe7ed1-faf2-432c-9bad-e3cb5f8cff48 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:00.339496 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96268ffe-0945-45f4-a3b9-8f5ef4590335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:00.340836 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96268ffe-0945-45f4-a3b9-8f5ef4590335 None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:00.341374 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96268ffe-0945-45f4-a3b9-8f5ef4590335 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:00.341864 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96268ffe-0945-45f4-a3b9-8f5ef4590335 None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:00.343294 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96268ffe-0945-45f4-a3b9-8f5ef4590335 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:00.345235 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96268ffe-0945-45f4-a3b9-8f5ef4590335 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:00.437534 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe7ed1-faf2-432c-9bad-e3cb5f8cff48 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:00.447862 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 234/477] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Mar 29 20:02:00 2022] POST /identity/v3/users => generated 248 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:02:00.482966 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1e7c8-1b1f-4e97-8624-847e8ef7222a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:00.483652 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1e7c8-1b1f-4e97-8624-847e8ef7222a None admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:00.483936 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1e7c8-1b1f-4e97-8624-847e8ef7222a None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:00.484215 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1e7c8-1b1f-4e97-8624-847e8ef7222a None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:00.484987 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1e7c8-1b1f-4e97-8624-847e8ef7222a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:00.486442 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1e7c8-1b1f-4e97-8624-847e8ef7222a None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:00.521960 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.sql.core [None req-22a1e7c8-1b1f-4e97-8624-847e8ef7222a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Mar 29 20:02:00.521960 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Mar 29 20:02:00.521960 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [parameters: {'id': 'd4aa50ab1f8d4c858452244616fd8916', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Mar 29 20:02:00.521960 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80092) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 29 20:02:00.539964 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-22a1e7c8-1b1f-4e97-8624-847e8ef7222a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Mar 29 20:02:00.543085 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 244/478] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Mar 29 20:02:00 2022] POST /identity/v3/roles => generated 144 bytes in 227 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:02:00.548953 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96268ffe-0945-45f4-a3b9-8f5ef4590335 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:00.660013 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96268ffe-0945-45f4-a3b9-8f5ef4590335 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:00.697605 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1a977-42b4-4e88-bc30-df29e74e6942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:00.698913 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1a977-42b4-4e88-bc30-df29e74e6942 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:00.699373 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1a977-42b4-4e88-bc30-df29e74e6942 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:00.699798 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1a977-42b4-4e88-bc30-df29e74e6942 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:00.710307 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1a977-42b4-4e88-bc30-df29e74e6942 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:00.718005 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-14b1a977-42b4-4e88-bc30-df29e74e6942 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 29 20:02:00.719712 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 235/479] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Mar 29 20:02:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:00.725468 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1e7c8-1b1f-4e97-8624-847e8ef7222a None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:00.835193 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1e7c8-1b1f-4e97-8624-847e8ef7222a None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:00.869532 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b63d8d-304a-46e3-8f09-e9aa2b37e5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:00.870453 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b63d8d-304a-46e3-8f09-e9aa2b37e5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:00.870885 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b63d8d-304a-46e3-8f09-e9aa2b37e5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:00.871368 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b63d8d-304a-46e3-8f09-e9aa2b37e5a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:00.872264 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b63d8d-304a-46e3-8f09-e9aa2b37e5a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:00.872719 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b63d8d-304a-46e3-8f09-e9aa2b37e5a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:00.874274 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b63d8d-304a-46e3-8f09-e9aa2b37e5a5 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:00.882991 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 245/480] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:02.309116 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420a8d5-ddc2-486b-9859-47d852b11e50 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:02.310204 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420a8d5-ddc2-486b-9859-47d852b11e50 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:02.310701 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420a8d5-ddc2-486b-9859-47d852b11e50 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:02.313049 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 236/481] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:02.319819 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160b66c-49ec-4a07-aae3-8ff191a2d3a8 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:02.320322 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160b66c-49ec-4a07-aae3-8ff191a2d3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:02.320408 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160b66c-49ec-4a07-aae3-8ff191a2d3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:02.343925 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-0160b66c-49ec-4a07-aae3-8ff191a2d3a8 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:02.345105 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-0160b66c-49ec-4a07-aae3-8ff191a2d3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:02.435749 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 246/482] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:02:02.468200 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420a8d5-ddc2-486b-9859-47d852b11e50 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:02.599013 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420a8d5-ddc2-486b-9859-47d852b11e50 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:02.645496 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227ca5a-c059-4b9a-b1c4-ad1476f64d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:02.646301 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227ca5a-c059-4b9a-b1c4-ad1476f64d6e None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:02.646588 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227ca5a-c059-4b9a-b1c4-ad1476f64d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:02.646870 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227ca5a-c059-4b9a-b1c4-ad1476f64d6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:02.676031 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227ca5a-c059-4b9a-b1c4-ad1476f64d6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:02.684033 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-1227ca5a-c059-4b9a-b1c4-ad1476f64d6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 20:02:02.685454 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 237/483] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Mar 29 20:02:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:02.691133 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160b66c-49ec-4a07-aae3-8ff191a2d3a8 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:02.741753 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d39314-6f3c-4b7f-8d09-566899e85c78 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:02.742076 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d39314-6f3c-4b7f-8d09-566899e85c78 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:02.742324 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d39314-6f3c-4b7f-8d09-566899e85c78 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:02.744453 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 238/484] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:02.752437 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009be17a-d3d7-4fce-82b5-b0b8a8658cb4 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:02.752778 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009be17a-d3d7-4fce-82b5-b0b8a8658cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:02.753001 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009be17a-d3d7-4fce-82b5-b0b8a8658cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:02.782600 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-009be17a-d3d7-4fce-82b5-b0b8a8658cb4 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:02.783802 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-009be17a-d3d7-4fce-82b5-b0b8a8658cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:02.878800 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160b66c-49ec-4a07-aae3-8ff191a2d3a8 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:02.906669 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 239/485] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 20:02:02.940899 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f354a1b-f5b9-46c9-a31e-764e4c17ae4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:02.941658 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f354a1b-f5b9-46c9-a31e-764e4c17ae4b None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:02.941941 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f354a1b-f5b9-46c9-a31e-764e4c17ae4b None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:02.942217 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f354a1b-f5b9-46c9-a31e-764e4c17ae4b None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:02.942969 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f354a1b-f5b9-46c9-a31e-764e4c17ae4b None admin] RBAC: Adding query filter params (name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:02.943281 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f354a1b-f5b9-46c9-a31e-764e4c17ae4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:02.944662 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f354a1b-f5b9-46c9-a31e-764e4c17ae4b None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:02.955155 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 247/486] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Mar 29 20:02:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:02.960428 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009be17a-d3d7-4fce-82b5-b0b8a8658cb4 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:02.971141 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f354a1b-f5b9-46c9-a31e-764e4c17ae4b None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:03.096027 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009be17a-d3d7-4fce-82b5-b0b8a8658cb4 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:03.147070 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58bd3a5-9e59-448a-be9e-144599cf97ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:03.147992 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bd3a5-9e59-448a-be9e-144599cf97ce None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:03.148669 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bd3a5-9e59-448a-be9e-144599cf97ce None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:03.148669 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bd3a5-9e59-448a-be9e-144599cf97ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:03.176609 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f354a1b-f5b9-46c9-a31e-764e4c17ae4b None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:03.177962 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58bd3a5-9e59-448a-be9e-144599cf97ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:03.179934 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58bd3a5-9e59-448a-be9e-144599cf97ce None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:03.218011 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-c58bd3a5-9e59-448a-be9e-144599cf97ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:03.219719 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 240/487] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:03.221207 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ed13e-d9b2-4f44-879f-8aaf67eedca9 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:03.221618 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2212789-318d-4576-b9c7-c47b18c08f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:03.221773 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ed13e-d9b2-4f44-879f-8aaf67eedca9 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:03.222113 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ed13e-d9b2-4f44-879f-8aaf67eedca9 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:03.222889 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2212789-318d-4576-b9c7-c47b18c08f97 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:03.223320 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2212789-318d-4576-b9c7-c47b18c08f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:03.223731 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2212789-318d-4576-b9c7-c47b18c08f97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:03.229098 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 241/488] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:03.229098 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ed13e-d9b2-4f44-879f-8aaf67eedca9 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:03.239914 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2212789-318d-4576-b9c7-c47b18c08f97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:03.247844 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-a2212789-318d-4576-b9c7-c47b18c08f97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 20:02:03.249403 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 248/489] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Mar 29 20:02:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:03.250718 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e553f32-fa02-40f4-a87d-97e5abb5bd24 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:03.251012 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e553f32-fa02-40f4-a87d-97e5abb5bd24 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:03.251292 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e553f32-fa02-40f4-a87d-97e5abb5bd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:03.270430 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-1e553f32-fa02-40f4-a87d-97e5abb5bd24 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:03.272087 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-1e553f32-fa02-40f4-a87d-97e5abb5bd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:03.351730 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 249/490] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:02:03.357340 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e553f32-fa02-40f4-a87d-97e5abb5bd24 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:03.371294 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ed13e-d9b2-4f44-879f-8aaf67eedca9 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:03.411575 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab3555-54d8-4f6e-adb5-8500ea8f9d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:03.412460 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab3555-54d8-4f6e-adb5-8500ea8f9d0e None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:03.412893 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab3555-54d8-4f6e-adb5-8500ea8f9d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:03.413483 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab3555-54d8-4f6e-adb5-8500ea8f9d0e None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:03.414460 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab3555-54d8-4f6e-adb5-8500ea8f9d0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:03.414970 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab3555-54d8-4f6e-adb5-8500ea8f9d0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:03.417163 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab3555-54d8-4f6e-adb5-8500ea8f9d0e None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:03.429356 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 242/491] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:03.430679 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab3555-54d8-4f6e-adb5-8500ea8f9d0e None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:03.488019 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e553f32-fa02-40f4-a87d-97e5abb5bd24 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:03.533849 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de13639-5356-4313-97e5-5bcc18fbffd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:03.534559 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de13639-5356-4313-97e5-5bcc18fbffd9 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:03.535133 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de13639-5356-4313-97e5-5bcc18fbffd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:03.535425 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de13639-5356-4313-97e5-5bcc18fbffd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:03.536300 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de13639-5356-4313-97e5-5bcc18fbffd9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:03.536738 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de13639-5356-4313-97e5-5bcc18fbffd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:03.538320 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de13639-5356-4313-97e5-5bcc18fbffd9 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:03.542331 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab3555-54d8-4f6e-adb5-8500ea8f9d0e None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:03.554189 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 250/492] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Mar 29 20:02:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:03.554189 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de13639-5356-4313-97e5-5bcc18fbffd9 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:03.584216 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea141596-1957-4068-83cd-1be3ca3fcfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:03.585666 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea141596-1957-4068-83cd-1be3ca3fcfd1 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:03.586059 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea141596-1957-4068-83cd-1be3ca3fcfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:03.586343 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea141596-1957-4068-83cd-1be3ca3fcfd1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:03.597144 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea141596-1957-4068-83cd-1be3ca3fcfd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:03.605257 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-ea141596-1957-4068-83cd-1be3ca3fcfd1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 20:02:03.611078 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 243/493] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Mar 29 20:02:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:03.611078 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea141596-1957-4068-83cd-1be3ca3fcfd1 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:03.666053 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de13639-5356-4313-97e5-5bcc18fbffd9 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:03.701910 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e226e-b80b-4008-8b17-3aed48d61f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:03.702703 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e226e-b80b-4008-8b17-3aed48d61f81 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:03.702978 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e226e-b80b-4008-8b17-3aed48d61f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:03.703251 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e226e-b80b-4008-8b17-3aed48d61f81 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:03.710884 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e226e-b80b-4008-8b17-3aed48d61f81 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:03.712972 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e226e-b80b-4008-8b17-3aed48d61f81 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:03.713207 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea141596-1957-4068-83cd-1be3ca3fcfd1 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:03.726197 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-9f7e226e-b80b-4008-8b17-3aed48d61f81 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 29 20:02:03.727455 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 251/494] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Mar 29 20:02:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:03.729428 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b0509-1740-43e5-9388-11c681981e67 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:03.729715 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b0509-1740-43e5-9388-11c681981e67 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:03.730003 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b0509-1740-43e5-9388-11c681981e67 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:03.731677 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 252/495] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:03.732380 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b0509-1740-43e5-9388-11c681981e67 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:03.747276 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9586b1f-0e32-4557-99aa-c7ee597f8d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:03.748068 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9586b1f-0e32-4557-99aa-c7ee597f8d73 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:03.748353 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9586b1f-0e32-4557-99aa-c7ee597f8d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:03.748659 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9586b1f-0e32-4557-99aa-c7ee597f8d73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:03.758892 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9586b1f-0e32-4557-99aa-c7ee597f8d73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:03.760653 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9586b1f-0e32-4557-99aa-c7ee597f8d73 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:03.777425 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-c9586b1f-0e32-4557-99aa-c7ee597f8d73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:03.778587 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 244/496] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:03.783241 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3c95b-5942-47f3-894c-4f350e4c9b79 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:03.783241 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3c95b-5942-47f3-894c-4f350e4c9b79 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:03.783241 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3c95b-5942-47f3-894c-4f350e4c9b79 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:03.783241 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 245/497] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:03.783241 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3c95b-5942-47f3-894c-4f350e4c9b79 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:03.830042 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b0509-1740-43e5-9388-11c681981e67 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:03.861859 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ce862-0ab8-4de5-981d-a1168d7adc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:03.862528 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ce862-0ab8-4de5-981d-a1168d7adc39 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:03.862812 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ce862-0ab8-4de5-981d-a1168d7adc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:03.863090 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ce862-0ab8-4de5-981d-a1168d7adc39 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:03.863822 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ce862-0ab8-4de5-981d-a1168d7adc39 None admin] RBAC: Adding query filter params (name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:03.864128 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ce862-0ab8-4de5-981d-a1168d7adc39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:03.865544 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ce862-0ab8-4de5-981d-a1168d7adc39 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:03.874151 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 253/498] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Mar 29 20:02:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:03.875327 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020772f5-689c-4cf5-93bf-6919f45e67a9 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:03.875616 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020772f5-689c-4cf5-93bf-6919f45e67a9 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:03.875898 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020772f5-689c-4cf5-93bf-6919f45e67a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:03.888526 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3c95b-5942-47f3-894c-4f350e4c9b79 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:03.893031 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-020772f5-689c-4cf5-93bf-6919f45e67a9 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:03.894244 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-020772f5-689c-4cf5-93bf-6919f45e67a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:03.920420 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641961e0-3c62-4d24-b780-2232d80a5b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:03.921016 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641961e0-3c62-4d24-b780-2232d80a5b3d None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:03.921312 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641961e0-3c62-4d24-b780-2232d80a5b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:03.921597 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641961e0-3c62-4d24-b780-2232d80a5b3d None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:03.922428 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641961e0-3c62-4d24-b780-2232d80a5b3d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:03.922736 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641961e0-3c62-4d24-b780-2232d80a5b3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:03.924157 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641961e0-3c62-4d24-b780-2232d80a5b3d None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:03.962857 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 246/499] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Mar 29 20:02:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:03.963893 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641961e0-3c62-4d24-b780-2232d80a5b3d None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:03.965691 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 254/500] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:02:03.967546 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb2eca-e9a7-4729-bb37-30f33dbda70d None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:03.967673 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb2eca-e9a7-4729-bb37-30f33dbda70d None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:03.967900 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb2eca-e9a7-4729-bb37-30f33dbda70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:03.984372 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-76cb2eca-e9a7-4729-bb37-30f33dbda70d None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:03.985611 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-76cb2eca-e9a7-4729-bb37-30f33dbda70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:04.048967 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 255/501] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:02:04.061482 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb2eca-e9a7-4729-bb37-30f33dbda70d None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:04.061989 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641961e0-3c62-4d24-b780-2232d80a5b3d None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:04.095668 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c883f2b-b693-4a55-b592-b0a568a174ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:04.096319 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c883f2b-b693-4a55-b592-b0a568a174ee None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:04.096598 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c883f2b-b693-4a55-b592-b0a568a174ee None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:04.096903 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c883f2b-b693-4a55-b592-b0a568a174ee None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:04.097649 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c883f2b-b693-4a55-b592-b0a568a174ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:04.097952 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c883f2b-b693-4a55-b592-b0a568a174ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:04.099317 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c883f2b-b693-4a55-b592-b0a568a174ee None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:04.110878 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 247/502] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:04.111662 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c883f2b-b693-4a55-b592-b0a568a174ee None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:04.145466 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb2eca-e9a7-4729-bb37-30f33dbda70d None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:04.177823 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d5713-961b-4cd3-a5c4-7586d8308f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:04.178543 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d5713-961b-4cd3-a5c4-7586d8308f89 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:04.178824 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d5713-961b-4cd3-a5c4-7586d8308f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:04.179097 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d5713-961b-4cd3-a5c4-7586d8308f89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:04.188719 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d5713-961b-4cd3-a5c4-7586d8308f89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:04.190209 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d5713-961b-4cd3-a5c4-7586d8308f89 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:04.206713 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c883f2b-b693-4a55-b592-b0a568a174ee None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:04.207373 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-053d5713-961b-4cd3-a5c4-7586d8308f89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:04.208549 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 256/503] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:04.209339 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d5713-961b-4cd3-a5c4-7586d8308f89 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:04.239543 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19ad41-087b-496e-a617-326846cdf02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:04.240189 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19ad41-087b-496e-a617-326846cdf02a None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:04.240476 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19ad41-087b-496e-a617-326846cdf02a None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:04.240752 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19ad41-087b-496e-a617-326846cdf02a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:04.302764 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d5713-961b-4cd3-a5c4-7586d8308f89 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:04.304383 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19ad41-087b-496e-a617-326846cdf02a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:04.305941 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19ad41-087b-496e-a617-326846cdf02a None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:04.335099 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280fd39-5fc5-4192-9eec-f9efc4c97ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:04.335880 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280fd39-5fc5-4192-9eec-f9efc4c97ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:04.336161 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280fd39-5fc5-4192-9eec-f9efc4c97ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:04.336432 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280fd39-5fc5-4192-9eec-f9efc4c97ea2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:04.346763 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280fd39-5fc5-4192-9eec-f9efc4c97ea2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:04.353876 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-f280fd39-5fc5-4192-9eec-f9efc4c97ea2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 20:02:04.355046 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 257/504] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Mar 29 20:02:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:04.359833 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280fd39-5fc5-4192-9eec-f9efc4c97ea2 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:04.399406 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 248/505] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:02:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:02:04.402223 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19ad41-087b-496e-a617-326846cdf02a None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:04.453008 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280fd39-5fc5-4192-9eec-f9efc4c97ea2 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:04.484603 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3b67d-7489-40f2-9e80-feef9bccd088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:04.485403 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3b67d-7489-40f2-9e80-feef9bccd088 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:04.485688 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3b67d-7489-40f2-9e80-feef9bccd088 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:04.485961 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3b67d-7489-40f2-9e80-feef9bccd088 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:04.494994 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19ad41-087b-496e-a617-326846cdf02a None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:04.496476 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3b67d-7489-40f2-9e80-feef9bccd088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:04.497971 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3b67d-7489-40f2-9e80-feef9bccd088 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:04.513740 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-a1b3b67d-7489-40f2-9e80-feef9bccd088 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:04.514903 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 258/506] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:04.515659 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3b67d-7489-40f2-9e80-feef9bccd088 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:04.528706 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9f063-401c-4dbd-9d1c-2bfa2e4e8f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:04.529527 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9f063-401c-4dbd-9d1c-2bfa2e4e8f85 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:04.529812 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9f063-401c-4dbd-9d1c-2bfa2e4e8f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:04.530095 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9f063-401c-4dbd-9d1c-2bfa2e4e8f85 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:04.536965 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9f063-401c-4dbd-9d1c-2bfa2e4e8f85 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:04.538444 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9f063-401c-4dbd-9d1c-2bfa2e4e8f85 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:04.552610 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-65e9f063-401c-4dbd-9d1c-2bfa2e4e8f85 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 29 20:02:04.553787 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 249/507] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:02:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:04.554551 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9f063-401c-4dbd-9d1c-2bfa2e4e8f85 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:04.614882 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3b67d-7489-40f2-9e80-feef9bccd088 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:04.647030 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37218c44-ac11-4084-a1e0-730583e97068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:04.647680 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37218c44-ac11-4084-a1e0-730583e97068 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:04.647964 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37218c44-ac11-4084-a1e0-730583e97068 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:04.648241 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37218c44-ac11-4084-a1e0-730583e97068 None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:04.648476 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9f063-401c-4dbd-9d1c-2bfa2e4e8f85 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:04.648954 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37218c44-ac11-4084-a1e0-730583e97068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:04.649262 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37218c44-ac11-4084-a1e0-730583e97068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:04.650697 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37218c44-ac11-4084-a1e0-730583e97068 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:04.662110 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 259/508] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:04.662891 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37218c44-ac11-4084-a1e0-730583e97068 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:04.686901 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b9b81-1657-488c-a678-7a8474d76a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:04.687595 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b9b81-1657-488c-a678-7a8474d76a00 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:04.687887 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b9b81-1657-488c-a678-7a8474d76a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:04.688166 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b9b81-1657-488c-a678-7a8474d76a00 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:04.688913 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b9b81-1657-488c-a678-7a8474d76a00 None admin] RBAC: Adding query filter params (name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:04.689223 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b9b81-1657-488c-a678-7a8474d76a00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:04.690611 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b9b81-1657-488c-a678-7a8474d76a00 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:04.699200 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 250/509] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Mar 29 20:02:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:04.700057 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b9b81-1657-488c-a678-7a8474d76a00 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:04.756480 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37218c44-ac11-4084-a1e0-730583e97068 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:04.788700 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a480b-963b-49c3-b0be-ba7c5fa2a888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:04.789513 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a480b-963b-49c3-b0be-ba7c5fa2a888 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:04.789803 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a480b-963b-49c3-b0be-ba7c5fa2a888 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:04.790074 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a480b-963b-49c3-b0be-ba7c5fa2a888 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:04.795129 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b9b81-1657-488c-a678-7a8474d76a00 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:04.800369 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a480b-963b-49c3-b0be-ba7c5fa2a888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:04.801866 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a480b-963b-49c3-b0be-ba7c5fa2a888 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:04.818222 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-ae2a480b-963b-49c3-b0be-ba7c5fa2a888 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:04.819380 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 260/510] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:04.820145 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a480b-963b-49c3-b0be-ba7c5fa2a888 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:04.826645 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ce582-cc3c-4b40-a287-9b25c7995033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:04.827304 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ce582-cc3c-4b40-a287-9b25c7995033 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:04.827591 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ce582-cc3c-4b40-a287-9b25c7995033 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:04.827872 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ce582-cc3c-4b40-a287-9b25c7995033 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:04.828596 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ce582-cc3c-4b40-a287-9b25c7995033 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:04.828910 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ce582-cc3c-4b40-a287-9b25c7995033 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:04.830306 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ce582-cc3c-4b40-a287-9b25c7995033 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:04.842625 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 251/511] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:04.843409 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ce582-cc3c-4b40-a287-9b25c7995033 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:04.914070 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a480b-963b-49c3-b0be-ba7c5fa2a888 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:04.939446 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ce582-cc3c-4b40-a287-9b25c7995033 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:04.949865 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb54ae-eef6-4f07-8c54-f84c96acc881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:04.950530 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb54ae-eef6-4f07-8c54-f84c96acc881 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:04.950819 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb54ae-eef6-4f07-8c54-f84c96acc881 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:04.951096 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb54ae-eef6-4f07-8c54-f84c96acc881 None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:04.951923 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb54ae-eef6-4f07-8c54-f84c96acc881 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:04.952234 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb54ae-eef6-4f07-8c54-f84c96acc881 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:04.953711 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb54ae-eef6-4f07-8c54-f84c96acc881 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:04.973562 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd8c1b-149a-4644-9f73-e9051ca6edfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:04.974346 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd8c1b-149a-4644-9f73-e9051ca6edfa None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:04.974628 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd8c1b-149a-4644-9f73-e9051ca6edfa None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:04.974903 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd8c1b-149a-4644-9f73-e9051ca6edfa None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:04.982209 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd8c1b-149a-4644-9f73-e9051ca6edfa None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:04.983635 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd8c1b-149a-4644-9f73-e9051ca6edfa None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:04.990152 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 261/512] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Mar 29 20:02:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:04.990979 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb54ae-eef6-4f07-8c54-f84c96acc881 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:04.997954 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-46cd8c1b-149a-4644-9f73-e9051ca6edfa None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 29 20:02:04.999135 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 252/513] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Mar 29 20:02:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:04.999885 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd8c1b-149a-4644-9f73-e9051ca6edfa None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:05.091005 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb54ae-eef6-4f07-8c54-f84c96acc881 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:05.095913 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd8c1b-149a-4644-9f73-e9051ca6edfa None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:05.126888 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14490f18-e116-4851-86bd-8684bb5e7c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:05.127683 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14490f18-e116-4851-86bd-8684bb5e7c26 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:05.127924 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487465ee-20dd-4824-9389-5f7570361e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:05.128054 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14490f18-e116-4851-86bd-8684bb5e7c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:05.128233 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14490f18-e116-4851-86bd-8684bb5e7c26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:05.128577 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487465ee-20dd-4824-9389-5f7570361e67 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:05.128863 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487465ee-20dd-4824-9389-5f7570361e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:05.129138 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487465ee-20dd-4824-9389-5f7570361e67 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:05.129894 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487465ee-20dd-4824-9389-5f7570361e67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:05.130202 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487465ee-20dd-4824-9389-5f7570361e67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:05.131570 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487465ee-20dd-4824-9389-5f7570361e67 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:05.138859 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14490f18-e116-4851-86bd-8684bb5e7c26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:05.140312 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14490f18-e116-4851-86bd-8684bb5e7c26 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:05.143047 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 253/514] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:05.143807 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487465ee-20dd-4824-9389-5f7570361e67 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:05.156960 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-14490f18-e116-4851-86bd-8684bb5e7c26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:05.158284 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 262/515] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:05.158927 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14490f18-e116-4851-86bd-8684bb5e7c26 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:05.240097 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487465ee-20dd-4824-9389-5f7570361e67 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:05.253873 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14490f18-e116-4851-86bd-8684bb5e7c26 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:05.273003 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1ea3f-ed73-43d1-9463-e71fbcf84a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:05.273721 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1ea3f-ed73-43d1-9463-e71fbcf84a40 None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:05.274004 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1ea3f-ed73-43d1-9463-e71fbcf84a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:05.274282 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1ea3f-ed73-43d1-9463-e71fbcf84a40 None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:05.275535 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1ea3f-ed73-43d1-9463-e71fbcf84a40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:05.276957 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1ea3f-ed73-43d1-9463-e71fbcf84a40 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:05.294944 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bdcd4-5a1c-4ac8-a93d-3efedf001368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:05.295588 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bdcd4-5a1c-4ac8-a93d-3efedf001368 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:05.295873 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bdcd4-5a1c-4ac8-a93d-3efedf001368 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:05.296174 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bdcd4-5a1c-4ac8-a93d-3efedf001368 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:05.360931 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07bdcd4-5a1c-4ac8-a93d-3efedf001368 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:05.362405 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07bdcd4-5a1c-4ac8-a93d-3efedf001368 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:05.366353 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 254/516] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Mar 29 20:02:05 2022] POST /identity/v3/users => generated 247 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:02:05.367004 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1ea3f-ed73-43d1-9463-e71fbcf84a40 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:05.468609 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 263/517] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:02:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:02:05.469879 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bdcd4-5a1c-4ac8-a93d-3efedf001368 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:05.476444 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1ea3f-ed73-43d1-9463-e71fbcf84a40 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:05.512491 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90920b83-a259-4dd7-a260-1ce08dbd5335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:05.513180 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90920b83-a259-4dd7-a260-1ce08dbd5335 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:05.513503 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90920b83-a259-4dd7-a260-1ce08dbd5335 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:05.513803 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90920b83-a259-4dd7-a260-1ce08dbd5335 None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:05.514659 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90920b83-a259-4dd7-a260-1ce08dbd5335 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:05.514973 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90920b83-a259-4dd7-a260-1ce08dbd5335 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:05.516431 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90920b83-a259-4dd7-a260-1ce08dbd5335 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:05.535598 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 255/518] 10.222.0.43 () {56 vars in 1139 bytes} [Tue Mar 29 20:02:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:05.536471 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90920b83-a259-4dd7-a260-1ce08dbd5335 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:05.576565 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bdcd4-5a1c-4ac8-a93d-3efedf001368 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:05.613776 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbefd53-b114-4f0f-9a14-70fe7f31c89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:05.614506 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbefd53-b114-4f0f-9a14-70fe7f31c89d None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:05.614790 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbefd53-b114-4f0f-9a14-70fe7f31c89d None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:05.615069 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbefd53-b114-4f0f-9a14-70fe7f31c89d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:05.622794 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbefd53-b114-4f0f-9a14-70fe7f31c89d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:05.624262 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbefd53-b114-4f0f-9a14-70fe7f31c89d None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:05.637329 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-adbefd53-b114-4f0f-9a14-70fe7f31c89d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:05.638680 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 264/519] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:05.643337 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbefd53-b114-4f0f-9a14-70fe7f31c89d None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:05.643458 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90920b83-a259-4dd7-a260-1ce08dbd5335 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:05.676702 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5cd49-0f60-4450-b82f-4f225832d499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:05.677396 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5cd49-0f60-4450-b82f-4f225832d499 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:05.677684 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5cd49-0f60-4450-b82f-4f225832d499 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:05.677957 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5cd49-0f60-4450-b82f-4f225832d499 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:05.678677 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5cd49-0f60-4450-b82f-4f225832d499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:05.678984 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5cd49-0f60-4450-b82f-4f225832d499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:05.680341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5cd49-0f60-4450-b82f-4f225832d499 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:05.692696 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 256/520] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:05.694244 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5cd49-0f60-4450-b82f-4f225832d499 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:05.743192 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbefd53-b114-4f0f-9a14-70fe7f31c89d None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:05.777888 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583d591-b4da-4a9e-9f78-fe8969ad086d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:05.778684 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583d591-b4da-4a9e-9f78-fe8969ad086d None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:05.778966 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583d591-b4da-4a9e-9f78-fe8969ad086d None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:05.779242 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583d591-b4da-4a9e-9f78-fe8969ad086d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:05.789787 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583d591-b4da-4a9e-9f78-fe8969ad086d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:05.791908 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583d591-b4da-4a9e-9f78-fe8969ad086d None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:05.797524 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5cd49-0f60-4450-b82f-4f225832d499 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:05.809214 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-d583d591-b4da-4a9e-9f78-fe8969ad086d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:05.810439 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 265/521] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:05.811208 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583d591-b4da-4a9e-9f78-fe8969ad086d None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:05.838244 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842017e-2874-4367-b00d-faa36b080e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:05.838935 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842017e-2874-4367-b00d-faa36b080e8f None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:05.839220 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842017e-2874-4367-b00d-faa36b080e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:05.839496 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842017e-2874-4367-b00d-faa36b080e8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:05.905918 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842017e-2874-4367-b00d-faa36b080e8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:05.907347 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842017e-2874-4367-b00d-faa36b080e8f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:05.914902 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583d591-b4da-4a9e-9f78-fe8969ad086d None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:05.955671 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e5f0f-a903-4959-9543-dd49942fd7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:05.956331 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e5f0f-a903-4959-9543-dd49942fd7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:05.956619 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e5f0f-a903-4959-9543-dd49942fd7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:05.956884 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e5f0f-a903-4959-9543-dd49942fd7a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:05.957688 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e5f0f-a903-4959-9543-dd49942fd7a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:05.957998 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e5f0f-a903-4959-9543-dd49942fd7a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:05.959435 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e5f0f-a903-4959-9543-dd49942fd7a1 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:05.977440 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 266/522] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:05.978904 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e5f0f-a903-4959-9543-dd49942fd7a1 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:06.030798 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 257/523] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:02:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:02:06.031982 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842017e-2874-4367-b00d-faa36b080e8f None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:06.106715 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e5f0f-a903-4959-9543-dd49942fd7a1 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:06.137282 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842017e-2874-4367-b00d-faa36b080e8f None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:06.141638 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88574d95-d97f-4b49-bdfa-2ba580479cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:06.142436 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88574d95-d97f-4b49-bdfa-2ba580479cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:06.142719 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88574d95-d97f-4b49-bdfa-2ba580479cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:06.143002 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88574d95-d97f-4b49-bdfa-2ba580479cf7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:06.150727 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88574d95-d97f-4b49-bdfa-2ba580479cf7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:06.152323 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88574d95-d97f-4b49-bdfa-2ba580479cf7 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:06.167190 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-88574d95-d97f-4b49-bdfa-2ba580479cf7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 29 20:02:06.173068 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 267/524] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:02:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:06.173068 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88574d95-d97f-4b49-bdfa-2ba580479cf7 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:06.177465 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d12e41-717a-4256-8b02-5633d16f4db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:06.178132 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d12e41-717a-4256-8b02-5633d16f4db2 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:06.178415 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d12e41-717a-4256-8b02-5633d16f4db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:06.178686 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d12e41-717a-4256-8b02-5633d16f4db2 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:06.179402 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d12e41-717a-4256-8b02-5633d16f4db2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:06.179713 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d12e41-717a-4256-8b02-5633d16f4db2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:06.181112 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d12e41-717a-4256-8b02-5633d16f4db2 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:06.192279 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 258/525] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:06.193098 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d12e41-717a-4256-8b02-5633d16f4db2 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:06.275938 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88574d95-d97f-4b49-bdfa-2ba580479cf7 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:06.305378 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d12e41-717a-4256-8b02-5633d16f4db2 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:06.309580 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a77a4-314d-49b1-8762-03583facabfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:06.310246 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a77a4-314d-49b1-8762-03583facabfc None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:06.310528 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a77a4-314d-49b1-8762-03583facabfc None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:06.310807 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a77a4-314d-49b1-8762-03583facabfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:06.311632 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a77a4-314d-49b1-8762-03583facabfc None admin] RBAC: Adding query filter params (role.id=04bfd9a52ca84b2db7f73121d5e57b41, scope.project.id=ec1f2c5cb900473da1083830387e3ff4, user.id=b797e15939694c9abf1f2b8e9aee4d67) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:06.311947 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a77a4-314d-49b1-8762-03583facabfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:06.313395 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a77a4-314d-49b1-8762-03583facabfc None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:06.318964 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 268/526] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:02:06 2022] GET /identity/v3/role_assignments?user.id=b797e15939694c9abf1f2b8e9aee4d67&scope.project.id=ec1f2c5cb900473da1083830387e3ff4&role.id=04bfd9a52ca84b2db7f73121d5e57b41 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:06.319752 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a77a4-314d-49b1-8762-03583facabfc None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:06.352619 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6acc43-b91e-49be-bae0-416ac6de4be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:06.354039 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6acc43-b91e-49be-bae0-416ac6de4be6 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:06.354320 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6acc43-b91e-49be-bae0-416ac6de4be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:06.354736 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6acc43-b91e-49be-bae0-416ac6de4be6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:06.366701 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6acc43-b91e-49be-bae0-416ac6de4be6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:06.368317 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6acc43-b91e-49be-bae0-416ac6de4be6 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:06.386869 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-ae6acc43-b91e-49be-bae0-416ac6de4be6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:06.388230 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 259/527] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:06.389044 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6acc43-b91e-49be-bae0-416ac6de4be6 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:06.437349 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a77a4-314d-49b1-8762-03583facabfc None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:06.476883 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e288c80-15e1-4477-b71f-0786cc987ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:06.477978 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e288c80-15e1-4477-b71f-0786cc987ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:06.478472 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e288c80-15e1-4477-b71f-0786cc987ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:06.478954 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e288c80-15e1-4477-b71f-0786cc987ef5 None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:06.480010 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e288c80-15e1-4477-b71f-0786cc987ef5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:06.480571 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e288c80-15e1-4477-b71f-0786cc987ef5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:06.482304 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e288c80-15e1-4477-b71f-0786cc987ef5 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:06.499215 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6acc43-b91e-49be-bae0-416ac6de4be6 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:06.507140 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 269/528] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Mar 29 20:02:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:06.508352 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e288c80-15e1-4477-b71f-0786cc987ef5 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:06.536156 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b36475-edb3-4551-b27a-3806c09e110b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:06.536959 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b36475-edb3-4551-b27a-3806c09e110b None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:06.537252 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b36475-edb3-4551-b27a-3806c09e110b None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:06.537565 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b36475-edb3-4551-b27a-3806c09e110b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:06.545963 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b36475-edb3-4551-b27a-3806c09e110b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:06.547469 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b36475-edb3-4551-b27a-3806c09e110b None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:06.562335 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-45b36475-edb3-4551-b27a-3806c09e110b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:06.563864 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 260/529] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:06.564645 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b36475-edb3-4551-b27a-3806c09e110b None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:06.619709 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e288c80-15e1-4477-b71f-0786cc987ef5 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:06.654979 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb98bee-21de-455e-80dc-d46397be234a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:06.655992 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb98bee-21de-455e-80dc-d46397be234a None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:06.656481 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb98bee-21de-455e-80dc-d46397be234a None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:06.656961 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb98bee-21de-455e-80dc-d46397be234a None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:06.657902 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb98bee-21de-455e-80dc-d46397be234a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:06.658437 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb98bee-21de-455e-80dc-d46397be234a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:06.660049 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb98bee-21de-455e-80dc-d46397be234a None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:06.664493 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b36475-edb3-4551-b27a-3806c09e110b None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:06.673189 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 270/530] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:06.674314 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb98bee-21de-455e-80dc-d46397be234a None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:06.700790 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c38a24-260c-430c-a972-0804169a56f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:06.701390 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c38a24-260c-430c-a972-0804169a56f3 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:06.701687 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c38a24-260c-430c-a972-0804169a56f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:06.702219 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c38a24-260c-430c-a972-0804169a56f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:06.770237 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c38a24-260c-430c-a972-0804169a56f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:06.771782 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c38a24-260c-430c-a972-0804169a56f3 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:06.778358 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb98bee-21de-455e-80dc-d46397be234a None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:06.812517 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9814ed-70bd-44f6-8882-04dc0f50af69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:06.813510 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9814ed-70bd-44f6-8882-04dc0f50af69 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:06.813999 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9814ed-70bd-44f6-8882-04dc0f50af69 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:06.814515 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9814ed-70bd-44f6-8882-04dc0f50af69 None admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:06.815487 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9814ed-70bd-44f6-8882-04dc0f50af69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:06.815998 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9814ed-70bd-44f6-8882-04dc0f50af69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:06.817696 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9814ed-70bd-44f6-8882-04dc0f50af69 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:06.830726 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 271/531] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:06.831808 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9814ed-70bd-44f6-8882-04dc0f50af69 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:06.875867 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 261/532] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:02:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:02:06.876741 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c38a24-260c-430c-a972-0804169a56f3 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:06.937762 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9814ed-70bd-44f6-8882-04dc0f50af69 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:06.975499 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c38a24-260c-430c-a972-0804169a56f3 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:06.979428 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1107c-91ce-45c3-8610-76e736fb0008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:06.980489 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1107c-91ce-45c3-8610-76e736fb0008 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:06.980979 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1107c-91ce-45c3-8610-76e736fb0008 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:06.981499 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1107c-91ce-45c3-8610-76e736fb0008 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:06.988867 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1107c-91ce-45c3-8610-76e736fb0008 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:06.990642 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1107c-91ce-45c3-8610-76e736fb0008 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:07.004762 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-06c1107c-91ce-45c3-8610-76e736fb0008 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:07.006601 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 272/533] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:07.007940 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1107c-91ce-45c3-8610-76e736fb0008 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:07.010396 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e79009-43fb-4849-a3c8-552504134cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:07.011055 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e79009-43fb-4849-a3c8-552504134cfd None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:07.011339 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e79009-43fb-4849-a3c8-552504134cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:07.011874 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e79009-43fb-4849-a3c8-552504134cfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:07.012722 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e79009-43fb-4849-a3c8-552504134cfd None admin] RBAC: Adding query filter params (role.id=04bfd9a52ca84b2db7f73121d5e57b41, scope.project.id=ec1f2c5cb900473da1083830387e3ff4, user.id=0b169395c92c4fbfbbe4fd14a235f81f) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:07.013037 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e79009-43fb-4849-a3c8-552504134cfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:07.014594 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e79009-43fb-4849-a3c8-552504134cfd None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:07.020434 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 262/534] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:02:06 2022] GET /identity/v3/role_assignments?user.id=0b169395c92c4fbfbbe4fd14a235f81f&scope.project.id=ec1f2c5cb900473da1083830387e3ff4&role.id=04bfd9a52ca84b2db7f73121d5e57b41 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:07.021241 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e79009-43fb-4849-a3c8-552504134cfd None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:07.117774 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1107c-91ce-45c3-8610-76e736fb0008 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:07.131005 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e79009-43fb-4849-a3c8-552504134cfd None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:07.155600 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435e783-bc37-4fd1-8def-4ee1661a1ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:07.156753 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435e783-bc37-4fd1-8def-4ee1661a1ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:07.157241 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435e783-bc37-4fd1-8def-4ee1661a1ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:07.157767 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435e783-bc37-4fd1-8def-4ee1661a1ef7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:07.169261 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af1c14-bb07-4abe-a980-9b6724e52e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:07.170127 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af1c14-bb07-4abe-a980-9b6724e52e89 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:07.170413 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af1c14-bb07-4abe-a980-9b6724e52e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:07.170729 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af1c14-bb07-4abe-a980-9b6724e52e89 None admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:07.170993 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435e783-bc37-4fd1-8def-4ee1661a1ef7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:07.171527 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af1c14-bb07-4abe-a980-9b6724e52e89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:07.171836 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af1c14-bb07-4abe-a980-9b6724e52e89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:07.173095 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435e783-bc37-4fd1-8def-4ee1661a1ef7 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:07.173269 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af1c14-bb07-4abe-a980-9b6724e52e89 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:07.192158 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-d435e783-bc37-4fd1-8def-4ee1661a1ef7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:07.193870 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 263/535] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:07.194056 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 273/536] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:07.200359 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435e783-bc37-4fd1-8def-4ee1661a1ef7 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:07.200507 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af1c14-bb07-4abe-a980-9b6724e52e89 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:07.306872 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435e783-bc37-4fd1-8def-4ee1661a1ef7 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:07.308464 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af1c14-bb07-4abe-a980-9b6724e52e89 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:07.344239 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440b5f4-b1ef-4072-96a5-6e594cf6c3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:07.345353 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440b5f4-b1ef-4072-96a5-6e594cf6c3dc None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:07.345879 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440b5f4-b1ef-4072-96a5-6e594cf6c3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:07.346436 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440b5f4-b1ef-4072-96a5-6e594cf6c3dc None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:07.347495 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440b5f4-b1ef-4072-96a5-6e594cf6c3dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:07.347897 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580965d1-6ab1-4629-9f67-6199117cd473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:07.348125 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440b5f4-b1ef-4072-96a5-6e594cf6c3dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:07.348744 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580965d1-6ab1-4629-9f67-6199117cd473 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:07.349123 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580965d1-6ab1-4629-9f67-6199117cd473 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:07.349527 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580965d1-6ab1-4629-9f67-6199117cd473 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:07.350190 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440b5f4-b1ef-4072-96a5-6e594cf6c3dc None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:07.350550 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580965d1-6ab1-4629-9f67-6199117cd473 None admin] RBAC: Adding query filter params (role.id=04bfd9a52ca84b2db7f73121d5e57b41, scope.project.id=ec1f2c5cb900473da1083830387e3ff4, user.id=22bdaa02b1b14be3837b337fbf6e0eb5) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:07.350960 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580965d1-6ab1-4629-9f67-6199117cd473 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:07.352484 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580965d1-6ab1-4629-9f67-6199117cd473 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:07.359971 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 264/537] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:02:07 2022] GET /identity/v3/role_assignments?user.id=22bdaa02b1b14be3837b337fbf6e0eb5&scope.project.id=ec1f2c5cb900473da1083830387e3ff4&role.id=04bfd9a52ca84b2db7f73121d5e57b41 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:07.364536 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 274/538] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:07.380596 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580965d1-6ab1-4629-9f67-6199117cd473 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:07.495210 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580965d1-6ab1-4629-9f67-6199117cd473 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:07.531811 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70e4d0-a511-4e02-9e44-393682c99e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:07.533325 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70e4d0-a511-4e02-9e44-393682c99e3e None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:07.533758 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70e4d0-a511-4e02-9e44-393682c99e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:07.534204 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70e4d0-a511-4e02-9e44-393682c99e3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:07.542581 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70e4d0-a511-4e02-9e44-393682c99e3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:07.544316 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70e4d0-a511-4e02-9e44-393682c99e3e None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:07.558583 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-dd70e4d0-a511-4e02-9e44-393682c99e3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:07.560308 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 265/539] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:07.565750 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440b5f4-b1ef-4072-96a5-6e594cf6c3dc None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:07.684198 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440b5f4-b1ef-4072-96a5-6e594cf6c3dc None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:07.720132 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0df40e-8310-46b5-813a-90354d52ddcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:07.721066 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0df40e-8310-46b5-813a-90354d52ddcf None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:07.721522 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0df40e-8310-46b5-813a-90354d52ddcf None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:07.721944 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0df40e-8310-46b5-813a-90354d52ddcf None admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:07.722872 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0df40e-8310-46b5-813a-90354d52ddcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:07.723355 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0df40e-8310-46b5-813a-90354d52ddcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:07.724946 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0df40e-8310-46b5-813a-90354d52ddcf None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:07.737494 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 275/540] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:07.743038 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70e4d0-a511-4e02-9e44-393682c99e3e None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:07.787950 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88a376-47ea-4696-a1a7-27925a2f9fb9 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:07.788687 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88a376-47ea-4696-a1a7-27925a2f9fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:07.789980 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88a376-47ea-4696-a1a7-27925a2f9fb9 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:07.792373 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 276/541] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:07.797717 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994c0f2-bc60-44df-856b-e400d4f3ba20 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:07.798660 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994c0f2-bc60-44df-856b-e400d4f3ba20 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:07.799122 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994c0f2-bc60-44df-856b-e400d4f3ba20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:07.819485 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-d994c0f2-bc60-44df-856b-e400d4f3ba20 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:07.820957 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-d994c0f2-bc60-44df-856b-e400d4f3ba20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:07.901959 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 277/542] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 20:02:07.925379 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994c0f2-bc60-44df-856b-e400d4f3ba20 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:07.942847 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70e4d0-a511-4e02-9e44-393682c99e3e None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:08.026719 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cddab-e9dd-4084-8d28-02773032541f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:08.027326 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cddab-e9dd-4084-8d28-02773032541f None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:08.027677 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cddab-e9dd-4084-8d28-02773032541f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:08.028025 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cddab-e9dd-4084-8d28-02773032541f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:08.028923 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597cddab-e9dd-4084-8d28-02773032541f None admin] RBAC: Adding query filter params (role.id=04bfd9a52ca84b2db7f73121d5e57b41, scope.project.id=ec1f2c5cb900473da1083830387e3ff4, user.id=1d8ea87a7fd34751896b2a0ffaedab2c) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:08.029318 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597cddab-e9dd-4084-8d28-02773032541f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:08.030826 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597cddab-e9dd-4084-8d28-02773032541f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:08.047438 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 266/543] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:02:07 2022] GET /identity/v3/role_assignments?user.id=1d8ea87a7fd34751896b2a0ffaedab2c&scope.project.id=ec1f2c5cb900473da1083830387e3ff4&role.id=04bfd9a52ca84b2db7f73121d5e57b41 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:08.051013 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994c0f2-bc60-44df-856b-e400d4f3ba20 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:08.090151 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47318516-d222-4314-8921-dfb84d1f5ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:08.091280 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47318516-d222-4314-8921-dfb84d1f5ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:08.091759 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47318516-d222-4314-8921-dfb84d1f5ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:08.092229 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47318516-d222-4314-8921-dfb84d1f5ea8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:08.104090 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47318516-d222-4314-8921-dfb84d1f5ea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:08.111892 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-47318516-d222-4314-8921-dfb84d1f5ea8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 20:02:08.113813 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 278/544] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Mar 29 20:02:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:08.120309 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cddab-e9dd-4084-8d28-02773032541f None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:08.296884 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cddab-e9dd-4084-8d28-02773032541f None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:08.331352 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461a3ab-53a4-4bb7-9d71-10af2e342967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:08.332022 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461a3ab-53a4-4bb7-9d71-10af2e342967 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:08.332305 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461a3ab-53a4-4bb7-9d71-10af2e342967 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:08.332580 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461a3ab-53a4-4bb7-9d71-10af2e342967 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:08.333351 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461a3ab-53a4-4bb7-9d71-10af2e342967 None admin] RBAC: Adding query filter params (name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:08.333666 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461a3ab-53a4-4bb7-9d71-10af2e342967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:08.335040 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461a3ab-53a4-4bb7-9d71-10af2e342967 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:08.344664 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 267/545] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Mar 29 20:02:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:08.350034 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47318516-d222-4314-8921-dfb84d1f5ea8 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:08.463923 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47318516-d222-4314-8921-dfb84d1f5ea8 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:08.508031 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4dfc6-c99a-43de-8cab-ff6536c894b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:08.509511 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4dfc6-c99a-43de-8cab-ff6536c894b0 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:08.509943 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4dfc6-c99a-43de-8cab-ff6536c894b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:08.510226 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4dfc6-c99a-43de-8cab-ff6536c894b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:08.524214 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4dfc6-c99a-43de-8cab-ff6536c894b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:08.525771 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4dfc6-c99a-43de-8cab-ff6536c894b0 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:08.544155 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-01a4dfc6-c99a-43de-8cab-ff6536c894b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:08.545791 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 279/546] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:02:08.554418 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461a3ab-53a4-4bb7-9d71-10af2e342967 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:08.691596 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461a3ab-53a4-4bb7-9d71-10af2e342967 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:08.734020 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46dcfd8-facd-4219-a06a-cc07e355c64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:08.734697 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46dcfd8-facd-4219-a06a-cc07e355c64f None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:08.734977 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46dcfd8-facd-4219-a06a-cc07e355c64f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:08.735252 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46dcfd8-facd-4219-a06a-cc07e355c64f None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:08.735977 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46dcfd8-facd-4219-a06a-cc07e355c64f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:08.736281 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46dcfd8-facd-4219-a06a-cc07e355c64f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:08.737673 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46dcfd8-facd-4219-a06a-cc07e355c64f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:08.754847 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 268/547] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:08.761891 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4dfc6-c99a-43de-8cab-ff6536c894b0 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:08.880160 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4dfc6-c99a-43de-8cab-ff6536c894b0 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:08.914873 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4794da4-1fbd-46c3-90a9-e45727c6c0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:08.916572 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4794da4-1fbd-46c3-90a9-e45727c6c0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:08.917071 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4794da4-1fbd-46c3-90a9-e45727c6c0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:08.917583 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4794da4-1fbd-46c3-90a9-e45727c6c0a0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:08.925613 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4794da4-1fbd-46c3-90a9-e45727c6c0a0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:08.927334 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4794da4-1fbd-46c3-90a9-e45727c6c0a0 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:08.953725 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-c4794da4-1fbd-46c3-90a9-e45727c6c0a0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 29 20:02:08.955255 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 280/548] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:02:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:08.961043 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46dcfd8-facd-4219-a06a-cc07e355c64f None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:09.051129 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf5731-5913-45b8-b110-e17417a7a8e4 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:09.051786 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf5731-5913-45b8-b110-e17417a7a8e4 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:09.052267 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf5731-5913-45b8-b110-e17417a7a8e4 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:09.058395 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 281/549] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:02:09.060079 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88969170-2aa8-4d00-bcb4-a6bbd4175133 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:09.060590 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88969170-2aa8-4d00-bcb4-a6bbd4175133 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:09.061089 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88969170-2aa8-4d00-bcb4-a6bbd4175133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:09.078910 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-88969170-2aa8-4d00-bcb4-a6bbd4175133 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:09.080403 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-88969170-2aa8-4d00-bcb4-a6bbd4175133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:09.150924 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46dcfd8-facd-4219-a06a-cc07e355c64f None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:09.199806 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 282/550] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 20:02:09.208838 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f9d66-c5da-4d3f-9e27-9d2cddf58f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:09.209811 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f9d66-c5da-4d3f-9e27-9d2cddf58f9e None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:09.210311 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f9d66-c5da-4d3f-9e27-9d2cddf58f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:09.210812 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f9d66-c5da-4d3f-9e27-9d2cddf58f9e None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:09.211901 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f9d66-c5da-4d3f-9e27-9d2cddf58f9e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:09.212613 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f9d66-c5da-4d3f-9e27-9d2cddf58f9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:09.214323 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f9d66-c5da-4d3f-9e27-9d2cddf58f9e None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:09.232482 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 269/551] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Mar 29 20:02:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:09.242389 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88969170-2aa8-4d00-bcb4-a6bbd4175133 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:09.244439 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f9d66-c5da-4d3f-9e27-9d2cddf58f9e None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:09.395172 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88969170-2aa8-4d00-bcb4-a6bbd4175133 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:09.405465 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f9d66-c5da-4d3f-9e27-9d2cddf58f9e None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:09.440085 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cbfdf-3924-48a9-9df8-bfcb44d58432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:09.441338 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cbfdf-3924-48a9-9df8-bfcb44d58432 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:09.442289 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cbfdf-3924-48a9-9df8-bfcb44d58432 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:09.443087 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919901a-bf59-4ab6-9f4e-8385d9b0a941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:09.444053 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919901a-bf59-4ab6-9f4e-8385d9b0a941 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:09.444483 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cbfdf-3924-48a9-9df8-bfcb44d58432 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:09.445504 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919901a-bf59-4ab6-9f4e-8385d9b0a941 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:09.446893 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919901a-bf59-4ab6-9f4e-8385d9b0a941 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:09.469265 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919901a-bf59-4ab6-9f4e-8385d9b0a941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:09.476553 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-0919901a-bf59-4ab6-9f4e-8385d9b0a941 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 20:02:09.478836 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 270/552] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Mar 29 20:02:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:02:09.484116 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919901a-bf59-4ab6-9f4e-8385d9b0a941 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:09.595532 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919901a-bf59-4ab6-9f4e-8385d9b0a941 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:09.606399 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284cbfdf-3924-48a9-9df8-bfcb44d58432 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:09.607900 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284cbfdf-3924-48a9-9df8-bfcb44d58432 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:09.634583 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44938674-030f-4b7f-8bc1-ad4de6159f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:09.635935 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44938674-030f-4b7f-8bc1-ad4de6159f33 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:09.636749 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44938674-030f-4b7f-8bc1-ad4de6159f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:09.637229 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44938674-030f-4b7f-8bc1-ad4de6159f33 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:09.638359 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44938674-030f-4b7f-8bc1-ad4de6159f33 None admin] RBAC: Adding query filter params (name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:09.638882 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44938674-030f-4b7f-8bc1-ad4de6159f33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:09.640472 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44938674-030f-4b7f-8bc1-ad4de6159f33 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:09.650433 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 271/553] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Mar 29 20:02:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:09.657493 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44938674-030f-4b7f-8bc1-ad4de6159f33 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:09.798021 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44938674-030f-4b7f-8bc1-ad4de6159f33 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:09.839585 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278dc81b-614c-4a58-b818-9f3ff2611f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:09.840897 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dc81b-614c-4a58-b818-9f3ff2611f6e None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:09.841437 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dc81b-614c-4a58-b818-9f3ff2611f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:09.841917 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dc81b-614c-4a58-b818-9f3ff2611f6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:09.845722 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 283/554] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:02:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:02:09.851293 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cbfdf-3924-48a9-9df8-bfcb44d58432 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:09.855068 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278dc81b-614c-4a58-b818-9f3ff2611f6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:09.856801 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278dc81b-614c-4a58-b818-9f3ff2611f6e None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:09.876403 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-278dc81b-614c-4a58-b818-9f3ff2611f6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:09.878771 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 272/555] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:09.886241 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278dc81b-614c-4a58-b818-9f3ff2611f6e None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:10.023619 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cbfdf-3924-48a9-9df8-bfcb44d58432 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:10.063636 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a785a3-3094-47d5-836e-7e97d50f690c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:10.064364 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a785a3-3094-47d5-836e-7e97d50f690c None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:10.064656 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a785a3-3094-47d5-836e-7e97d50f690c None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:10.064936 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a785a3-3094-47d5-836e-7e97d50f690c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:10.076901 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a785a3-3094-47d5-836e-7e97d50f690c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:10.078400 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a785a3-3094-47d5-836e-7e97d50f690c None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:10.097737 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-b3a785a3-3094-47d5-836e-7e97d50f690c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:10.099258 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 284/556] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:02:10.104886 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a785a3-3094-47d5-836e-7e97d50f690c None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:10.135912 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278dc81b-614c-4a58-b818-9f3ff2611f6e None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:10.185312 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c079c-73c9-44b0-939e-2ddbddce3ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:10.196269 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c079c-73c9-44b0-939e-2ddbddce3ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:10.196269 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c079c-73c9-44b0-939e-2ddbddce3ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:10.196269 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c079c-73c9-44b0-939e-2ddbddce3ba3 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:10.196269 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c079c-73c9-44b0-939e-2ddbddce3ba3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:10.196269 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c079c-73c9-44b0-939e-2ddbddce3ba3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:10.196269 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c079c-73c9-44b0-939e-2ddbddce3ba3 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:10.219016 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 273/557] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:10.224088 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c079c-73c9-44b0-939e-2ddbddce3ba3 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:10.262083 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a785a3-3094-47d5-836e-7e97d50f690c None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:10.298404 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df3a1c-84b6-4c61-b0d5-b339f9229055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:10.299350 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df3a1c-84b6-4c61-b0d5-b339f9229055 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:10.299779 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df3a1c-84b6-4c61-b0d5-b339f9229055 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:10.300208 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df3a1c-84b6-4c61-b0d5-b339f9229055 None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:10.300940 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df3a1c-84b6-4c61-b0d5-b339f9229055 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:10.301328 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df3a1c-84b6-4c61-b0d5-b339f9229055 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:10.302706 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df3a1c-84b6-4c61-b0d5-b339f9229055 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:10.315120 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 285/558] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:10.316495 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873b058-ca58-4668-a66e-b3636031cd77 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:10.316791 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873b058-ca58-4668-a66e-b3636031cd77 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:10.317069 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873b058-ca58-4668-a66e-b3636031cd77 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:10.322283 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 286/559] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:10.322283 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91ab3e-1839-4c20-97bc-f17bb239d3c1 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:10.322283 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91ab3e-1839-4c20-97bc-f17bb239d3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:10.322283 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91ab3e-1839-4c20-97bc-f17bb239d3c1 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:10.323222 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 287/560] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:10.324097 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91ab3e-1839-4c20-97bc-f17bb239d3c1 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:10.335326 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c079c-73c9-44b0-939e-2ddbddce3ba3 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:10.370814 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f863d42-f335-49dd-9ef5-b33493842755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:10.371606 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f863d42-f335-49dd-9ef5-b33493842755 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:10.371891 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f863d42-f335-49dd-9ef5-b33493842755 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:10.372170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f863d42-f335-49dd-9ef5-b33493842755 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:10.379282 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f863d42-f335-49dd-9ef5-b33493842755 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:10.380758 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f863d42-f335-49dd-9ef5-b33493842755 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:10.395617 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-4f863d42-f335-49dd-9ef5-b33493842755 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 29 20:02:10.401488 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 274/561] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Mar 29 20:02:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:02:10.401488 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637010e7-b441-432d-abe4-66e431d523a0 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:10.401488 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637010e7-b441-432d-abe4-66e431d523a0 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:10.401488 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637010e7-b441-432d-abe4-66e431d523a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:10.415099 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-637010e7-b441-432d-abe4-66e431d523a0 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:10.416299 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-637010e7-b441-432d-abe4-66e431d523a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:10.428512 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91ab3e-1839-4c20-97bc-f17bb239d3c1 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:10.467796 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97709241-02b7-4351-a91f-f64c26a8538d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:10.468616 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97709241-02b7-4351-a91f-f64c26a8538d None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:10.468897 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97709241-02b7-4351-a91f-f64c26a8538d None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:10.469179 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97709241-02b7-4351-a91f-f64c26a8538d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:10.476594 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97709241-02b7-4351-a91f-f64c26a8538d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:10.478399 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97709241-02b7-4351-a91f-f64c26a8538d None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:10.493497 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 275/562] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:02:10.493497 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda8a0e-4f8e-4658-aa3e-1481837e4bf1 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:10.493497 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda8a0e-4f8e-4658-aa3e-1481837e4bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:10.493497 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda8a0e-4f8e-4658-aa3e-1481837e4bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:10.502875 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-97709241-02b7-4351-a91f-f64c26a8538d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:10.503407 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-9fda8a0e-4f8e-4658-aa3e-1481837e4bf1 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:10.504116 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 288/563] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:10.504687 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9fda8a0e-4f8e-4658-aa3e-1481837e4bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:10.504896 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97709241-02b7-4351-a91f-f64c26a8538d None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:10.574486 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 276/564] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:02:10.575736 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda8a0e-4f8e-4658-aa3e-1481837e4bf1 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:10.621021 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97709241-02b7-4351-a91f-f64c26a8538d None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:10.657032 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d663f6-9934-4026-b27c-72c0c48e5a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:10.657742 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d663f6-9934-4026-b27c-72c0c48e5a69 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:10.658030 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d663f6-9934-4026-b27c-72c0c48e5a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:10.658309 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d663f6-9934-4026-b27c-72c0c48e5a69 None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:10.659141 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d663f6-9934-4026-b27c-72c0c48e5a69 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:10.659453 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d663f6-9934-4026-b27c-72c0c48e5a69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:10.660906 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d663f6-9934-4026-b27c-72c0c48e5a69 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:10.678379 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 289/565] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Mar 29 20:02:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:10.679148 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda8a0e-4f8e-4658-aa3e-1481837e4bf1 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:10.679687 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d663f6-9934-4026-b27c-72c0c48e5a69 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:10.717199 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6953f8-5297-47ff-bf2b-3c534767f3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:10.718279 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6953f8-5297-47ff-bf2b-3c534767f3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:10.718708 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6953f8-5297-47ff-bf2b-3c534767f3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:10.719191 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6953f8-5297-47ff-bf2b-3c534767f3a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:10.730163 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6953f8-5297-47ff-bf2b-3c534767f3a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:10.737205 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-4c6953f8-5297-47ff-bf2b-3c534767f3a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 20:02:10.738427 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 277/566] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Mar 29 20:02:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:10.739191 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6953f8-5297-47ff-bf2b-3c534767f3a2 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:10.788806 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d663f6-9934-4026-b27c-72c0c48e5a69 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:10.825204 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718eb78a-9b5b-41c4-884f-3f5b4424800e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:10.825817 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718eb78a-9b5b-41c4-884f-3f5b4424800e None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:10.826096 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718eb78a-9b5b-41c4-884f-3f5b4424800e None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:10.826368 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718eb78a-9b5b-41c4-884f-3f5b4424800e None admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:10.827134 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718eb78a-9b5b-41c4-884f-3f5b4424800e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:10.827445 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718eb78a-9b5b-41c4-884f-3f5b4424800e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:10.828861 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718eb78a-9b5b-41c4-884f-3f5b4424800e None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:10.836258 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6953f8-5297-47ff-bf2b-3c534767f3a2 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:10.840911 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 290/567] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:10.841569 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718eb78a-9b5b-41c4-884f-3f5b4424800e None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:10.869586 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d78a1-57c5-41c9-bde8-07de8d345be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:10.870381 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d78a1-57c5-41c9-bde8-07de8d345be3 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:10.870667 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d78a1-57c5-41c9-bde8-07de8d345be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:10.870945 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d78a1-57c5-41c9-bde8-07de8d345be3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:10.880689 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d78a1-57c5-41c9-bde8-07de8d345be3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:10.887786 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-283d78a1-57c5-41c9-bde8-07de8d345be3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 20:02:10.888954 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 278/568] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Mar 29 20:02:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:10.889735 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d78a1-57c5-41c9-bde8-07de8d345be3 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:10.938909 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718eb78a-9b5b-41c4-884f-3f5b4424800e None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:10.976943 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad010c92-5a26-41ca-a0f1-f324f3f99b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:10.978389 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad010c92-5a26-41ca-a0f1-f324f3f99b3e None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:10.978669 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad010c92-5a26-41ca-a0f1-f324f3f99b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:10.979023 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad010c92-5a26-41ca-a0f1-f324f3f99b3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:10.990893 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad010c92-5a26-41ca-a0f1-f324f3f99b3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:10.992342 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad010c92-5a26-41ca-a0f1-f324f3f99b3e None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:11.009018 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-ad010c92-5a26-41ca-a0f1-f324f3f99b3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:11.010228 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 291/569] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:11.011496 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a21ef-71cb-4e44-b9cb-bff1d681a707 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:11.011796 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a21ef-71cb-4e44-b9cb-bff1d681a707 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:11.012072 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a21ef-71cb-4e44-b9cb-bff1d681a707 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:11.014826 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 292/570] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:11.014826 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a21ef-71cb-4e44-b9cb-bff1d681a707 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:11.021502 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d78a1-57c5-41c9-bde8-07de8d345be3 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:11.053890 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8a9b7-3387-44c6-bd23-addffefc33e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:11.054554 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8a9b7-3387-44c6-bd23-addffefc33e2 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:11.054843 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8a9b7-3387-44c6-bd23-addffefc33e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:11.055122 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8a9b7-3387-44c6-bd23-addffefc33e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:11.056512 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8a9b7-3387-44c6-bd23-addffefc33e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:11.056912 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8a9b7-3387-44c6-bd23-addffefc33e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:11.058325 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8a9b7-3387-44c6-bd23-addffefc33e2 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:11.070422 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 279/571] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Mar 29 20:02:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:11.070422 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8a9b7-3387-44c6-bd23-addffefc33e2 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:11.112640 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a21ef-71cb-4e44-b9cb-bff1d681a707 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:11.145073 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a7f96-4bdf-4278-92c0-362ecf087122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:11.145757 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a7f96-4bdf-4278-92c0-362ecf087122 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:11.146047 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a7f96-4bdf-4278-92c0-362ecf087122 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:11.146330 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a7f96-4bdf-4278-92c0-362ecf087122 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:11.147149 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a7f96-4bdf-4278-92c0-362ecf087122 None admin] RBAC: Adding query filter params (role.id=04bfd9a52ca84b2db7f73121d5e57b41, scope.project.id=ec1f2c5cb900473da1083830387e3ff4, user.id=9d6d8e7788494f2c92ad5c183c8fa283) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:11.147466 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a7f96-4bdf-4278-92c0-362ecf087122 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:11.148913 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a7f96-4bdf-4278-92c0-362ecf087122 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:11.154426 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 293/572] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:02:11 2022] GET /identity/v3/role_assignments?user.id=9d6d8e7788494f2c92ad5c183c8fa283&scope.project.id=ec1f2c5cb900473da1083830387e3ff4&role.id=04bfd9a52ca84b2db7f73121d5e57b41 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:11.155198 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a7f96-4bdf-4278-92c0-362ecf087122 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:11.161902 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8a9b7-3387-44c6-bd23-addffefc33e2 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:11.201080 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51443e6a-ebcf-48a6-bf70-7add8f062c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:11.201798 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51443e6a-ebcf-48a6-bf70-7add8f062c95 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:11.202084 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51443e6a-ebcf-48a6-bf70-7add8f062c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:11.202366 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51443e6a-ebcf-48a6-bf70-7add8f062c95 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:11.203128 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51443e6a-ebcf-48a6-bf70-7add8f062c95 None admin] RBAC: Adding query filter params (name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:11.203441 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51443e6a-ebcf-48a6-bf70-7add8f062c95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:11.204837 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51443e6a-ebcf-48a6-bf70-7add8f062c95 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:11.218404 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 280/573] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Mar 29 20:02:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:11.218404 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd31095-d7d9-4789-b132-1d6a7dd9c666 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:11.218404 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd31095-d7d9-4789-b132-1d6a7dd9c666 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:11.218404 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd31095-d7d9-4789-b132-1d6a7dd9c666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:11.235422 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-fdd31095-d7d9-4789-b132-1d6a7dd9c666 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:11.236662 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-fdd31095-d7d9-4789-b132-1d6a7dd9c666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:11.270915 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a7f96-4bdf-4278-92c0-362ecf087122 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:11.308501 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2dd6d-cd3c-449d-a871-f25af1247ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:11.309185 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2dd6d-cd3c-449d-a871-f25af1247ffe None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:11.309502 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2dd6d-cd3c-449d-a871-f25af1247ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:11.309783 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2dd6d-cd3c-449d-a871-f25af1247ffe None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:11.310520 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2dd6d-cd3c-449d-a871-f25af1247ffe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:11.310830 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2dd6d-cd3c-449d-a871-f25af1247ffe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:11.321400 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 281/574] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:02:11.321400 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd31095-d7d9-4789-b132-1d6a7dd9c666 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:11.321705 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2dd6d-cd3c-449d-a871-f25af1247ffe None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:11.337371 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 294/575] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:11.339021 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2dd6d-cd3c-449d-a871-f25af1247ffe None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:11.416881 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd31095-d7d9-4789-b132-1d6a7dd9c666 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:11.442403 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2dd6d-cd3c-449d-a871-f25af1247ffe None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:11.452301 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbba076-cf23-4c9e-b9cd-479edb831245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:11.453303 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbba076-cf23-4c9e-b9cd-479edb831245 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:11.453617 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbba076-cf23-4c9e-b9cd-479edb831245 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:11.453898 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbba076-cf23-4c9e-b9cd-479edb831245 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:11.464867 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbba076-cf23-4c9e-b9cd-479edb831245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:11.466353 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbba076-cf23-4c9e-b9cd-479edb831245 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:11.479675 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93627009-2711-4120-8116-1f4db2b3e206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:11.480477 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93627009-2711-4120-8116-1f4db2b3e206 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:11.480763 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93627009-2711-4120-8116-1f4db2b3e206 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:11.481042 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93627009-2711-4120-8116-1f4db2b3e206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:11.483054 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-5cbba076-cf23-4c9e-b9cd-479edb831245 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:11.488674 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 282/576] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:11.488674 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbba076-cf23-4c9e-b9cd-479edb831245 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:11.492687 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93627009-2711-4120-8116-1f4db2b3e206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:11.495300 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93627009-2711-4120-8116-1f4db2b3e206 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:11.515084 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-93627009-2711-4120-8116-1f4db2b3e206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:11.516320 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 295/577] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:11.517103 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93627009-2711-4120-8116-1f4db2b3e206 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:11.588605 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbba076-cf23-4c9e-b9cd-479edb831245 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:11.614576 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93627009-2711-4120-8116-1f4db2b3e206 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:11.621797 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c81ccf-5af0-45da-abf8-a2b4c12d18b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:11.622595 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c81ccf-5af0-45da-abf8-a2b4c12d18b9 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:11.622884 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c81ccf-5af0-45da-abf8-a2b4c12d18b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:11.623171 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c81ccf-5af0-45da-abf8-a2b4c12d18b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:11.633335 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c81ccf-5af0-45da-abf8-a2b4c12d18b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:11.640429 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-53c81ccf-5af0-45da-abf8-a2b4c12d18b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 20:02:11.641633 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 283/578] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Mar 29 20:02:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:11.642397 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c81ccf-5af0-45da-abf8-a2b4c12d18b9 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:11.654494 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1373998-27a0-43b0-b058-c43413a7721f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:11.655376 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1373998-27a0-43b0-b058-c43413a7721f None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:11.655662 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1373998-27a0-43b0-b058-c43413a7721f None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:11.655936 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1373998-27a0-43b0-b058-c43413a7721f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:11.663010 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1373998-27a0-43b0-b058-c43413a7721f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:11.664444 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1373998-27a0-43b0-b058-c43413a7721f None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:11.680321 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-e1373998-27a0-43b0-b058-c43413a7721f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:11.681707 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 296/579] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:11.682809 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1373998-27a0-43b0-b058-c43413a7721f None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:11.752395 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c81ccf-5af0-45da-abf8-a2b4c12d18b9 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:11.781270 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1373998-27a0-43b0-b058-c43413a7721f None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:11.785741 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184ee67-e884-40b9-9fd2-c9260d6113c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:11.786588 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184ee67-e884-40b9-9fd2-c9260d6113c3 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:11.787020 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184ee67-e884-40b9-9fd2-c9260d6113c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:11.787432 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184ee67-e884-40b9-9fd2-c9260d6113c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:11.788293 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184ee67-e884-40b9-9fd2-c9260d6113c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:11.788759 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184ee67-e884-40b9-9fd2-c9260d6113c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:11.790976 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184ee67-e884-40b9-9fd2-c9260d6113c3 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:11.803245 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 284/580] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:11.804352 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184ee67-e884-40b9-9fd2-c9260d6113c3 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:11.818970 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16926e75-ed06-44d8-9fc1-99166ffe5b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:11.819700 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16926e75-ed06-44d8-9fc1-99166ffe5b08 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:11.819981 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16926e75-ed06-44d8-9fc1-99166ffe5b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:11.820260 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16926e75-ed06-44d8-9fc1-99166ffe5b08 None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:11.820968 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16926e75-ed06-44d8-9fc1-99166ffe5b08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:11.822259 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16926e75-ed06-44d8-9fc1-99166ffe5b08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:11.823474 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16926e75-ed06-44d8-9fc1-99166ffe5b08 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:11.834962 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 297/581] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:11.835748 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16926e75-ed06-44d8-9fc1-99166ffe5b08 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:11.905512 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184ee67-e884-40b9-9fd2-c9260d6113c3 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:11.938762 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45fa91-6307-4c7f-989e-9bbc1e500293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:11.939446 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45fa91-6307-4c7f-989e-9bbc1e500293 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:11.939733 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45fa91-6307-4c7f-989e-9bbc1e500293 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:11.940018 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45fa91-6307-4c7f-989e-9bbc1e500293 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:11.940810 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45fa91-6307-4c7f-989e-9bbc1e500293 None admin] RBAC: Adding query filter params (name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:11.941124 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45fa91-6307-4c7f-989e-9bbc1e500293 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:11.942064 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16926e75-ed06-44d8-9fc1-99166ffe5b08 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:11.942533 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45fa91-6307-4c7f-989e-9bbc1e500293 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:11.953335 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 285/582] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Mar 29 20:02:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:11.953335 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45fa91-6307-4c7f-989e-9bbc1e500293 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:11.984524 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f01ff-f51a-442f-9bd9-bbbf5d321e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:11.985222 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f01ff-f51a-442f-9bd9-bbbf5d321e4d None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:11.985529 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f01ff-f51a-442f-9bd9-bbbf5d321e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:11.985807 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f01ff-f51a-442f-9bd9-bbbf5d321e4d None admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:11.986581 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f01ff-f51a-442f-9bd9-bbbf5d321e4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:11.986889 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f01ff-f51a-442f-9bd9-bbbf5d321e4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:11.988325 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f01ff-f51a-442f-9bd9-bbbf5d321e4d None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:12.004837 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 298/583] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:12.004837 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f01ff-f51a-442f-9bd9-bbbf5d321e4d None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:12.056669 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45fa91-6307-4c7f-989e-9bbc1e500293 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:12.092047 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab15c8d-d654-4ac6-be57-0d9ff22da43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:12.092832 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab15c8d-d654-4ac6-be57-0d9ff22da43b None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:12.093112 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab15c8d-d654-4ac6-be57-0d9ff22da43b None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:12.093416 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab15c8d-d654-4ac6-be57-0d9ff22da43b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:12.101382 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab15c8d-d654-4ac6-be57-0d9ff22da43b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:12.102779 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f01ff-f51a-442f-9bd9-bbbf5d321e4d None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:12.102901 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab15c8d-d654-4ac6-be57-0d9ff22da43b None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:12.120403 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-bab15c8d-d654-4ac6-be57-0d9ff22da43b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 29 20:02:12.126067 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 286/584] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:02:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:12.126067 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab15c8d-d654-4ac6-be57-0d9ff22da43b None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:12.140485 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c80e0-ed28-4963-87d2-a671a5a1f9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:12.141314 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c80e0-ed28-4963-87d2-a671a5a1f9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:12.141610 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c80e0-ed28-4963-87d2-a671a5a1f9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:12.141891 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c80e0-ed28-4963-87d2-a671a5a1f9c4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:12.150144 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c80e0-ed28-4963-87d2-a671a5a1f9c4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:12.151877 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c80e0-ed28-4963-87d2-a671a5a1f9c4 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:12.165400 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-362c80e0-ed28-4963-87d2-a671a5a1f9c4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 29 20:02:12.171166 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 299/585] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Mar 29 20:02:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:12.171166 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c80e0-ed28-4963-87d2-a671a5a1f9c4 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:12.229578 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab15c8d-d654-4ac6-be57-0d9ff22da43b None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:12.263070 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5cc0a-d962-473e-a130-299315022982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:12.263862 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5cc0a-d962-473e-a130-299315022982 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:12.264150 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5cc0a-d962-473e-a130-299315022982 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:12.264547 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5cc0a-d962-473e-a130-299315022982 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:12.267414 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c80e0-ed28-4963-87d2-a671a5a1f9c4 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:12.275454 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c5cc0a-d962-473e-a130-299315022982 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:12.276907 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c5cc0a-d962-473e-a130-299315022982 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:12.295012 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-53c5cc0a-d962-473e-a130-299315022982 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:12.300954 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 287/586] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:12.300954 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5cc0a-d962-473e-a130-299315022982 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:12.309837 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf30e81-ff76-42b6-bf36-5aac5a1d2382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:12.311304 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf30e81-ff76-42b6-bf36-5aac5a1d2382 None admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:12.311599 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf30e81-ff76-42b6-bf36-5aac5a1d2382 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:12.311877 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf30e81-ff76-42b6-bf36-5aac5a1d2382 None admin] PATH_INFO: `/v3/projects/ec1f2c5cb900473da1083830387e3ff4/users/b797e15939694c9abf1f2b8e9aee4d67/roles/04bfd9a52ca84b2db7f73121d5e57b41` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:12.327892 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf30e81-ff76-42b6-bf36-5aac5a1d2382 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec1f2c5cb900473da1083830387e3ff4, user_id=b797e15939694c9abf1f2b8e9aee4d67, role_id=04bfd9a52ca84b2db7f73121d5e57b41)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:12.329352 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf30e81-ff76-42b6-bf36-5aac5a1d2382 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:12.393939 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5cc0a-d962-473e-a130-299315022982 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:12.408339 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 300/587] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Mar 29 20:02:12 2022] PUT /identity/v3/projects/ec1f2c5cb900473da1083830387e3ff4/users/b797e15939694c9abf1f2b8e9aee4d67/roles/04bfd9a52ca84b2db7f73121d5e57b41 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:02:12.414331 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf30e81-ff76-42b6-bf36-5aac5a1d2382 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:12.440077 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d001e-4682-41ea-af29-c3605bb850a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:12.441076 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d001e-4682-41ea-af29-c3605bb850a1 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:12.441538 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d001e-4682-41ea-af29-c3605bb850a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:12.441965 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d001e-4682-41ea-af29-c3605bb850a1 None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:12.443034 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d001e-4682-41ea-af29-c3605bb850a1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:12.443503 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d001e-4682-41ea-af29-c3605bb850a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:12.445199 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d001e-4682-41ea-af29-c3605bb850a1 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:12.466880 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 288/588] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Mar 29 20:02:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:12.468037 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d001e-4682-41ea-af29-c3605bb850a1 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:12.556491 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf30e81-ff76-42b6-bf36-5aac5a1d2382 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:12.578616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d001e-4682-41ea-af29-c3605bb850a1 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:12.597191 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785ac9c-e9fc-4a60-a484-e3e23ac649a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:12.598060 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785ac9c-e9fc-4a60-a484-e3e23ac649a3 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:12.598419 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785ac9c-e9fc-4a60-a484-e3e23ac649a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:12.599356 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785ac9c-e9fc-4a60-a484-e3e23ac649a3 None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:12.599678 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785ac9c-e9fc-4a60-a484-e3e23ac649a3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:12.600062 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785ac9c-e9fc-4a60-a484-e3e23ac649a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:12.601593 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785ac9c-e9fc-4a60-a484-e3e23ac649a3 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:12.617079 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075ea0b-31d9-4adf-9922-7ce02fdd9c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:12.618127 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075ea0b-31d9-4adf-9922-7ce02fdd9c07 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:12.618589 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075ea0b-31d9-4adf-9922-7ce02fdd9c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:12.619030 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075ea0b-31d9-4adf-9922-7ce02fdd9c07 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:12.619910 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075ea0b-31d9-4adf-9922-7ce02fdd9c07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:12.620379 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075ea0b-31d9-4adf-9922-7ce02fdd9c07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:12.621947 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075ea0b-31d9-4adf-9922-7ce02fdd9c07 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:12.622253 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 301/589] 10.222.0.43 () {56 vars in 1139 bytes} [Tue Mar 29 20:02:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:12.623335 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785ac9c-e9fc-4a60-a484-e3e23ac649a3 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:12.634964 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 289/590] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:12.635862 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075ea0b-31d9-4adf-9922-7ce02fdd9c07 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:12.728551 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785ac9c-e9fc-4a60-a484-e3e23ac649a3 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:12.742456 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075ea0b-31d9-4adf-9922-7ce02fdd9c07 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:12.763033 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc5d92-24a5-4a5a-9986-b318c6c3217f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:12.763842 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc5d92-24a5-4a5a-9986-b318c6c3217f None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:12.764124 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc5d92-24a5-4a5a-9986-b318c6c3217f None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:12.764402 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc5d92-24a5-4a5a-9986-b318c6c3217f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:12.776675 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc5d92-24a5-4a5a-9986-b318c6c3217f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:12.777109 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0444d9-4d79-453b-87eb-11df75f8396c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:12.777954 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0444d9-4d79-453b-87eb-11df75f8396c None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:12.778154 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc5d92-24a5-4a5a-9986-b318c6c3217f None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:12.778257 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0444d9-4d79-453b-87eb-11df75f8396c None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:12.778505 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0444d9-4d79-453b-87eb-11df75f8396c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:12.789469 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0444d9-4d79-453b-87eb-11df75f8396c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:12.791483 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0444d9-4d79-453b-87eb-11df75f8396c None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:12.796128 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-d9cc5d92-24a5-4a5a-9986-b318c6c3217f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:12.797718 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 302/591] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:12.798527 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc5d92-24a5-4a5a-9986-b318c6c3217f None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:12.808598 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-5d0444d9-4d79-453b-87eb-11df75f8396c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:12.810046 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 290/592] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:12.810842 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0444d9-4d79-453b-87eb-11df75f8396c None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:12.907440 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc5d92-24a5-4a5a-9986-b318c6c3217f None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:12.933687 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0444d9-4d79-453b-87eb-11df75f8396c None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:12.942891 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2074b-4b71-4357-996f-a406518b1b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:12.943707 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2074b-4b71-4357-996f-a406518b1b90 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:12.943992 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2074b-4b71-4357-996f-a406518b1b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:12.944272 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2074b-4b71-4357-996f-a406518b1b90 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:12.954776 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2074b-4b71-4357-996f-a406518b1b90 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:12.956250 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2074b-4b71-4357-996f-a406518b1b90 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:12.968916 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28587d13-e9b9-4908-99ac-73175a27d6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:12.969632 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28587d13-e9b9-4908-99ac-73175a27d6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:12.969922 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28587d13-e9b9-4908-99ac-73175a27d6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:12.970288 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28587d13-e9b9-4908-99ac-73175a27d6c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:12.971018 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28587d13-e9b9-4908-99ac-73175a27d6c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:12.971335 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28587d13-e9b9-4908-99ac-73175a27d6c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:12.971901 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-13d2074b-4b71-4357-996f-a406518b1b90 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 29 20:02:12.972761 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28587d13-e9b9-4908-99ac-73175a27d6c6 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:12.973588 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 303/593] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:02:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:12.974442 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2074b-4b71-4357-996f-a406518b1b90 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:12.990658 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 291/594] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:12.991522 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28587d13-e9b9-4908-99ac-73175a27d6c6 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:13.076732 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2074b-4b71-4357-996f-a406518b1b90 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:13.092956 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28587d13-e9b9-4908-99ac-73175a27d6c6 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:13.110909 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e65634-426b-48d7-b410-2e24c464ba0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:13.111596 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e65634-426b-48d7-b410-2e24c464ba0f None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:13.112313 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e65634-426b-48d7-b410-2e24c464ba0f None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:13.112313 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e65634-426b-48d7-b410-2e24c464ba0f None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:13.112868 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e65634-426b-48d7-b410-2e24c464ba0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:13.113176 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e65634-426b-48d7-b410-2e24c464ba0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:13.114583 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e65634-426b-48d7-b410-2e24c464ba0f None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:13.128197 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e4482-aea6-4b50-bee9-20d8baf5125e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:13.128876 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e4482-aea6-4b50-bee9-20d8baf5125e None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:13.129226 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e4482-aea6-4b50-bee9-20d8baf5125e None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:13.129538 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e4482-aea6-4b50-bee9-20d8baf5125e None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:13.130383 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e4482-aea6-4b50-bee9-20d8baf5125e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:13.130697 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e4482-aea6-4b50-bee9-20d8baf5125e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:13.131705 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 304/595] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:13.132214 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e4482-aea6-4b50-bee9-20d8baf5125e None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:13.132661 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e65634-426b-48d7-b410-2e24c464ba0f None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:13.161407 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 292/596] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Mar 29 20:02:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:13.162517 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e4482-aea6-4b50-bee9-20d8baf5125e None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:13.243049 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e65634-426b-48d7-b410-2e24c464ba0f None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:13.277717 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737b2ad-265b-4c4e-bda5-21a780b781dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:13.278520 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737b2ad-265b-4c4e-bda5-21a780b781dd None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:13.278805 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737b2ad-265b-4c4e-bda5-21a780b781dd None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:13.279083 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737b2ad-265b-4c4e-bda5-21a780b781dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:13.286096 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737b2ad-265b-4c4e-bda5-21a780b781dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:13.287544 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737b2ad-265b-4c4e-bda5-21a780b781dd None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:13.295448 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e4482-aea6-4b50-bee9-20d8baf5125e None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:13.302354 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-8737b2ad-265b-4c4e-bda5-21a780b781dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:13.303905 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 305/597] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:13.304759 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737b2ad-265b-4c4e-bda5-21a780b781dd None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:13.338362 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76f8ab-a7d9-4b91-a41f-189b720fe6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:13.340444 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76f8ab-a7d9-4b91-a41f-189b720fe6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:13.340950 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76f8ab-a7d9-4b91-a41f-189b720fe6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:13.341485 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76f8ab-a7d9-4b91-a41f-189b720fe6d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:13.350202 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76f8ab-a7d9-4b91-a41f-189b720fe6d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:13.353102 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76f8ab-a7d9-4b91-a41f-189b720fe6d0 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:13.370290 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-ad76f8ab-a7d9-4b91-a41f-189b720fe6d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:13.371408 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 293/598] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:13.376884 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76f8ab-a7d9-4b91-a41f-189b720fe6d0 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:13.420115 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737b2ad-265b-4c4e-bda5-21a780b781dd None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:13.464094 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfeb22-a116-4440-9ba5-cf879f3824b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:13.465683 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfeb22-a116-4440-9ba5-cf879f3824b9 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:13.466322 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfeb22-a116-4440-9ba5-cf879f3824b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:13.466884 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfeb22-a116-4440-9ba5-cf879f3824b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:13.478931 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76f8ab-a7d9-4b91-a41f-189b720fe6d0 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:13.480378 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cfeb22-a116-4440-9ba5-cf879f3824b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:13.483046 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cfeb22-a116-4440-9ba5-cf879f3824b9 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:13.504111 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-48cfeb22-a116-4440-9ba5-cf879f3824b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:13.510730 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 306/599] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:13.510730 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfeb22-a116-4440-9ba5-cf879f3824b9 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:13.524083 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2c25e-c221-4879-bb21-6750fbf7fff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:13.524787 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2c25e-c221-4879-bb21-6750fbf7fff2 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:13.525075 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2c25e-c221-4879-bb21-6750fbf7fff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:13.525400 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2c25e-c221-4879-bb21-6750fbf7fff2 None admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:13.526200 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f2c25e-c221-4879-bb21-6750fbf7fff2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:13.526516 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f2c25e-c221-4879-bb21-6750fbf7fff2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:13.527952 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f2c25e-c221-4879-bb21-6750fbf7fff2 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:13.540644 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 294/600] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:13.541486 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2c25e-c221-4879-bb21-6750fbf7fff2 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:13.615874 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfeb22-a116-4440-9ba5-cf879f3824b9 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:13.643527 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2c25e-c221-4879-bb21-6750fbf7fff2 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:13.651209 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d059801-dc77-4d97-8c32-1a273f889ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:13.652289 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d059801-dc77-4d97-8c32-1a273f889ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:13.652580 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d059801-dc77-4d97-8c32-1a273f889ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:13.652864 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d059801-dc77-4d97-8c32-1a273f889ca1 None admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:13.653687 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d059801-dc77-4d97-8c32-1a273f889ca1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:13.654000 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d059801-dc77-4d97-8c32-1a273f889ca1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:13.655447 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d059801-dc77-4d97-8c32-1a273f889ca1 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:13.672085 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 307/601] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:13.672085 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43adb1-54a3-4064-8abd-9c6c69659ade None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:13.672085 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43adb1-54a3-4064-8abd-9c6c69659ade None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:13.672085 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43adb1-54a3-4064-8abd-9c6c69659ade None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:13.674555 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 308/602] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:13.675327 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43adb1-54a3-4064-8abd-9c6c69659ade None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:13.678326 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f0170-0697-49fb-a2d8-916ada845971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:13.680011 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f0170-0697-49fb-a2d8-916ada845971 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:13.681174 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f0170-0697-49fb-a2d8-916ada845971 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:13.681830 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f0170-0697-49fb-a2d8-916ada845971 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:13.682783 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f0170-0697-49fb-a2d8-916ada845971 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:13.683298 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f0170-0697-49fb-a2d8-916ada845971 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:13.685318 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f0170-0697-49fb-a2d8-916ada845971 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:13.704388 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 295/603] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:13.704388 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f0170-0697-49fb-a2d8-916ada845971 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:13.780835 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43adb1-54a3-4064-8abd-9c6c69659ade None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:13.804108 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f0170-0697-49fb-a2d8-916ada845971 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:13.813451 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab37cd3-7ee2-4e1a-8c14-f37d0ed5e103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:13.814344 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab37cd3-7ee2-4e1a-8c14-f37d0ed5e103 None admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:13.814632 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab37cd3-7ee2-4e1a-8c14-f37d0ed5e103 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:13.814914 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab37cd3-7ee2-4e1a-8c14-f37d0ed5e103 None admin] PATH_INFO: `/v3/projects/ec1f2c5cb900473da1083830387e3ff4/users/0b169395c92c4fbfbbe4fd14a235f81f/roles/04bfd9a52ca84b2db7f73121d5e57b41` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:13.829049 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab37cd3-7ee2-4e1a-8c14-f37d0ed5e103 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec1f2c5cb900473da1083830387e3ff4, user_id=0b169395c92c4fbfbbe4fd14a235f81f, role_id=04bfd9a52ca84b2db7f73121d5e57b41)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:13.830551 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab37cd3-7ee2-4e1a-8c14-f37d0ed5e103 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:13.837266 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc92771-9c09-42a4-bb23-ea275b34baad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:13.838172 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc92771-9c09-42a4-bb23-ea275b34baad None admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:13.838458 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc92771-9c09-42a4-bb23-ea275b34baad None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:13.838735 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc92771-9c09-42a4-bb23-ea275b34baad None admin] PATH_INFO: `/v3/projects/ec1f2c5cb900473da1083830387e3ff4/users/22bdaa02b1b14be3837b337fbf6e0eb5/roles/04bfd9a52ca84b2db7f73121d5e57b41` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:13.853123 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc92771-9c09-42a4-bb23-ea275b34baad None admin] RBAC: Authorizing `identity:create_grant(project_id=ec1f2c5cb900473da1083830387e3ff4, user_id=22bdaa02b1b14be3837b337fbf6e0eb5, role_id=04bfd9a52ca84b2db7f73121d5e57b41)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:13.854669 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc92771-9c09-42a4-bb23-ea275b34baad None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:13.911063 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 309/604] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Mar 29 20:02:13 2022] PUT /identity/v3/projects/ec1f2c5cb900473da1083830387e3ff4/users/0b169395c92c4fbfbbe4fd14a235f81f/roles/04bfd9a52ca84b2db7f73121d5e57b41 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:02:13.912360 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bbeb7-db17-4800-b82c-5bb77b2f2834 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:13.912778 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bbeb7-db17-4800-b82c-5bb77b2f2834 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:13.913199 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bbeb7-db17-4800-b82c-5bb77b2f2834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:13.938897 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-a78bbeb7-db17-4800-b82c-5bb77b2f2834 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:13.942055 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a78bbeb7-db17-4800-b82c-5bb77b2f2834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:13.948173 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 296/605] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Mar 29 20:02:13 2022] PUT /identity/v3/projects/ec1f2c5cb900473da1083830387e3ff4/users/22bdaa02b1b14be3837b337fbf6e0eb5/roles/04bfd9a52ca84b2db7f73121d5e57b41 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:02:13.948173 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc92771-9c09-42a4-bb23-ea275b34baad None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:14.031836 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 310/606] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:02:14.049547 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bbeb7-db17-4800-b82c-5bb77b2f2834 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:14.169386 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc92771-9c09-42a4-bb23-ea275b34baad None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:14.169582 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bbeb7-db17-4800-b82c-5bb77b2f2834 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:14.228940 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a8158-3308-4d88-89ed-65989bdf85d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:14.229796 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a8158-3308-4d88-89ed-65989bdf85d1 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:14.230104 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a8158-3308-4d88-89ed-65989bdf85d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:14.230350 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a8158-3308-4d88-89ed-65989bdf85d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:14.232111 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ab5d1-b528-4568-9896-9574be6caf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:14.233125 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ab5d1-b528-4568-9896-9574be6caf18 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:14.233563 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ab5d1-b528-4568-9896-9574be6caf18 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:14.233942 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ab5d1-b528-4568-9896-9574be6caf18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:14.241317 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ab5d1-b528-4568-9896-9574be6caf18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:14.243179 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ab5d1-b528-4568-9896-9574be6caf18 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:14.244371 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a8158-3308-4d88-89ed-65989bdf85d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:14.252719 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-f77a8158-3308-4d88-89ed-65989bdf85d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 20:02:14.254471 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 311/607] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Mar 29 20:02:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:02:14.256766 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-4e4ab5d1-b528-4568-9896-9574be6caf18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:14.261342 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 297/608] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:14.264877 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a8158-3308-4d88-89ed-65989bdf85d1 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:14.270279 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ab5d1-b528-4568-9896-9574be6caf18 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:14.400884 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ab5d1-b528-4568-9896-9574be6caf18 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:14.446690 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1a171-d29f-4cb4-8e7a-b4a19bb9b8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:14.448157 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1a171-d29f-4cb4-8e7a-b4a19bb9b8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:14.448440 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1a171-d29f-4cb4-8e7a-b4a19bb9b8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:14.448712 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1a171-d29f-4cb4-8e7a-b4a19bb9b8b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:14.449488 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1a171-d29f-4cb4-8e7a-b4a19bb9b8b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:14.449794 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1a171-d29f-4cb4-8e7a-b4a19bb9b8b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:14.451156 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1a171-d29f-4cb4-8e7a-b4a19bb9b8b9 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:14.468538 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a8158-3308-4d88-89ed-65989bdf85d1 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:14.478342 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 298/609] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Mar 29 20:02:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:14.485839 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1a171-d29f-4cb4-8e7a-b4a19bb9b8b9 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:14.566525 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6faa0b-81e7-4803-84a7-474c9804f24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:14.567427 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6faa0b-81e7-4803-84a7-474c9804f24d None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:14.567720 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6faa0b-81e7-4803-84a7-474c9804f24d None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:14.568002 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6faa0b-81e7-4803-84a7-474c9804f24d None admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:14.568794 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6faa0b-81e7-4803-84a7-474c9804f24d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:14.569107 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6faa0b-81e7-4803-84a7-474c9804f24d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:14.570580 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6faa0b-81e7-4803-84a7-474c9804f24d None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:14.591530 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 312/610] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:14.598856 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6faa0b-81e7-4803-84a7-474c9804f24d None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:14.611178 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1a171-d29f-4cb4-8e7a-b4a19bb9b8b9 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:14.654192 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5caca6-91b4-41cd-85ba-43885068346c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:14.654986 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5caca6-91b4-41cd-85ba-43885068346c None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:14.655269 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5caca6-91b4-41cd-85ba-43885068346c None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:14.655544 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5caca6-91b4-41cd-85ba-43885068346c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:14.678370 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5caca6-91b4-41cd-85ba-43885068346c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:14.679808 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5caca6-91b4-41cd-85ba-43885068346c None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:14.709693 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-ab5caca6-91b4-41cd-85ba-43885068346c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:14.711295 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 299/611] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:14.716869 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5caca6-91b4-41cd-85ba-43885068346c None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:14.786308 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6faa0b-81e7-4803-84a7-474c9804f24d None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:14.832321 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90819749-3ae1-437b-9081-617cea086152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:14.833219 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90819749-3ae1-437b-9081-617cea086152 None admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:14.833524 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90819749-3ae1-437b-9081-617cea086152 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:14.833794 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90819749-3ae1-437b-9081-617cea086152 None admin] PATH_INFO: `/v3/projects/ec1f2c5cb900473da1083830387e3ff4/users/1d8ea87a7fd34751896b2a0ffaedab2c/roles/04bfd9a52ca84b2db7f73121d5e57b41` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:14.863185 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90819749-3ae1-437b-9081-617cea086152 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec1f2c5cb900473da1083830387e3ff4, user_id=1d8ea87a7fd34751896b2a0ffaedab2c, role_id=04bfd9a52ca84b2db7f73121d5e57b41)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:14.865678 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90819749-3ae1-437b-9081-617cea086152 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:14.915712 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5caca6-91b4-41cd-85ba-43885068346c None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:14.945209 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 313/612] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Mar 29 20:02:14 2022] PUT /identity/v3/projects/ec1f2c5cb900473da1083830387e3ff4/users/1d8ea87a7fd34751896b2a0ffaedab2c/roles/04bfd9a52ca84b2db7f73121d5e57b41 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:02:14.945209 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0ffc5-017e-4ef2-925a-9c722f34b6cc None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:14.945209 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0ffc5-017e-4ef2-925a-9c722f34b6cc None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:14.945209 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0ffc5-017e-4ef2-925a-9c722f34b6cc None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:14.945209 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 314/613] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:14.959404 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2265a2e-05ac-4731-90ac-799a0ce06791 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:14.959404 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2265a2e-05ac-4731-90ac-799a0ce06791 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:14.959404 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2265a2e-05ac-4731-90ac-799a0ce06791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:14.979533 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8061c-f7a0-4643-8c0b-0cdf457ece8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:14.980176 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8061c-f7a0-4643-8c0b-0cdf457ece8c None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:14.980463 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8061c-f7a0-4643-8c0b-0cdf457ece8c None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:14.980735 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8061c-f7a0-4643-8c0b-0cdf457ece8c None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:14.981546 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8061c-f7a0-4643-8c0b-0cdf457ece8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:14.981856 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8061c-f7a0-4643-8c0b-0cdf457ece8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:14.983267 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8061c-f7a0-4643-8c0b-0cdf457ece8c None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:14.987341 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-d2265a2e-05ac-4731-90ac-799a0ce06791 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:14.988567 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-d2265a2e-05ac-4731-90ac-799a0ce06791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:15.011628 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 300/614] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:15.016561 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8061c-f7a0-4643-8c0b-0cdf457ece8c None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:15.141145 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 315/615] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 20:02:15.185856 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2265a2e-05ac-4731-90ac-799a0ce06791 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:15.198375 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8061c-f7a0-4643-8c0b-0cdf457ece8c None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:15.244710 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1178ca-e878-4246-8d10-72da74b40d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:15.245630 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1178ca-e878-4246-8d10-72da74b40d8e None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:15.245912 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1178ca-e878-4246-8d10-72da74b40d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:15.246186 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1178ca-e878-4246-8d10-72da74b40d8e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:15.253627 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1178ca-e878-4246-8d10-72da74b40d8e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:15.255078 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1178ca-e878-4246-8d10-72da74b40d8e None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:15.269917 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-0a1178ca-e878-4246-8d10-72da74b40d8e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 29 20:02:15.271413 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 301/616] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:02:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:02:15.278033 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1178ca-e878-4246-8d10-72da74b40d8e None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:15.301706 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2265a2e-05ac-4731-90ac-799a0ce06791 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:15.348662 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cad90-299e-4434-bef3-d50b6ef7b6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:15.349492 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cad90-299e-4434-bef3-d50b6ef7b6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:15.349773 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cad90-299e-4434-bef3-d50b6ef7b6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:15.350047 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cad90-299e-4434-bef3-d50b6ef7b6b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:15.361202 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cad90-299e-4434-bef3-d50b6ef7b6b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:15.369418 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-b05cad90-299e-4434-bef3-d50b6ef7b6b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 20:02:15.370929 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 316/617] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Mar 29 20:02:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:02:15.376412 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cad90-299e-4434-bef3-d50b6ef7b6b1 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:15.398034 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1178ca-e878-4246-8d10-72da74b40d8e None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:15.444327 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b2a62-7620-4198-9f61-a34a39bf331b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:15.446199 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b2a62-7620-4198-9f61-a34a39bf331b None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:15.446489 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b2a62-7620-4198-9f61-a34a39bf331b None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:15.446830 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b2a62-7620-4198-9f61-a34a39bf331b None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:15.447878 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b2a62-7620-4198-9f61-a34a39bf331b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:15.448187 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b2a62-7620-4198-9f61-a34a39bf331b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:15.452329 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b2a62-7620-4198-9f61-a34a39bf331b None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:15.490543 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 302/618] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Mar 29 20:02:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:15.497833 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b2a62-7620-4198-9f61-a34a39bf331b None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:15.580120 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cad90-299e-4434-bef3-d50b6ef7b6b1 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:15.617387 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0a2ed-f997-4605-b7a2-fccc291c2dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:15.618765 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0a2ed-f997-4605-b7a2-fccc291c2dcb None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:15.619048 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0a2ed-f997-4605-b7a2-fccc291c2dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:15.619321 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0a2ed-f997-4605-b7a2-fccc291c2dcb None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:15.620089 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0a2ed-f997-4605-b7a2-fccc291c2dcb None admin] RBAC: Adding query filter params (name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:15.620520 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0a2ed-f997-4605-b7a2-fccc291c2dcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:15.622236 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0a2ed-f997-4605-b7a2-fccc291c2dcb None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:15.631019 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 317/619] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Mar 29 20:02:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:15.638072 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0a2ed-f997-4605-b7a2-fccc291c2dcb None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:15.735260 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b2a62-7620-4198-9f61-a34a39bf331b None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:15.747015 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0a2ed-f997-4605-b7a2-fccc291c2dcb None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:15.783817 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc7d78-2d2c-4f2d-9e16-23eac532e5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:15.784582 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc7d78-2d2c-4f2d-9e16-23eac532e5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:15.784868 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc7d78-2d2c-4f2d-9e16-23eac532e5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:15.785144 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc7d78-2d2c-4f2d-9e16-23eac532e5b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:15.798049 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc7d78-2d2c-4f2d-9e16-23eac532e5b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:15.799533 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc7d78-2d2c-4f2d-9e16-23eac532e5b0 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:15.819352 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-84dc7d78-2d2c-4f2d-9e16-23eac532e5b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:15.820909 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 318/620] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:15.826882 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc7d78-2d2c-4f2d-9e16-23eac532e5b0 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:15.830005 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada71522-9d97-485b-858c-4a18f9b94139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:15.830814 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada71522-9d97-485b-858c-4a18f9b94139 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:15.831098 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada71522-9d97-485b-858c-4a18f9b94139 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:15.831377 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada71522-9d97-485b-858c-4a18f9b94139 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:15.854447 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada71522-9d97-485b-858c-4a18f9b94139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:15.855916 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada71522-9d97-485b-858c-4a18f9b94139 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:15.893916 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-ada71522-9d97-485b-858c-4a18f9b94139 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:15.895446 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 303/621] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:15.906280 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada71522-9d97-485b-858c-4a18f9b94139 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:15.940192 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc7d78-2d2c-4f2d-9e16-23eac532e5b0 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:15.976821 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d1e46-0e6b-4552-b265-6543b9563445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:15.977727 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d1e46-0e6b-4552-b265-6543b9563445 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:15.978015 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d1e46-0e6b-4552-b265-6543b9563445 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:15.978293 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d1e46-0e6b-4552-b265-6543b9563445 None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:15.979013 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d1e46-0e6b-4552-b265-6543b9563445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:15.980176 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d1e46-0e6b-4552-b265-6543b9563445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:15.980718 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d1e46-0e6b-4552-b265-6543b9563445 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:15.995763 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 319/622] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:16.002445 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d1e46-0e6b-4552-b265-6543b9563445 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:16.120542 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada71522-9d97-485b-858c-4a18f9b94139 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:16.184585 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778634d-7796-4dad-8446-95900bfd98db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:16.185258 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778634d-7796-4dad-8446-95900bfd98db None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:16.185570 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778634d-7796-4dad-8446-95900bfd98db None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:16.185845 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778634d-7796-4dad-8446-95900bfd98db None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:16.186573 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778634d-7796-4dad-8446-95900bfd98db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:16.186879 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778634d-7796-4dad-8446-95900bfd98db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:16.188256 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778634d-7796-4dad-8446-95900bfd98db None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:16.203689 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 304/623] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:16.205594 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d1e46-0e6b-4552-b265-6543b9563445 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:16.212172 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778634d-7796-4dad-8446-95900bfd98db None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:16.274385 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf27cd3-1261-43bd-8f8c-036e3f5bc63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:16.275412 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf27cd3-1261-43bd-8f8c-036e3f5bc63b None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:16.275693 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf27cd3-1261-43bd-8f8c-036e3f5bc63b None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:16.275970 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf27cd3-1261-43bd-8f8c-036e3f5bc63b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:16.300315 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf27cd3-1261-43bd-8f8c-036e3f5bc63b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:16.304950 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf27cd3-1261-43bd-8f8c-036e3f5bc63b None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:16.337679 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-edf27cd3-1261-43bd-8f8c-036e3f5bc63b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 29 20:02:16.339334 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 320/624] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Mar 29 20:02:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:16.344710 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf27cd3-1261-43bd-8f8c-036e3f5bc63b None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:16.379773 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778634d-7796-4dad-8446-95900bfd98db None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:16.415542 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cc1fc-12c8-421a-8c03-333a05a52ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:16.416559 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cc1fc-12c8-421a-8c03-333a05a52ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:16.416844 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cc1fc-12c8-421a-8c03-333a05a52ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:16.417174 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cc1fc-12c8-421a-8c03-333a05a52ae5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:16.424283 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0cc1fc-12c8-421a-8c03-333a05a52ae5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:16.425816 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0cc1fc-12c8-421a-8c03-333a05a52ae5 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:16.441390 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-cd0cc1fc-12c8-421a-8c03-333a05a52ae5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:16.442927 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 305/625] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:02:16.449168 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cc1fc-12c8-421a-8c03-333a05a52ae5 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:16.551632 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cc1fc-12c8-421a-8c03-333a05a52ae5 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:16.587058 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436e722-0116-4c40-9d71-5d8e09bd1dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:16.587740 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436e722-0116-4c40-9d71-5d8e09bd1dde None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:16.588023 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436e722-0116-4c40-9d71-5d8e09bd1dde None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:16.588300 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436e722-0116-4c40-9d71-5d8e09bd1dde None admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:16.589125 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436e722-0116-4c40-9d71-5d8e09bd1dde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:16.589472 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436e722-0116-4c40-9d71-5d8e09bd1dde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:16.590903 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436e722-0116-4c40-9d71-5d8e09bd1dde None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:16.600873 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf27cd3-1261-43bd-8f8c-036e3f5bc63b None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:16.603233 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 306/626] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:16.608908 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436e722-0116-4c40-9d71-5d8e09bd1dde None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:16.677176 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a3858-ac42-4a91-b4a3-aa4d176f7a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:16.677797 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a3858-ac42-4a91-b4a3-aa4d176f7a46 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:16.678080 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a3858-ac42-4a91-b4a3-aa4d176f7a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:16.678358 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a3858-ac42-4a91-b4a3-aa4d176f7a46 None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:16.679185 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a3858-ac42-4a91-b4a3-aa4d176f7a46 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:16.680682 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a3858-ac42-4a91-b4a3-aa4d176f7a46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:16.681572 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a3858-ac42-4a91-b4a3-aa4d176f7a46 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:16.703848 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 321/627] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Mar 29 20:02:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:16.703848 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79803e-39ab-49c3-b12d-64b9a3156297 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:16.703848 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79803e-39ab-49c3-b12d-64b9a3156297 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:16.703848 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79803e-39ab-49c3-b12d-64b9a3156297 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:16.703848 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 322/628] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:16.704724 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ab9a8-7641-4930-9203-1e580090042e None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:16.705331 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ab9a8-7641-4930-9203-1e580090042e None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:16.705331 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ab9a8-7641-4930-9203-1e580090042e None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:16.707208 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 323/629] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:16.707736 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ab9a8-7641-4930-9203-1e580090042e None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:16.720400 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436e722-0116-4c40-9d71-5d8e09bd1dde None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:16.755715 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee1a03-1b33-420f-9d15-930e3f437e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:16.756593 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee1a03-1b33-420f-9d15-930e3f437e6f None admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:16.756879 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee1a03-1b33-420f-9d15-930e3f437e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:16.757160 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee1a03-1b33-420f-9d15-930e3f437e6f None admin] PATH_INFO: `/v3/projects/ec1f2c5cb900473da1083830387e3ff4/users/9d6d8e7788494f2c92ad5c183c8fa283/roles/04bfd9a52ca84b2db7f73121d5e57b41` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:16.771803 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee1a03-1b33-420f-9d15-930e3f437e6f None admin] RBAC: Authorizing `identity:create_grant(project_id=ec1f2c5cb900473da1083830387e3ff4, user_id=9d6d8e7788494f2c92ad5c183c8fa283, role_id=04bfd9a52ca84b2db7f73121d5e57b41)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:16.773235 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee1a03-1b33-420f-9d15-930e3f437e6f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:16.812411 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ab9a8-7641-4930-9203-1e580090042e None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:16.845196 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95e388-e605-45b6-8c83-3d37f8f2dd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:16.845874 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95e388-e605-45b6-8c83-3d37f8f2dd9a None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:16.846159 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95e388-e605-45b6-8c83-3d37f8f2dd9a None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:16.846438 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95e388-e605-45b6-8c83-3d37f8f2dd9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:16.859382 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 307/630] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Mar 29 20:02:16 2022] PUT /identity/v3/projects/ec1f2c5cb900473da1083830387e3ff4/users/9d6d8e7788494f2c92ad5c183c8fa283/roles/04bfd9a52ca84b2db7f73121d5e57b41 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:02:16.860928 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc2726-83df-4839-9a86-597f165ab493 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:16.861453 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc2726-83df-4839-9a86-597f165ab493 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:16.861930 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc2726-83df-4839-9a86-597f165ab493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:16.888039 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-1ebc2726-83df-4839-9a86-597f165ab493 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:16.889726 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-1ebc2726-83df-4839-9a86-597f165ab493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:16.920145 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95e388-e605-45b6-8c83-3d37f8f2dd9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:16.921662 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95e388-e605-45b6-8c83-3d37f8f2dd9a None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:16.982943 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 308/631] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:02:16.985234 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dededb9-575b-4aa9-be9e-88c1068ccb78 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:16.985981 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dededb9-575b-4aa9-be9e-88c1068ccb78 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:16.986460 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dededb9-575b-4aa9-be9e-88c1068ccb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:17.010032 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-0dededb9-575b-4aa9-be9e-88c1068ccb78 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:17.011548 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-0dededb9-575b-4aa9-be9e-88c1068ccb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:17.041824 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 324/632] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:02:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:02:17.042717 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95e388-e605-45b6-8c83-3d37f8f2dd9a None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:17.103225 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 309/633] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:02:17.104109 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dededb9-575b-4aa9-be9e-88c1068ccb78 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:17.170831 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95e388-e605-45b6-8c83-3d37f8f2dd9a None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:17.208654 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354695f0-3746-459a-8fc0-7ef7d0ff583b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:17.209461 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354695f0-3746-459a-8fc0-7ef7d0ff583b None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:17.209635 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354695f0-3746-459a-8fc0-7ef7d0ff583b None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:17.209905 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354695f0-3746-459a-8fc0-7ef7d0ff583b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:17.220823 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354695f0-3746-459a-8fc0-7ef7d0ff583b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:17.228759 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-354695f0-3746-459a-8fc0-7ef7d0ff583b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 20:02:17.230469 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 325/634] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Mar 29 20:02:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:17.231319 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354695f0-3746-459a-8fc0-7ef7d0ff583b None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:17.240164 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dededb9-575b-4aa9-be9e-88c1068ccb78 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:17.285083 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f316aba-4ed3-4a13-bd8a-bb5f6dab2e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:17.286550 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f316aba-4ed3-4a13-bd8a-bb5f6dab2e54 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:17.287055 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f316aba-4ed3-4a13-bd8a-bb5f6dab2e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:17.287523 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f316aba-4ed3-4a13-bd8a-bb5f6dab2e54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:17.302358 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f316aba-4ed3-4a13-bd8a-bb5f6dab2e54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:17.304864 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f316aba-4ed3-4a13-bd8a-bb5f6dab2e54 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:17.328022 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-9f316aba-4ed3-4a13-bd8a-bb5f6dab2e54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:17.329585 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 310/635] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:17.330505 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f316aba-4ed3-4a13-bd8a-bb5f6dab2e54 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:17.343466 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354695f0-3746-459a-8fc0-7ef7d0ff583b None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:17.387836 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1bafb-9c5f-43f3-8646-1931da073786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:17.389082 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1bafb-9c5f-43f3-8646-1931da073786 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:17.389839 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1bafb-9c5f-43f3-8646-1931da073786 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:17.390516 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1bafb-9c5f-43f3-8646-1931da073786 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:17.406151 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1bafb-9c5f-43f3-8646-1931da073786 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:17.416168 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-6ae1bafb-9c5f-43f3-8646-1931da073786 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 20:02:17.418353 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 326/636] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Mar 29 20:02:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:17.419284 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1bafb-9c5f-43f3-8646-1931da073786 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:17.438830 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f316aba-4ed3-4a13-bd8a-bb5f6dab2e54 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:17.479525 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a288240-56f8-4d3a-9bc9-36a6730eece9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:17.480454 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a288240-56f8-4d3a-9bc9-36a6730eece9 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:17.480880 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a288240-56f8-4d3a-9bc9-36a6730eece9 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:17.481320 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a288240-56f8-4d3a-9bc9-36a6730eece9 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:17.482196 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a288240-56f8-4d3a-9bc9-36a6730eece9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:17.482692 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a288240-56f8-4d3a-9bc9-36a6730eece9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:17.484226 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a288240-56f8-4d3a-9bc9-36a6730eece9 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:17.497661 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 311/637] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Mar 29 20:02:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:17.498881 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a288240-56f8-4d3a-9bc9-36a6730eece9 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:17.526354 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1bafb-9c5f-43f3-8646-1931da073786 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:17.560532 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affffdfc-66cb-417a-9ca4-bb7590301e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:17.561310 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affffdfc-66cb-417a-9ca4-bb7590301e2e None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:17.561689 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affffdfc-66cb-417a-9ca4-bb7590301e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:17.562199 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affffdfc-66cb-417a-9ca4-bb7590301e2e None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:17.562982 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affffdfc-66cb-417a-9ca4-bb7590301e2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:17.563356 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affffdfc-66cb-417a-9ca4-bb7590301e2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:17.564843 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affffdfc-66cb-417a-9ca4-bb7590301e2e None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:17.577625 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 327/638] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:17.578592 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affffdfc-66cb-417a-9ca4-bb7590301e2e None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:17.607572 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a288240-56f8-4d3a-9bc9-36a6730eece9 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:17.643157 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb938375-1a30-4422-8c3b-13951bb77973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:17.644247 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb938375-1a30-4422-8c3b-13951bb77973 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:17.644776 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb938375-1a30-4422-8c3b-13951bb77973 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:17.645275 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb938375-1a30-4422-8c3b-13951bb77973 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:17.646242 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb938375-1a30-4422-8c3b-13951bb77973 None admin] RBAC: Adding query filter params (name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:17.646759 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb938375-1a30-4422-8c3b-13951bb77973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:17.648323 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb938375-1a30-4422-8c3b-13951bb77973 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:17.658460 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 312/639] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Mar 29 20:02:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:17.659645 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb938375-1a30-4422-8c3b-13951bb77973 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:17.678269 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affffdfc-66cb-417a-9ca4-bb7590301e2e None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:17.712993 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2577ddf-3508-4003-bea9-b3a6a48f4719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:17.713900 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2577ddf-3508-4003-bea9-b3a6a48f4719 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:17.714097 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2577ddf-3508-4003-bea9-b3a6a48f4719 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:17.714373 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2577ddf-3508-4003-bea9-b3a6a48f4719 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:17.724740 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2577ddf-3508-4003-bea9-b3a6a48f4719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:17.726144 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2577ddf-3508-4003-bea9-b3a6a48f4719 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:17.744430 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-e2577ddf-3508-4003-bea9-b3a6a48f4719 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:17.749982 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 328/640] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:17.749982 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2577ddf-3508-4003-bea9-b3a6a48f4719 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:17.774324 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb938375-1a30-4422-8c3b-13951bb77973 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:17.813215 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674f75a-56af-4b81-af8a-76fb706362cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:17.814274 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674f75a-56af-4b81-af8a-76fb706362cb None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:17.814554 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674f75a-56af-4b81-af8a-76fb706362cb None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:17.816919 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674f75a-56af-4b81-af8a-76fb706362cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:17.825745 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674f75a-56af-4b81-af8a-76fb706362cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:17.827180 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674f75a-56af-4b81-af8a-76fb706362cb None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:17.841883 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-7674f75a-56af-4b81-af8a-76fb706362cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:17.846453 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 313/641] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:17.846453 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674f75a-56af-4b81-af8a-76fb706362cb None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:17.855564 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2577ddf-3508-4003-bea9-b3a6a48f4719 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:17.889027 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69423d-7f7a-4f70-8632-516cb71aaccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:17.889859 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69423d-7f7a-4f70-8632-516cb71aaccc None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:17.890145 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69423d-7f7a-4f70-8632-516cb71aaccc None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:17.890427 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69423d-7f7a-4f70-8632-516cb71aaccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:17.900891 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69423d-7f7a-4f70-8632-516cb71aaccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:17.902383 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69423d-7f7a-4f70-8632-516cb71aaccc None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:17.919765 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-ae69423d-7f7a-4f70-8632-516cb71aaccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:17.925320 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 329/642] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:17.925320 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b336af7-5518-4726-92a9-a30b5e7c9ae1 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:17.925320 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b336af7-5518-4726-92a9-a30b5e7c9ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:17.925320 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b336af7-5518-4726-92a9-a30b5e7c9ae1 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:17.935747 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 330/643] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:17.935747 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b336af7-5518-4726-92a9-a30b5e7c9ae1 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:17.955090 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674f75a-56af-4b81-af8a-76fb706362cb None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:17.988633 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c21771-18aa-420c-a965-22010e031b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:17.989271 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c21771-18aa-420c-a965-22010e031b6c None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:17.989591 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c21771-18aa-420c-a965-22010e031b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:17.989870 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c21771-18aa-420c-a965-22010e031b6c None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:17.990588 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c21771-18aa-420c-a965-22010e031b6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:17.990897 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c21771-18aa-420c-a965-22010e031b6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:17.992265 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c21771-18aa-420c-a965-22010e031b6c None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:18.003145 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 314/644] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:18.003858 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c21771-18aa-420c-a965-22010e031b6c None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:18.045623 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b336af7-5518-4726-92a9-a30b5e7c9ae1 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:18.079838 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c8994-cf0a-45de-9ed3-1ffee8820ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:18.080496 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c8994-cf0a-45de-9ed3-1ffee8820ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:18.080779 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c8994-cf0a-45de-9ed3-1ffee8820ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:18.081055 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c8994-cf0a-45de-9ed3-1ffee8820ac8 None admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:18.081857 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c8994-cf0a-45de-9ed3-1ffee8820ac8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:18.082168 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c8994-cf0a-45de-9ed3-1ffee8820ac8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:18.083586 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c8994-cf0a-45de-9ed3-1ffee8820ac8 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:18.095992 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 331/645] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:18.097246 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b7d7d-3c40-4bc2-a871-c070ac9b707e None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:18.097566 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b7d7d-3c40-4bc2-a871-c070ac9b707e None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:18.097843 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b7d7d-3c40-4bc2-a871-c070ac9b707e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:18.110168 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c21771-18aa-420c-a965-22010e031b6c None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:18.115214 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-bb5b7d7d-3c40-4bc2-a871-c070ac9b707e None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:18.116421 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-bb5b7d7d-3c40-4bc2-a871-c070ac9b707e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:18.145272 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42752630-0c43-42f5-b235-dd4d8cf9d9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:18.145954 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42752630-0c43-42f5-b235-dd4d8cf9d9db None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:18.146235 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42752630-0c43-42f5-b235-dd4d8cf9d9db None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:18.146512 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42752630-0c43-42f5-b235-dd4d8cf9d9db None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:18.147229 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42752630-0c43-42f5-b235-dd4d8cf9d9db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:18.147535 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42752630-0c43-42f5-b235-dd4d8cf9d9db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:18.148968 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42752630-0c43-42f5-b235-dd4d8cf9d9db None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:18.164689 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 315/646] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:18.164689 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42752630-0c43-42f5-b235-dd4d8cf9d9db None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:18.188194 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 332/647] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:02:18.190202 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b7d7d-3c40-4bc2-a871-c070ac9b707e None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:18.269281 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42752630-0c43-42f5-b235-dd4d8cf9d9db None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:18.291419 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b7d7d-3c40-4bc2-a871-c070ac9b707e None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:18.302025 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a48ef-7ef2-445d-8ed4-3b73d1d4477e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:18.302815 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a48ef-7ef2-445d-8ed4-3b73d1d4477e None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:18.303102 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a48ef-7ef2-445d-8ed4-3b73d1d4477e None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:18.303381 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a48ef-7ef2-445d-8ed4-3b73d1d4477e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:18.310947 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a48ef-7ef2-445d-8ed4-3b73d1d4477e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:18.312379 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a48ef-7ef2-445d-8ed4-3b73d1d4477e None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:18.325019 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356fc3ed-788e-4784-8e7b-8c7c8d4f1236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:18.325707 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fc3ed-788e-4784-8e7b-8c7c8d4f1236 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:18.325996 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fc3ed-788e-4784-8e7b-8c7c8d4f1236 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:18.326280 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fc3ed-788e-4784-8e7b-8c7c8d4f1236 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:18.326527 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-fa1a48ef-7ef2-445d-8ed4-3b73d1d4477e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 29 20:02:18.327112 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356fc3ed-788e-4784-8e7b-8c7c8d4f1236 None admin] RBAC: Adding query filter params (role.id=04bfd9a52ca84b2db7f73121d5e57b41, scope.project.id=ec1f2c5cb900473da1083830387e3ff4, user.id=b797e15939694c9abf1f2b8e9aee4d67) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:18.327431 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356fc3ed-788e-4784-8e7b-8c7c8d4f1236 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:18.327851 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 316/648] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:02:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:18.328441 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a48ef-7ef2-445d-8ed4-3b73d1d4477e None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:18.333530 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356fc3ed-788e-4784-8e7b-8c7c8d4f1236 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:18.340284 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 333/649] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:02:18 2022] GET /identity/v3/role_assignments?user.id=b797e15939694c9abf1f2b8e9aee4d67&scope.project.id=ec1f2c5cb900473da1083830387e3ff4&role.id=04bfd9a52ca84b2db7f73121d5e57b41 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:18.341055 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356fc3ed-788e-4784-8e7b-8c7c8d4f1236 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:18.449865 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356fc3ed-788e-4784-8e7b-8c7c8d4f1236 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:18.459354 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a48ef-7ef2-445d-8ed4-3b73d1d4477e None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:18.487457 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe323e2-71c2-4d2f-af19-07ef7d7cbd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:18.488379 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe323e2-71c2-4d2f-af19-07ef7d7cbd80 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:18.488678 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe323e2-71c2-4d2f-af19-07ef7d7cbd80 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:18.488952 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe323e2-71c2-4d2f-af19-07ef7d7cbd80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:18.499255 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3db7ce-d6a3-4240-a7b0-aa8d81f0c1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:18.500448 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3db7ce-d6a3-4240-a7b0-aa8d81f0c1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:18.500915 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe323e2-71c2-4d2f-af19-07ef7d7cbd80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:18.501161 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3db7ce-d6a3-4240-a7b0-aa8d81f0c1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:18.501670 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3db7ce-d6a3-4240-a7b0-aa8d81f0c1d2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:18.508823 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-6fe323e2-71c2-4d2f-af19-07ef7d7cbd80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 20:02:18.510994 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3db7ce-d6a3-4240-a7b0-aa8d81f0c1d2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:18.512701 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3db7ce-d6a3-4240-a7b0-aa8d81f0c1d2 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:18.515171 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 334/650] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Mar 29 20:02:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:18.516431 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe323e2-71c2-4d2f-af19-07ef7d7cbd80 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:18.528720 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-ea3db7ce-d6a3-4240-a7b0-aa8d81f0c1d2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 29 20:02:18.530620 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 317/651] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Mar 29 20:02:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:18.531625 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3db7ce-d6a3-4240-a7b0-aa8d81f0c1d2 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:18.620235 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe323e2-71c2-4d2f-af19-07ef7d7cbd80 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:18.655320 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225d2f3-38e6-4b7e-b92b-5170916133d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:18.657385 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225d2f3-38e6-4b7e-b92b-5170916133d9 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:18.657873 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225d2f3-38e6-4b7e-b92b-5170916133d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:18.658349 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225d2f3-38e6-4b7e-b92b-5170916133d9 None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:18.659377 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225d2f3-38e6-4b7e-b92b-5170916133d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:18.659876 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225d2f3-38e6-4b7e-b92b-5170916133d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:18.661359 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225d2f3-38e6-4b7e-b92b-5170916133d9 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:18.663398 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3db7ce-d6a3-4240-a7b0-aa8d81f0c1d2 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:18.680121 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 335/652] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Mar 29 20:02:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:18.680986 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225d2f3-38e6-4b7e-b92b-5170916133d9 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:18.704628 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcaa1aa-7680-4246-935d-d0e066d0c753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:18.705741 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaa1aa-7680-4246-935d-d0e066d0c753 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:18.706262 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaa1aa-7680-4246-935d-d0e066d0c753 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:18.706744 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaa1aa-7680-4246-935d-d0e066d0c753 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:18.707728 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcaa1aa-7680-4246-935d-d0e066d0c753 None admin] RBAC: Adding query filter params (name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:18.708255 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcaa1aa-7680-4246-935d-d0e066d0c753 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:18.709972 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcaa1aa-7680-4246-935d-d0e066d0c753 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:18.719251 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 318/653] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Mar 29 20:02:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:18.720404 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcaa1aa-7680-4246-935d-d0e066d0c753 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:18.781759 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225d2f3-38e6-4b7e-b92b-5170916133d9 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:18.817154 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffbbbd-6e0d-4cfb-b172-261d3ea96c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:18.817866 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffbbbd-6e0d-4cfb-b172-261d3ea96c69 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:18.818152 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffbbbd-6e0d-4cfb-b172-261d3ea96c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:18.818507 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffbbbd-6e0d-4cfb-b172-261d3ea96c69 None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:18.819259 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffbbbd-6e0d-4cfb-b172-261d3ea96c69 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:18.819752 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffbbbd-6e0d-4cfb-b172-261d3ea96c69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:18.821048 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffbbbd-6e0d-4cfb-b172-261d3ea96c69 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:18.826310 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcaa1aa-7680-4246-935d-d0e066d0c753 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:18.843910 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 336/654] 10.222.0.43 () {56 vars in 1139 bytes} [Tue Mar 29 20:02:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:18.844895 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffbbbd-6e0d-4cfb-b172-261d3ea96c69 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:18.862853 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06c093-a19f-4942-b2ce-6770e942ff43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:18.863875 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06c093-a19f-4942-b2ce-6770e942ff43 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:18.864382 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06c093-a19f-4942-b2ce-6770e942ff43 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:18.864849 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06c093-a19f-4942-b2ce-6770e942ff43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:18.943827 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06c093-a19f-4942-b2ce-6770e942ff43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:18.946709 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06c093-a19f-4942-b2ce-6770e942ff43 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:18.956512 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffbbbd-6e0d-4cfb-b172-261d3ea96c69 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:18.992337 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061178b-5602-4ef6-8618-84e2647fe2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:18.993199 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061178b-5602-4ef6-8618-84e2647fe2cf None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:18.993580 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061178b-5602-4ef6-8618-84e2647fe2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:18.993787 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061178b-5602-4ef6-8618-84e2647fe2cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:19.004095 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061178b-5602-4ef6-8618-84e2647fe2cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:19.005578 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061178b-5602-4ef6-8618-84e2647fe2cf None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:19.022815 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-2061178b-5602-4ef6-8618-84e2647fe2cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:19.024866 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 337/655] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:19.025686 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061178b-5602-4ef6-8618-84e2647fe2cf None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:19.052172 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 319/656] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:02:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:02:19.053346 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06c093-a19f-4942-b2ce-6770e942ff43 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:19.125418 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061178b-5602-4ef6-8618-84e2647fe2cf None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:19.161996 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92591a-90aa-42ec-9010-5e6b353d83f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:19.162935 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92591a-90aa-42ec-9010-5e6b353d83f7 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:19.163210 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92591a-90aa-42ec-9010-5e6b353d83f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:19.163525 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92591a-90aa-42ec-9010-5e6b353d83f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:19.164266 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06c093-a19f-4942-b2ce-6770e942ff43 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:19.201717 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dab277-b5be-4ef4-b37d-0f2423db4608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:19.202799 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dab277-b5be-4ef4-b37d-0f2423db4608 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:19.203343 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dab277-b5be-4ef4-b37d-0f2423db4608 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:19.203829 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dab277-b5be-4ef4-b37d-0f2423db4608 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:19.204745 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dab277-b5be-4ef4-b37d-0f2423db4608 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:19.205258 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dab277-b5be-4ef4-b37d-0f2423db4608 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:19.206838 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dab277-b5be-4ef4-b37d-0f2423db4608 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:19.219398 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 320/657] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:19.220536 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dab277-b5be-4ef4-b37d-0f2423db4608 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:19.234274 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92591a-90aa-42ec-9010-5e6b353d83f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:19.235755 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92591a-90aa-42ec-9010-5e6b353d83f7 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:19.322779 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dab277-b5be-4ef4-b37d-0f2423db4608 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:19.336019 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 338/658] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:02:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:02:19.338282 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92591a-90aa-42ec-9010-5e6b353d83f7 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:19.362028 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1133c-eb4c-44bc-8bf9-2d0aa54d536e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:19.362820 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1133c-eb4c-44bc-8bf9-2d0aa54d536e None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:19.363105 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1133c-eb4c-44bc-8bf9-2d0aa54d536e None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:19.363382 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1133c-eb4c-44bc-8bf9-2d0aa54d536e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:19.373804 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1133c-eb4c-44bc-8bf9-2d0aa54d536e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:19.375246 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1133c-eb4c-44bc-8bf9-2d0aa54d536e None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:19.391904 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-40c1133c-eb4c-44bc-8bf9-2d0aa54d536e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:19.393089 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 321/659] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:19.394404 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98159f50-f50d-45d2-a6b2-0c987bb79539 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:19.394698 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98159f50-f50d-45d2-a6b2-0c987bb79539 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:19.394978 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98159f50-f50d-45d2-a6b2-0c987bb79539 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:19.396786 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 322/660] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:19.398027 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98159f50-f50d-45d2-a6b2-0c987bb79539 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:19.447884 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92591a-90aa-42ec-9010-5e6b353d83f7 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:19.482025 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1942099-51cc-4d80-9b0b-7127dc0a252a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:19.483246 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1942099-51cc-4d80-9b0b-7127dc0a252a None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:19.483736 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1942099-51cc-4d80-9b0b-7127dc0a252a None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:19.484224 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1942099-51cc-4d80-9b0b-7127dc0a252a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:19.495640 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1942099-51cc-4d80-9b0b-7127dc0a252a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:19.497268 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1942099-51cc-4d80-9b0b-7127dc0a252a None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:19.511910 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-c1942099-51cc-4d80-9b0b-7127dc0a252a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 29 20:02:19.513102 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 339/661] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:02:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:19.513902 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1942099-51cc-4d80-9b0b-7127dc0a252a None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:19.520867 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98159f50-f50d-45d2-a6b2-0c987bb79539 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:19.554444 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4241e-97ee-4dba-aff6-095c95346e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:19.555247 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4241e-97ee-4dba-aff6-095c95346e57 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:19.555535 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4241e-97ee-4dba-aff6-095c95346e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:19.555829 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4241e-97ee-4dba-aff6-095c95346e57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:19.566742 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4241e-97ee-4dba-aff6-095c95346e57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:19.568662 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4241e-97ee-4dba-aff6-095c95346e57 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:19.587059 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-51c4241e-97ee-4dba-aff6-095c95346e57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:19.592712 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 323/662] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:19.592712 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a079ca3-070f-4636-b5cc-cd9e9e8fef8d None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:19.592712 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a079ca3-070f-4636-b5cc-cd9e9e8fef8d None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:19.592712 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a079ca3-070f-4636-b5cc-cd9e9e8fef8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:19.607649 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-3a079ca3-070f-4636-b5cc-cd9e9e8fef8d None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:19.608831 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-3a079ca3-070f-4636-b5cc-cd9e9e8fef8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:19.619899 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1942099-51cc-4d80-9b0b-7127dc0a252a None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:19.656269 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4161a88-4368-4bcd-ba2d-95168f633db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:19.656945 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4161a88-4368-4bcd-ba2d-95168f633db0 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:19.657230 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4161a88-4368-4bcd-ba2d-95168f633db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:19.657538 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4161a88-4368-4bcd-ba2d-95168f633db0 None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:19.658260 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4161a88-4368-4bcd-ba2d-95168f633db0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:19.658571 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4161a88-4368-4bcd-ba2d-95168f633db0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:19.659972 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4161a88-4368-4bcd-ba2d-95168f633db0 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:19.671908 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 340/663] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:19.676499 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4161a88-4368-4bcd-ba2d-95168f633db0 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:19.689327 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 324/664] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:02:19.689327 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a079ca3-070f-4636-b5cc-cd9e9e8fef8d None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:19.783815 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4161a88-4368-4bcd-ba2d-95168f633db0 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:19.788446 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a079ca3-070f-4636-b5cc-cd9e9e8fef8d None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:19.817064 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731e27d-662b-4b02-bc08-e025fcd2f859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:19.817784 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731e27d-662b-4b02-bc08-e025fcd2f859 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:19.818078 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731e27d-662b-4b02-bc08-e025fcd2f859 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:19.818362 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731e27d-662b-4b02-bc08-e025fcd2f859 None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:19.819187 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731e27d-662b-4b02-bc08-e025fcd2f859 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:19.819499 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731e27d-662b-4b02-bc08-e025fcd2f859 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:19.820970 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731e27d-662b-4b02-bc08-e025fcd2f859 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:19.829771 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194b94a-b8a4-4989-b03a-bca335d64435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:19.830621 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194b94a-b8a4-4989-b03a-bca335d64435 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:19.830902 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194b94a-b8a4-4989-b03a-bca335d64435 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:19.831183 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194b94a-b8a4-4989-b03a-bca335d64435 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:19.831899 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194b94a-b8a4-4989-b03a-bca335d64435 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:19.832213 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194b94a-b8a4-4989-b03a-bca335d64435 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:19.833775 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194b94a-b8a4-4989-b03a-bca335d64435 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:19.844115 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 341/665] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Mar 29 20:02:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:19.844115 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731e27d-662b-4b02-bc08-e025fcd2f859 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:19.855148 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 325/666] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:19.856203 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194b94a-b8a4-4989-b03a-bca335d64435 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:19.953643 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731e27d-662b-4b02-bc08-e025fcd2f859 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:19.958795 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194b94a-b8a4-4989-b03a-bca335d64435 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:19.987661 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58c848-1dd5-4535-aa4f-3835abe1d726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:19.988492 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58c848-1dd5-4535-aa4f-3835abe1d726 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:19.988781 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58c848-1dd5-4535-aa4f-3835abe1d726 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:19.989060 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58c848-1dd5-4535-aa4f-3835abe1d726 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:19.994519 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5f267-d753-4e0c-8f2c-a4f5cbe4cf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:19.995312 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5f267-d753-4e0c-8f2c-a4f5cbe4cf09 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:19.995599 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5f267-d753-4e0c-8f2c-a4f5cbe4cf09 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:19.995940 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5f267-d753-4e0c-8f2c-a4f5cbe4cf09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:19.996592 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58c848-1dd5-4535-aa4f-3835abe1d726 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:19.998062 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58c848-1dd5-4535-aa4f-3835abe1d726 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:20.006065 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5f267-d753-4e0c-8f2c-a4f5cbe4cf09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:20.011490 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-fe58c848-1dd5-4535-aa4f-3835abe1d726 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:20.017485 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 342/667] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:20.017485 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58c848-1dd5-4535-aa4f-3835abe1d726 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:20.017675 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-fde5f267-d753-4e0c-8f2c-a4f5cbe4cf09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 20:02:20.017675 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 326/668] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Mar 29 20:02:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:20.017675 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5f267-d753-4e0c-8f2c-a4f5cbe4cf09 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:20.114811 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5f267-d753-4e0c-8f2c-a4f5cbe4cf09 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:20.117209 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58c848-1dd5-4535-aa4f-3835abe1d726 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:20.147485 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da294aff-9bbb-4d24-b066-536110dbe63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:20.148283 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da294aff-9bbb-4d24-b066-536110dbe63f None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:20.148569 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da294aff-9bbb-4d24-b066-536110dbe63f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:20.149480 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da294aff-9bbb-4d24-b066-536110dbe63f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:20.151721 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e6523-222c-4062-858b-9fb1cbd0bc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:20.152379 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e6523-222c-4062-858b-9fb1cbd0bc1f None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:20.152666 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e6523-222c-4062-858b-9fb1cbd0bc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:20.152945 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e6523-222c-4062-858b-9fb1cbd0bc1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:20.156245 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da294aff-9bbb-4d24-b066-536110dbe63f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:20.157716 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da294aff-9bbb-4d24-b066-536110dbe63f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:20.171089 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-da294aff-9bbb-4d24-b066-536110dbe63f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:20.176882 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 327/669] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:20.176882 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da294aff-9bbb-4d24-b066-536110dbe63f None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:20.222967 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e6523-222c-4062-858b-9fb1cbd0bc1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:20.224405 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e6523-222c-4062-858b-9fb1cbd0bc1f None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:20.275455 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da294aff-9bbb-4d24-b066-536110dbe63f None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:20.314255 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a9794-6c3f-4f10-9e1f-5970b40f0e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:20.314916 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a9794-6c3f-4f10-9e1f-5970b40f0e7d None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:20.315194 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a9794-6c3f-4f10-9e1f-5970b40f0e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:20.315470 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a9794-6c3f-4f10-9e1f-5970b40f0e7d None admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:20.316246 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a9794-6c3f-4f10-9e1f-5970b40f0e7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:20.316559 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a9794-6c3f-4f10-9e1f-5970b40f0e7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:20.318005 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a9794-6c3f-4f10-9e1f-5970b40f0e7d None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:20.328117 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 343/670] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:02:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:02:20.328117 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e6523-222c-4062-858b-9fb1cbd0bc1f None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:20.333768 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 328/671] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:20.339186 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a9794-6c3f-4f10-9e1f-5970b40f0e7d None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:20.425981 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e6523-222c-4062-858b-9fb1cbd0bc1f None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:20.438556 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a9794-6c3f-4f10-9e1f-5970b40f0e7d None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:20.459497 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50088cb4-3885-4933-9bf4-426a73c34cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:20.460187 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50088cb4-3885-4933-9bf4-426a73c34cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:20.460467 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50088cb4-3885-4933-9bf4-426a73c34cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:20.460746 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50088cb4-3885-4933-9bf4-426a73c34cc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:20.462561 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50088cb4-3885-4933-9bf4-426a73c34cc0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:20.462761 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50088cb4-3885-4933-9bf4-426a73c34cc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:20.464180 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50088cb4-3885-4933-9bf4-426a73c34cc0 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:20.473147 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 344/672] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Mar 29 20:02:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:20.474075 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50088cb4-3885-4933-9bf4-426a73c34cc0 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:20.482140 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db617c4-36ba-4e89-98de-0d4e18ebd7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:20.482880 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db617c4-36ba-4e89-98de-0d4e18ebd7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:20.483173 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db617c4-36ba-4e89-98de-0d4e18ebd7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:20.483459 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db617c4-36ba-4e89-98de-0d4e18ebd7d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:20.484262 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db617c4-36ba-4e89-98de-0d4e18ebd7d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:20.484578 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db617c4-36ba-4e89-98de-0d4e18ebd7d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:20.486069 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db617c4-36ba-4e89-98de-0d4e18ebd7d6 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:20.503959 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 329/673] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:20.503959 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db617c4-36ba-4e89-98de-0d4e18ebd7d6 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:20.580105 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50088cb4-3885-4933-9bf4-426a73c34cc0 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:20.599772 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db617c4-36ba-4e89-98de-0d4e18ebd7d6 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:20.612621 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139f131-9e4f-4fea-8fe9-20eb1569fd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:20.613457 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139f131-9e4f-4fea-8fe9-20eb1569fd03 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:20.613745 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139f131-9e4f-4fea-8fe9-20eb1569fd03 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:20.614026 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139f131-9e4f-4fea-8fe9-20eb1569fd03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:20.624914 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139f131-9e4f-4fea-8fe9-20eb1569fd03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:20.626402 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139f131-9e4f-4fea-8fe9-20eb1569fd03 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:20.634871 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da0eb2-a907-428c-a3f0-e5bdbd00225f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:20.635526 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da0eb2-a907-428c-a3f0-e5bdbd00225f None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:20.635814 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da0eb2-a907-428c-a3f0-e5bdbd00225f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:20.636097 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da0eb2-a907-428c-a3f0-e5bdbd00225f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:20.636925 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da0eb2-a907-428c-a3f0-e5bdbd00225f None admin] RBAC: Adding query filter params (role.id=04bfd9a52ca84b2db7f73121d5e57b41, scope.project.id=ec1f2c5cb900473da1083830387e3ff4, user.id=0b169395c92c4fbfbbe4fd14a235f81f) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:20.637244 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da0eb2-a907-428c-a3f0-e5bdbd00225f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:20.638680 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da0eb2-a907-428c-a3f0-e5bdbd00225f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:20.643565 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-8139f131-9e4f-4fea-8fe9-20eb1569fd03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:20.653578 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 330/674] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:02:20 2022] GET /identity/v3/role_assignments?user.id=0b169395c92c4fbfbbe4fd14a235f81f&scope.project.id=ec1f2c5cb900473da1083830387e3ff4&role.id=04bfd9a52ca84b2db7f73121d5e57b41 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:20.653763 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 345/675] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:20.653868 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da0eb2-a907-428c-a3f0-e5bdbd00225f None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:20.653944 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139f131-9e4f-4fea-8fe9-20eb1569fd03 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:20.756199 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da0eb2-a907-428c-a3f0-e5bdbd00225f None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:20.764081 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139f131-9e4f-4fea-8fe9-20eb1569fd03 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:20.796170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2af166-8be7-48e4-ae4c-4771a3359ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:20.796986 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2af166-8be7-48e4-ae4c-4771a3359ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:20.797318 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2af166-8be7-48e4-ae4c-4771a3359ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:20.797784 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2af166-8be7-48e4-ae4c-4771a3359ad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:20.801198 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea6ab1-7d55-48ef-a1fb-1d8d49952ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:20.801903 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea6ab1-7d55-48ef-a1fb-1d8d49952ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:20.802191 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea6ab1-7d55-48ef-a1fb-1d8d49952ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:20.802536 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea6ab1-7d55-48ef-a1fb-1d8d49952ac5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:20.803380 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea6ab1-7d55-48ef-a1fb-1d8d49952ac5 None admin] RBAC: Adding query filter params (role.id=04bfd9a52ca84b2db7f73121d5e57b41, scope.project.id=ec1f2c5cb900473da1083830387e3ff4, user.id=22bdaa02b1b14be3837b337fbf6e0eb5) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:20.803697 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea6ab1-7d55-48ef-a1fb-1d8d49952ac5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:20.805761 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea6ab1-7d55-48ef-a1fb-1d8d49952ac5 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:20.810275 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2af166-8be7-48e4-ae4c-4771a3359ad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:20.811736 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2af166-8be7-48e4-ae4c-4771a3359ad1 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:20.817765 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 346/676] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:02:20 2022] GET /identity/v3/role_assignments?user.id=22bdaa02b1b14be3837b337fbf6e0eb5&scope.project.id=ec1f2c5cb900473da1083830387e3ff4&role.id=04bfd9a52ca84b2db7f73121d5e57b41 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:20.818829 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea6ab1-7d55-48ef-a1fb-1d8d49952ac5 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:20.836697 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-2a2af166-8be7-48e4-ae4c-4771a3359ad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:20.839837 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 331/677] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:20.842166 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f610b-29b1-4229-bf82-7a90af609ce4 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:20.842166 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f610b-29b1-4229-bf82-7a90af609ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:20.842166 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f610b-29b1-4229-bf82-7a90af609ce4 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:20.842833 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 332/678] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:20.844129 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f610b-29b1-4229-bf82-7a90af609ce4 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:20.967997 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f610b-29b1-4229-bf82-7a90af609ce4 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:20.972197 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea6ab1-7d55-48ef-a1fb-1d8d49952ac5 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:21.007375 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736bf65-cadb-43e1-8bad-00b095660bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:21.007975 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736bf65-cadb-43e1-8bad-00b095660bcd None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:21.008511 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736bf65-cadb-43e1-8bad-00b095660bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:21.008695 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736bf65-cadb-43e1-8bad-00b095660bcd None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:21.009621 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736bf65-cadb-43e1-8bad-00b095660bcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:21.009937 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736bf65-cadb-43e1-8bad-00b095660bcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:21.011429 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736bf65-cadb-43e1-8bad-00b095660bcd None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:21.011925 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c9162-92ae-47ab-8766-7543d5545f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:21.012802 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c9162-92ae-47ab-8766-7543d5545f6f None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:21.013324 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c9162-92ae-47ab-8766-7543d5545f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:21.013621 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c9162-92ae-47ab-8766-7543d5545f6f None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:21.014349 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c9162-92ae-47ab-8766-7543d5545f6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:21.014655 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c9162-92ae-47ab-8766-7543d5545f6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:21.016036 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c9162-92ae-47ab-8766-7543d5545f6f None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:21.024574 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 333/679] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:21.025565 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248b5ba-5a0e-4eaa-ae1c-c17dfcff0528 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:21.025862 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248b5ba-5a0e-4eaa-ae1c-c17dfcff0528 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:21.030412 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248b5ba-5a0e-4eaa-ae1c-c17dfcff0528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:21.036656 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 347/680] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:21.037533 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c9162-92ae-47ab-8766-7543d5545f6f None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:21.044965 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-1248b5ba-5a0e-4eaa-ae1c-c17dfcff0528 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:21.046454 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-1248b5ba-5a0e-4eaa-ae1c-c17dfcff0528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:21.125624 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 334/681] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:02:21.126848 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248b5ba-5a0e-4eaa-ae1c-c17dfcff0528 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:21.170974 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c9162-92ae-47ab-8766-7543d5545f6f None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:21.206579 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b377d-7f36-450b-a0d5-fbf090b2df24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:21.207374 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b377d-7f36-450b-a0d5-fbf090b2df24 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:21.207654 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b377d-7f36-450b-a0d5-fbf090b2df24 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:21.207927 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b377d-7f36-450b-a0d5-fbf090b2df24 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:21.216352 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b377d-7f36-450b-a0d5-fbf090b2df24 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:21.217830 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b377d-7f36-450b-a0d5-fbf090b2df24 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:21.232447 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-9d1b377d-7f36-450b-a0d5-fbf090b2df24 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 29 20:02:21.237330 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 348/682] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:02:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:21.237330 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b377d-7f36-450b-a0d5-fbf090b2df24 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:21.239858 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248b5ba-5a0e-4eaa-ae1c-c17dfcff0528 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:21.277019 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad28b7-44ce-4d84-8d02-ffec5dc86496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:21.277767 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad28b7-44ce-4d84-8d02-ffec5dc86496 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:21.278054 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad28b7-44ce-4d84-8d02-ffec5dc86496 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:21.278334 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad28b7-44ce-4d84-8d02-ffec5dc86496 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:21.285459 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad28b7-44ce-4d84-8d02-ffec5dc86496 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:21.286906 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad28b7-44ce-4d84-8d02-ffec5dc86496 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:21.300440 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-05ad28b7-44ce-4d84-8d02-ffec5dc86496 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:21.301953 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 335/683] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:21.302746 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad28b7-44ce-4d84-8d02-ffec5dc86496 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:21.341554 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b377d-7f36-450b-a0d5-fbf090b2df24 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:21.376288 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481e72c-8bb1-4742-a7a6-4bc59ef850c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:21.377083 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481e72c-8bb1-4742-a7a6-4bc59ef850c9 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:21.377393 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481e72c-8bb1-4742-a7a6-4bc59ef850c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:21.377733 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481e72c-8bb1-4742-a7a6-4bc59ef850c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:21.388194 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481e72c-8bb1-4742-a7a6-4bc59ef850c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:21.395218 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-f481e72c-8bb1-4742-a7a6-4bc59ef850c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:02:21.396786 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 349/684] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:02:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:21.397793 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481e72c-8bb1-4742-a7a6-4bc59ef850c9 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:21.403821 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad28b7-44ce-4d84-8d02-ffec5dc86496 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:21.439433 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a896888-3c2f-4519-adcd-1471e879f0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:21.440106 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a896888-3c2f-4519-adcd-1471e879f0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:21.440392 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a896888-3c2f-4519-adcd-1471e879f0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:21.440670 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a896888-3c2f-4519-adcd-1471e879f0b7 None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:21.441544 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a896888-3c2f-4519-adcd-1471e879f0b7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:21.441855 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a896888-3c2f-4519-adcd-1471e879f0b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:21.443277 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a896888-3c2f-4519-adcd-1471e879f0b7 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:21.466267 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 336/685] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Mar 29 20:02:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:21.467233 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a896888-3c2f-4519-adcd-1471e879f0b7 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:21.501509 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481e72c-8bb1-4742-a7a6-4bc59ef850c9 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:21.535224 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8bb42-6111-4665-93ae-f4e310ad43a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:21.535866 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8bb42-6111-4665-93ae-f4e310ad43a8 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:21.536146 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8bb42-6111-4665-93ae-f4e310ad43a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:21.536421 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8bb42-6111-4665-93ae-f4e310ad43a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:21.537245 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8bb42-6111-4665-93ae-f4e310ad43a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:21.537598 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8bb42-6111-4665-93ae-f4e310ad43a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:21.539029 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8bb42-6111-4665-93ae-f4e310ad43a8 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:21.552158 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 350/686] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:21.557670 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8bb42-6111-4665-93ae-f4e310ad43a8 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:21.566516 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a896888-3c2f-4519-adcd-1471e879f0b7 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:21.601402 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28496100-d3dc-4228-9842-86a5a5772605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:21.602650 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28496100-d3dc-4228-9842-86a5a5772605 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:21.602929 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28496100-d3dc-4228-9842-86a5a5772605 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:21.603203 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28496100-d3dc-4228-9842-86a5a5772605 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:21.603953 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28496100-d3dc-4228-9842-86a5a5772605 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:21.604265 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28496100-d3dc-4228-9842-86a5a5772605 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:21.605649 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28496100-d3dc-4228-9842-86a5a5772605 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:21.614477 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 337/687] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:02:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:21.615324 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28496100-d3dc-4228-9842-86a5a5772605 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:21.660503 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8bb42-6111-4665-93ae-f4e310ad43a8 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:21.695177 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5f9bf-d701-464b-b83f-b5547624568e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:21.696385 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5f9bf-d701-464b-b83f-b5547624568e None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:21.696662 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5f9bf-d701-464b-b83f-b5547624568e None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:21.697014 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5f9bf-d701-464b-b83f-b5547624568e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:21.715795 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28496100-d3dc-4228-9842-86a5a5772605 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:21.750359 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bfc80-4b93-4f12-b70a-fbbe733e9c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:21.751020 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bfc80-4b93-4f12-b70a-fbbe733e9c6e None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:21.751305 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bfc80-4b93-4f12-b70a-fbbe733e9c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:21.751587 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bfc80-4b93-4f12-b70a-fbbe733e9c6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:21.752414 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156bfc80-4b93-4f12-b70a-fbbe733e9c6e None admin] RBAC: Adding query filter params (role.id=04bfd9a52ca84b2db7f73121d5e57b41, scope.project.id=ec1f2c5cb900473da1083830387e3ff4, user.id=1d8ea87a7fd34751896b2a0ffaedab2c) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:21.752728 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156bfc80-4b93-4f12-b70a-fbbe733e9c6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:21.754187 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156bfc80-4b93-4f12-b70a-fbbe733e9c6e None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:21.761055 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 338/688] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:02:21 2022] GET /identity/v3/role_assignments?user.id=1d8ea87a7fd34751896b2a0ffaedab2c&scope.project.id=ec1f2c5cb900473da1083830387e3ff4&role.id=04bfd9a52ca84b2db7f73121d5e57b41 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:21.761897 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bfc80-4b93-4f12-b70a-fbbe733e9c6e None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:21.784975 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5f9bf-d701-464b-b83f-b5547624568e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:21.786556 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5f9bf-d701-464b-b83f-b5547624568e None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:21.928858 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bfc80-4b93-4f12-b70a-fbbe733e9c6e None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:21.978339 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba04be-0237-4723-bd8a-c99c1ab3d80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:21.979150 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba04be-0237-4723-bd8a-c99c1ab3d80f None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:21.979431 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba04be-0237-4723-bd8a-c99c1ab3d80f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:21.979702 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba04be-0237-4723-bd8a-c99c1ab3d80f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:22.002407 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba04be-0237-4723-bd8a-c99c1ab3d80f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:22.003864 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba04be-0237-4723-bd8a-c99c1ab3d80f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:22.007312 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 351/689] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:02:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:02:22.012620 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5f9bf-d701-464b-b83f-b5547624568e None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:22.028490 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-91ba04be-0237-4723-bd8a-c99c1ab3d80f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:22.030179 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 339/690] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:22.035300 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba04be-0237-4723-bd8a-c99c1ab3d80f None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:22.147495 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5f9bf-d701-464b-b83f-b5547624568e None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:22.161075 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba04be-0237-4723-bd8a-c99c1ab3d80f None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:22.191675 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6448a5-e464-4b05-8a40-b9ea49168b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:22.192609 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6448a5-e464-4b05-8a40-b9ea49168b6f None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:22.192889 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6448a5-e464-4b05-8a40-b9ea49168b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:22.193337 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6448a5-e464-4b05-8a40-b9ea49168b6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:22.201514 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493af29e-c8cc-49ce-b259-6793a600564f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:22.202186 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493af29e-c8cc-49ce-b259-6793a600564f None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:22.202528 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493af29e-c8cc-49ce-b259-6793a600564f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:22.202809 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493af29e-c8cc-49ce-b259-6793a600564f None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:22.203578 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493af29e-c8cc-49ce-b259-6793a600564f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:22.203890 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493af29e-c8cc-49ce-b259-6793a600564f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:22.205246 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493af29e-c8cc-49ce-b259-6793a600564f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:22.205890 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6448a5-e464-4b05-8a40-b9ea49168b6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:22.207930 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6448a5-e464-4b05-8a40-b9ea49168b6f None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:22.218224 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 340/691] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:22.227770 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-7c6448a5-e464-4b05-8a40-b9ea49168b6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:22.229128 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 352/692] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:02:22.230063 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493af29e-c8cc-49ce-b259-6793a600564f None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:22.234656 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6448a5-e464-4b05-8a40-b9ea49168b6f None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:22.342103 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6448a5-e464-4b05-8a40-b9ea49168b6f None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:22.405967 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73de29f-485e-47c5-88f8-9425ea64a625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:22.406999 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73de29f-485e-47c5-88f8-9425ea64a625 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:22.407531 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73de29f-485e-47c5-88f8-9425ea64a625 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:22.408005 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73de29f-485e-47c5-88f8-9425ea64a625 None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:22.408974 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73de29f-485e-47c5-88f8-9425ea64a625 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:22.409521 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73de29f-485e-47c5-88f8-9425ea64a625 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:22.411117 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73de29f-485e-47c5-88f8-9425ea64a625 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:22.424682 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 353/693] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:22.429685 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73de29f-485e-47c5-88f8-9425ea64a625 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:22.437080 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493af29e-c8cc-49ce-b259-6793a600564f None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:22.500040 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646778c0-0682-4ce2-98fd-a9b9cd1a315b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:22.500845 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646778c0-0682-4ce2-98fd-a9b9cd1a315b None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:22.501126 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646778c0-0682-4ce2-98fd-a9b9cd1a315b None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:22.501427 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646778c0-0682-4ce2-98fd-a9b9cd1a315b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:22.516651 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646778c0-0682-4ce2-98fd-a9b9cd1a315b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:22.518118 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646778c0-0682-4ce2-98fd-a9b9cd1a315b None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:22.542980 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-646778c0-0682-4ce2-98fd-a9b9cd1a315b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 29 20:02:22.544631 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 341/694] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Mar 29 20:02:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:22.550113 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646778c0-0682-4ce2-98fd-a9b9cd1a315b None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:22.624165 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73de29f-485e-47c5-88f8-9425ea64a625 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:22.669422 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831d905-b6be-4cea-aa4e-b639dbf175c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:22.670642 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831d905-b6be-4cea-aa4e-b639dbf175c2 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:22.671126 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831d905-b6be-4cea-aa4e-b639dbf175c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:22.671611 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831d905-b6be-4cea-aa4e-b639dbf175c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:22.682883 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831d905-b6be-4cea-aa4e-b639dbf175c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:22.685621 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831d905-b6be-4cea-aa4e-b639dbf175c2 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:22.714049 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-b831d905-b6be-4cea-aa4e-b639dbf175c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:22.716686 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 354/695] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:02:22.722906 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831d905-b6be-4cea-aa4e-b639dbf175c2 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:22.741340 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646778c0-0682-4ce2-98fd-a9b9cd1a315b None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:22.781168 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba9ea4-25be-474a-bba3-0176b072adc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:22.781883 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba9ea4-25be-474a-bba3-0176b072adc4 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:22.782172 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba9ea4-25be-474a-bba3-0176b072adc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:22.782452 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba9ea4-25be-474a-bba3-0176b072adc4 None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:22.783300 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba9ea4-25be-474a-bba3-0176b072adc4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:22.783610 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba9ea4-25be-474a-bba3-0176b072adc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:22.785022 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba9ea4-25be-474a-bba3-0176b072adc4 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:22.803588 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 342/696] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Mar 29 20:02:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:22.809795 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba9ea4-25be-474a-bba3-0176b072adc4 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:22.894750 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831d905-b6be-4cea-aa4e-b639dbf175c2 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:22.944351 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba9ea4-25be-474a-bba3-0176b072adc4 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:22.978638 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b79ed8-ea4d-44f1-932c-f6f36d546a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:22.979320 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b79ed8-ea4d-44f1-932c-f6f36d546a56 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:22.979591 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b79ed8-ea4d-44f1-932c-f6f36d546a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:22.979868 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b79ed8-ea4d-44f1-932c-f6f36d546a56 None admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:22.980656 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b79ed8-ea4d-44f1-932c-f6f36d546a56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:22.980966 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b79ed8-ea4d-44f1-932c-f6f36d546a56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:22.982098 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df111d0-efc3-497f-b582-c66174931364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:22.982740 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df111d0-efc3-497f-b582-c66174931364 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:22.983015 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df111d0-efc3-497f-b582-c66174931364 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:22.983286 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df111d0-efc3-497f-b582-c66174931364 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:22.985277 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b79ed8-ea4d-44f1-932c-f6f36d546a56 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:23.013412 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 355/697] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:23.014893 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b79ed8-ea4d-44f1-932c-f6f36d546a56 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:23.084215 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df111d0-efc3-497f-b582-c66174931364 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:23.086382 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df111d0-efc3-497f-b582-c66174931364 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:23.131372 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b79ed8-ea4d-44f1-932c-f6f36d546a56 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:23.170783 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de67cb0-8cb3-46b9-96b0-63bfcedb3c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:23.171808 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de67cb0-8cb3-46b9-96b0-63bfcedb3c1b None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:23.172638 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de67cb0-8cb3-46b9-96b0-63bfcedb3c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:23.173146 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de67cb0-8cb3-46b9-96b0-63bfcedb3c1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:23.174188 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de67cb0-8cb3-46b9-96b0-63bfcedb3c1b None admin] RBAC: Adding query filter params (role.id=04bfd9a52ca84b2db7f73121d5e57b41, scope.project.id=ec1f2c5cb900473da1083830387e3ff4, user.id=9d6d8e7788494f2c92ad5c183c8fa283) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:23.174975 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de67cb0-8cb3-46b9-96b0-63bfcedb3c1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:23.177577 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de67cb0-8cb3-46b9-96b0-63bfcedb3c1b None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:23.184944 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 356/698] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:02:23 2022] GET /identity/v3/role_assignments?user.id=9d6d8e7788494f2c92ad5c183c8fa283&scope.project.id=ec1f2c5cb900473da1083830387e3ff4&role.id=04bfd9a52ca84b2db7f73121d5e57b41 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:23.257584 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 343/699] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:02:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:02:23.263802 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de67cb0-8cb3-46b9-96b0-63bfcedb3c1b None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:23.304155 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f845a04-0319-46b6-afc9-2dcfd393612c None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:23.304468 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f845a04-0319-46b6-afc9-2dcfd393612c None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:23.304659 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f845a04-0319-46b6-afc9-2dcfd393612c None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:23.307487 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 344/700] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:02:23.312643 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bd3d3-c123-4741-95cc-3d354b4d58af None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:23.312932 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bd3d3-c123-4741-95cc-3d354b4d58af None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:23.313212 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bd3d3-c123-4741-95cc-3d354b4d58af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:23.346392 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-912bd3d3-c123-4741-95cc-3d354b4d58af None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:23.347823 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-912bd3d3-c123-4741-95cc-3d354b4d58af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:23.385608 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de67cb0-8cb3-46b9-96b0-63bfcedb3c1b None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:23.422608 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ac934-1f24-4779-9fda-14eeb21f2344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:23.423404 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ac934-1f24-4779-9fda-14eeb21f2344 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:23.423684 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ac934-1f24-4779-9fda-14eeb21f2344 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:23.423956 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ac934-1f24-4779-9fda-14eeb21f2344 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:23.435793 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ac934-1f24-4779-9fda-14eeb21f2344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:23.437244 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ac934-1f24-4779-9fda-14eeb21f2344 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:23.454678 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-207ac934-1f24-4779-9fda-14eeb21f2344 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:23.455454 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 345/701] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:02:23.456747 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 357/702] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:23.462891 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bd3d3-c123-4741-95cc-3d354b4d58af None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:23.484961 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ac934-1f24-4779-9fda-14eeb21f2344 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:23.582548 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bd3d3-c123-4741-95cc-3d354b4d58af None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:23.594152 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ac934-1f24-4779-9fda-14eeb21f2344 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:23.623538 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b316dc1-5c43-4a27-8a40-ff76767a2b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:23.623781 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b316dc1-5c43-4a27-8a40-ff76767a2b56 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:23.624061 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b316dc1-5c43-4a27-8a40-ff76767a2b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:23.624336 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b316dc1-5c43-4a27-8a40-ff76767a2b56 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:23.625052 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b316dc1-5c43-4a27-8a40-ff76767a2b56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:23.625422 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b316dc1-5c43-4a27-8a40-ff76767a2b56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:23.626817 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b316dc1-5c43-4a27-8a40-ff76767a2b56 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:23.638702 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492cb6b-938e-4c17-91f8-5a6b68ab97d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:23.640112 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492cb6b-938e-4c17-91f8-5a6b68ab97d4 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:23.640249 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 346/703] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:23.640698 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492cb6b-938e-4c17-91f8-5a6b68ab97d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:23.641153 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492cb6b-938e-4c17-91f8-5a6b68ab97d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:23.641655 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36302857-9765-4bfd-adae-0528ef52c3d7 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:23.641949 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36302857-9765-4bfd-adae-0528ef52c3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:23.642228 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36302857-9765-4bfd-adae-0528ef52c3d7 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:23.644117 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 347/704] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:23.646619 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36302857-9765-4bfd-adae-0528ef52c3d7 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:23.657703 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492cb6b-938e-4c17-91f8-5a6b68ab97d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:23.659374 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492cb6b-938e-4c17-91f8-5a6b68ab97d4 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:23.676677 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-1492cb6b-938e-4c17-91f8-5a6b68ab97d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:23.678879 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 358/705] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:02:23.680771 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7914d-60a1-49d7-bdd5-6e8529e86ab5 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:23.681062 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7914d-60a1-49d7-bdd5-6e8529e86ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:23.681380 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7914d-60a1-49d7-bdd5-6e8529e86ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:23.698817 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-4cc7914d-60a1-49d7-bdd5-6e8529e86ab5 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:23.700255 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-4cc7914d-60a1-49d7-bdd5-6e8529e86ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:23.767239 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 359/706] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:02:23.768333 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7914d-60a1-49d7-bdd5-6e8529e86ab5 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:23.776018 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36302857-9765-4bfd-adae-0528ef52c3d7 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:23.822018 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b2e5d-08b9-4873-a7a1-65bab288ccdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:23.823423 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b2e5d-08b9-4873-a7a1-65bab288ccdd None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:23.823925 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b2e5d-08b9-4873-a7a1-65bab288ccdd None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:23.824400 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b2e5d-08b9-4873-a7a1-65bab288ccdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:23.831993 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b2e5d-08b9-4873-a7a1-65bab288ccdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:23.833756 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b2e5d-08b9-4873-a7a1-65bab288ccdd None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:23.847849 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-582b2e5d-08b9-4873-a7a1-65bab288ccdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:23.849648 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 348/707] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:02:23.855670 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b2e5d-08b9-4873-a7a1-65bab288ccdd None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:23.897730 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7914d-60a1-49d7-bdd5-6e8529e86ab5 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:23.947722 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5737570-b5b8-494c-a972-e602527d58b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:23.948398 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5737570-b5b8-494c-a972-e602527d58b9 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:23.948677 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5737570-b5b8-494c-a972-e602527d58b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:23.948948 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5737570-b5b8-494c-a972-e602527d58b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:23.949699 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5737570-b5b8-494c-a972-e602527d58b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:23.950008 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5737570-b5b8-494c-a972-e602527d58b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:23.951373 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5737570-b5b8-494c-a972-e602527d58b9 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:23.964204 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 360/708] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:23.965044 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5737570-b5b8-494c-a972-e602527d58b9 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:23.982790 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b2e5d-08b9-4873-a7a1-65bab288ccdd None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:24.025634 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fced9-6423-441d-86e9-e867330947e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:24.026602 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fced9-6423-441d-86e9-e867330947e5 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:24.026892 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fced9-6423-441d-86e9-e867330947e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:24.027489 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fced9-6423-441d-86e9-e867330947e5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:24.028420 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924fced9-6423-441d-86e9-e867330947e5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:24.029979 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924fced9-6423-441d-86e9-e867330947e5 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:24.046605 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-924fced9-6423-441d-86e9-e867330947e5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 29 20:02:24.049396 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 349/709] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:23 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:24.050253 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fced9-6423-441d-86e9-e867330947e5 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:24.080465 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5737570-b5b8-494c-a972-e602527d58b9 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:24.118897 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2413bd8-d348-4d02-922c-1ebe2d829f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:24.119498 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2413bd8-d348-4d02-922c-1ebe2d829f95 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:24.119776 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2413bd8-d348-4d02-922c-1ebe2d829f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:24.120048 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2413bd8-d348-4d02-922c-1ebe2d829f95 None admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:24.120937 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2413bd8-d348-4d02-922c-1ebe2d829f95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:24.121249 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2413bd8-d348-4d02-922c-1ebe2d829f95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:24.122972 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2413bd8-d348-4d02-922c-1ebe2d829f95 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:24.136997 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 361/710] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:24.137981 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2413bd8-d348-4d02-922c-1ebe2d829f95 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:24.162091 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fced9-6423-441d-86e9-e867330947e5 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:24.196586 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458e0cd-f2fb-4413-ab55-0c18953c7d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:24.197694 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458e0cd-f2fb-4413-ab55-0c18953c7d8a None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:24.197981 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458e0cd-f2fb-4413-ab55-0c18953c7d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:24.198263 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458e0cd-f2fb-4413-ab55-0c18953c7d8a None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:24.198974 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458e0cd-f2fb-4413-ab55-0c18953c7d8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:24.200418 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458e0cd-f2fb-4413-ab55-0c18953c7d8a None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:24.245260 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2413bd8-d348-4d02-922c-1ebe2d829f95 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:24.280701 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2a4da-4b5d-432f-afef-d0f8dda78f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:24.281773 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2a4da-4b5d-432f-afef-d0f8dda78f7e None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:24.282270 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2a4da-4b5d-432f-afef-d0f8dda78f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:24.282786 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2a4da-4b5d-432f-afef-d0f8dda78f7e None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:24.283752 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2a4da-4b5d-432f-afef-d0f8dda78f7e None admin] RBAC: Adding query filter params (name=network) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:24.284294 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2a4da-4b5d-432f-afef-d0f8dda78f7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:24.285705 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 350/711] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Mar 29 20:02:24 2022] POST /identity/v3/users => generated 254 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:02:24.286261 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2a4da-4b5d-432f-afef-d0f8dda78f7e None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:24.286807 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458e0cd-f2fb-4413-ab55-0c18953c7d8a None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:24.295332 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 362/712] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Mar 29 20:02:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:24.301635 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2a4da-4b5d-432f-afef-d0f8dda78f7e None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:24.475003 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458e0cd-f2fb-4413-ab55-0c18953c7d8a None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:24.520070 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36dec4-0255-46eb-87d9-cf7a50d71a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:24.520731 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36dec4-0255-46eb-87d9-cf7a50d71a99 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:24.521013 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36dec4-0255-46eb-87d9-cf7a50d71a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:24.521303 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36dec4-0255-46eb-87d9-cf7a50d71a99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:24.522149 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36dec4-0255-46eb-87d9-cf7a50d71a99 None admin] RBAC: Adding query filter params (role.id=8cfa924df1a1400986d9ecc9686a7f52, scope.project.id=ec1f2c5cb900473da1083830387e3ff4, user.id=b797e15939694c9abf1f2b8e9aee4d67) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:24.522460 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36dec4-0255-46eb-87d9-cf7a50d71a99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:24.524079 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36dec4-0255-46eb-87d9-cf7a50d71a99 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:24.527462 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2a4da-4b5d-432f-afef-d0f8dda78f7e None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:24.530779 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 351/713] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:02:24 2022] GET /identity/v3/role_assignments?user.id=b797e15939694c9abf1f2b8e9aee4d67&scope.project.id=ec1f2c5cb900473da1083830387e3ff4&role.id=8cfa924df1a1400986d9ecc9686a7f52 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:24.570073 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac16cca-f966-4484-8ec5-eed466ddaf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:24.571831 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac16cca-f966-4484-8ec5-eed466ddaf01 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:24.572554 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac16cca-f966-4484-8ec5-eed466ddaf01 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:24.573011 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac16cca-f966-4484-8ec5-eed466ddaf01 None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:24.573945 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac16cca-f966-4484-8ec5-eed466ddaf01 None admin] RBAC: Adding query filter params (type=network) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:24.574436 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac16cca-f966-4484-8ec5-eed466ddaf01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:24.576051 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac16cca-f966-4484-8ec5-eed466ddaf01 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:24.583047 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 363/714] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Mar 29 20:02:24 2022] GET /identity/v3/services?type=network => generated 124 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:24.689986 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c337ac4-ac35-4573-b89d-d0c23f4a6a73 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:24.690626 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c337ac4-ac35-4573-b89d-d0c23f4a6a73 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:24.691111 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c337ac4-ac35-4573-b89d-d0c23f4a6a73 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:24.693680 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 352/715] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:24.700310 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a1049-804f-44e4-a320-c6aa9ba93015 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:24.700857 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a1049-804f-44e4-a320-c6aa9ba93015 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:24.700857 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a1049-804f-44e4-a320-c6aa9ba93015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:24.722335 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-f89a1049-804f-44e4-a320-c6aa9ba93015 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:24.723585 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-f89a1049-804f-44e4-a320-c6aa9ba93015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:24.808594 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 364/716] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:02:24.831673 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c337ac4-ac35-4573-b89d-d0c23f4a6a73 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:24.944445 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c337ac4-ac35-4573-b89d-d0c23f4a6a73 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:24.982297 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794053d7-230b-4045-877d-897883045752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:24.983116 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794053d7-230b-4045-877d-897883045752 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:24.983400 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794053d7-230b-4045-877d-897883045752 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:24.983678 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794053d7-230b-4045-877d-897883045752 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:24.984394 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794053d7-230b-4045-877d-897883045752 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:24.985791 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794053d7-230b-4045-877d-897883045752 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:24.998561 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-794053d7-230b-4045-877d-897883045752 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 29 20:02:25.005742 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 353/717] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Mar 29 20:02:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:25.014020 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a1049-804f-44e4-a320-c6aa9ba93015 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:25.174958 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a1049-804f-44e4-a320-c6aa9ba93015 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:25.216356 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d5ddc-1f72-4c70-bcec-b83ae1412d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:25.217035 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d5ddc-1f72-4c70-bcec-b83ae1412d0a None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:25.217337 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d5ddc-1f72-4c70-bcec-b83ae1412d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:25.217623 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d5ddc-1f72-4c70-bcec-b83ae1412d0a None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:25.218331 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d5ddc-1f72-4c70-bcec-b83ae1412d0a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:25.218643 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d5ddc-1f72-4c70-bcec-b83ae1412d0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:25.220034 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d5ddc-1f72-4c70-bcec-b83ae1412d0a None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:25.229616 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 365/718] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Mar 29 20:02:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:25.234339 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794053d7-230b-4045-877d-897883045752 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:25.361620 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794053d7-230b-4045-877d-897883045752 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:25.395994 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ff2b3-4592-410c-a785-c568a2809e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:25.396662 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ff2b3-4592-410c-a785-c568a2809e7b None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:25.396945 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ff2b3-4592-410c-a785-c568a2809e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:25.397223 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ff2b3-4592-410c-a785-c568a2809e7b None admin] PATH_INFO: `/v3/services` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:25.397959 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ff2b3-4592-410c-a785-c568a2809e7b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:25.398265 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ff2b3-4592-410c-a785-c568a2809e7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:25.400307 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ff2b3-4592-410c-a785-c568a2809e7b None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:25.406426 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 354/719] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Mar 29 20:02:25 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:25.993956 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36968a-281d-4517-a86c-eb4e26774950 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:25.994947 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36968a-281d-4517-a86c-eb4e26774950 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:25.995463 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36968a-281d-4517-a86c-eb4e26774950 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:25.997776 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 366/720] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:26.003445 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae8626-13f8-418f-bf45-2f3fc3db6f63 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:26.004303 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae8626-13f8-418f-bf45-2f3fc3db6f63 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:26.004782 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae8626-13f8-418f-bf45-2f3fc3db6f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:26.022074 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-91ae8626-13f8-418f-bf45-2f3fc3db6f63 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:26.023654 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-91ae8626-13f8-418f-bf45-2f3fc3db6f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:26.098991 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 355/721] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:02:26.123330 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36968a-281d-4517-a86c-eb4e26774950 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:26.230626 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36968a-281d-4517-a86c-eb4e26774950 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:26.265282 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746d63a-7086-4bb1-b6b1-991327e05b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:26.266494 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746d63a-7086-4bb1-b6b1-991327e05b67 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:26.266990 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746d63a-7086-4bb1-b6b1-991327e05b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:26.267464 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746d63a-7086-4bb1-b6b1-991327e05b67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:26.278954 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746d63a-7086-4bb1-b6b1-991327e05b67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:26.286428 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-9746d63a-7086-4bb1-b6b1-991327e05b67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:02:26.288121 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 367/722] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:02:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:26.294146 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae8626-13f8-418f-bf45-2f3fc3db6f63 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:26.415875 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae8626-13f8-418f-bf45-2f3fc3db6f63 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:26.456624 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6ce26-7898-4846-bcac-0bf0334cf1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:26.457719 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6ce26-7898-4846-bcac-0bf0334cf1ba None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:26.458208 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6ce26-7898-4846-bcac-0bf0334cf1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:26.458685 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6ce26-7898-4846-bcac-0bf0334cf1ba None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:26.459623 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae6ce26-7898-4846-bcac-0bf0334cf1ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:26.460153 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae6ce26-7898-4846-bcac-0bf0334cf1ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:26.462367 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae6ce26-7898-4846-bcac-0bf0334cf1ba None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:26.471040 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 356/723] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:02:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:26.477239 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746d63a-7086-4bb1-b6b1-991327e05b67 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:26.580184 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746d63a-7086-4bb1-b6b1-991327e05b67 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:26.614902 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92b9a4-2369-49a9-97f2-61706315e453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:26.616097 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92b9a4-2369-49a9-97f2-61706315e453 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:26.616580 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92b9a4-2369-49a9-97f2-61706315e453 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:26.617120 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92b9a4-2369-49a9-97f2-61706315e453 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:26.628498 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92b9a4-2369-49a9-97f2-61706315e453 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:26.630267 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92b9a4-2369-49a9-97f2-61706315e453 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:26.647795 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-db92b9a4-2369-49a9-97f2-61706315e453 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:26.650232 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 368/724] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:26.655948 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6ce26-7898-4846-bcac-0bf0334cf1ba None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:26.782359 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6ce26-7898-4846-bcac-0bf0334cf1ba None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:26.827387 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47619b9-2db9-4d4f-aeee-d32d21dee19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:26.828057 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47619b9-2db9-4d4f-aeee-d32d21dee19a None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:26.828339 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47619b9-2db9-4d4f-aeee-d32d21dee19a None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:26.828617 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47619b9-2db9-4d4f-aeee-d32d21dee19a None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:26.829364 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47619b9-2db9-4d4f-aeee-d32d21dee19a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:26.829677 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47619b9-2db9-4d4f-aeee-d32d21dee19a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:26.831103 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47619b9-2db9-4d4f-aeee-d32d21dee19a None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:26.851912 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 357/725] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:26.857698 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92b9a4-2369-49a9-97f2-61706315e453 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:27.023405 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92b9a4-2369-49a9-97f2-61706315e453 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:27.076115 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbb9e7-01f8-4f77-baef-6166bbeaa48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:27.076960 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbb9e7-01f8-4f77-baef-6166bbeaa48c None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:27.077246 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbb9e7-01f8-4f77-baef-6166bbeaa48c None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:27.077576 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbb9e7-01f8-4f77-baef-6166bbeaa48c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:27.090853 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbb9e7-01f8-4f77-baef-6166bbeaa48c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:27.092251 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbb9e7-01f8-4f77-baef-6166bbeaa48c None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:27.113416 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-9dfbb9e7-01f8-4f77-baef-6166bbeaa48c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 29 20:02:27.115741 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 369/726] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:02:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:27.121079 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47619b9-2db9-4d4f-aeee-d32d21dee19a None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:27.249566 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47619b9-2db9-4d4f-aeee-d32d21dee19a None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:27.295084 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8496c6-c8b9-43e8-bd3e-ec8a01bea762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:27.296037 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8496c6-c8b9-43e8-bd3e-ec8a01bea762 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:27.296466 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8496c6-c8b9-43e8-bd3e-ec8a01bea762 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:27.296908 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8496c6-c8b9-43e8-bd3e-ec8a01bea762 None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:27.297908 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8496c6-c8b9-43e8-bd3e-ec8a01bea762 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:27.298382 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8496c6-c8b9-43e8-bd3e-ec8a01bea762 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:27.299962 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8496c6-c8b9-43e8-bd3e-ec8a01bea762 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:27.327847 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 358/727] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Mar 29 20:02:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:27.333735 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbb9e7-01f8-4f77-baef-6166bbeaa48c None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:27.429041 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff3039-cdf5-40be-b61d-674f581764f0 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:27.429251 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff3039-cdf5-40be-b61d-674f581764f0 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:27.429982 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff3039-cdf5-40be-b61d-674f581764f0 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:27.432022 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 359/728] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:02:27.437969 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f57765-e57d-4a02-86b3-66de07e1b389 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:27.438257 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f57765-e57d-4a02-86b3-66de07e1b389 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:27.438543 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f57765-e57d-4a02-86b3-66de07e1b389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:27.473373 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-c7f57765-e57d-4a02-86b3-66de07e1b389 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:27.474564 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-c7f57765-e57d-4a02-86b3-66de07e1b389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:27.513543 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbb9e7-01f8-4f77-baef-6166bbeaa48c None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:27.558689 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce73bf1-ce63-44a4-a875-b66572366167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:27.559369 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce73bf1-ce63-44a4-a875-b66572366167 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:27.559655 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce73bf1-ce63-44a4-a875-b66572366167 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:27.560392 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce73bf1-ce63-44a4-a875-b66572366167 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:27.589380 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 360/729] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 20:02:27.591063 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4184819-5c2b-4da5-8f47-5f9f80db61df None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:27.591505 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4184819-5c2b-4da5-8f47-5f9f80db61df None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:27.591930 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4184819-5c2b-4da5-8f47-5f9f80db61df None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:27.600729 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 361/730] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:27 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:27.603926 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dc25c-dcba-439e-a05d-db1e64dbf4ad None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:27.605081 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dc25c-dcba-439e-a05d-db1e64dbf4ad None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:27.605540 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dc25c-dcba-439e-a05d-db1e64dbf4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:27.630371 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-171dc25c-dcba-439e-a05d-db1e64dbf4ad None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:27.631833 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-171dc25c-dcba-439e-a05d-db1e64dbf4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:27.654883 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce73bf1-ce63-44a4-a875-b66572366167 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:27.656558 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce73bf1-ce63-44a4-a875-b66572366167 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:27.702649 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 362/731] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:02:27.709311 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171dc25c-dcba-439e-a05d-db1e64dbf4ad None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:27.766031 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 370/732] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:02:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 20:02:27.767369 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22b4b7-03fb-472a-92a2-375278d58237 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:27.767659 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22b4b7-03fb-472a-92a2-375278d58237 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:27.767936 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22b4b7-03fb-472a-92a2-375278d58237 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:27.769629 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 371/733] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:27.770559 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22b4b7-03fb-472a-92a2-375278d58237 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:27.823150 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171dc25c-dcba-439e-a05d-db1e64dbf4ad None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:27.856464 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb8342-8b47-4bc3-86c8-e92e42cab883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:27.857266 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb8342-8b47-4bc3-86c8-e92e42cab883 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:27.857579 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb8342-8b47-4bc3-86c8-e92e42cab883 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:27.857860 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb8342-8b47-4bc3-86c8-e92e42cab883 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:27.868772 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb8342-8b47-4bc3-86c8-e92e42cab883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:27.872384 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22b4b7-03fb-472a-92a2-375278d58237 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:27.875698 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-0cfb8342-8b47-4bc3-86c8-e92e42cab883 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 20:02:27.877071 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 363/734] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Mar 29 20:02:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:27.878009 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb8342-8b47-4bc3-86c8-e92e42cab883 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:27.913577 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f5017-ce07-48c2-af2c-99df7bc6a279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:27.914969 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f5017-ce07-48c2-af2c-99df7bc6a279 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:27.915468 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f5017-ce07-48c2-af2c-99df7bc6a279 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:27.915600 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f5017-ce07-48c2-af2c-99df7bc6a279 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:27.928404 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f5017-ce07-48c2-af2c-99df7bc6a279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:27.935608 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-903f5017-ce07-48c2-af2c-99df7bc6a279 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:02:27.941591 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 372/735] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:02:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:27.941591 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1477c8-6a76-4981-88c8-24e94ef44a12 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:27.941591 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1477c8-6a76-4981-88c8-24e94ef44a12 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:27.941591 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1477c8-6a76-4981-88c8-24e94ef44a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:27.959038 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-4b1477c8-6a76-4981-88c8-24e94ef44a12 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:27.960158 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-4b1477c8-6a76-4981-88c8-24e94ef44a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:27.993973 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb8342-8b47-4bc3-86c8-e92e42cab883 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:28.027474 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76196ad-70ee-4356-879b-6e49820fac67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:28.028291 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76196ad-70ee-4356-879b-6e49820fac67 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:28.028573 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76196ad-70ee-4356-879b-6e49820fac67 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:28.028848 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76196ad-70ee-4356-879b-6e49820fac67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:28.029586 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 373/736] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:02:28.030705 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1477c8-6a76-4981-88c8-24e94ef44a12 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:28.056981 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76196ad-70ee-4356-879b-6e49820fac67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:28.058511 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76196ad-70ee-4356-879b-6e49820fac67 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:28.075350 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-a76196ad-70ee-4356-879b-6e49820fac67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:28.076542 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 364/737] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:28.077501 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76196ad-70ee-4356-879b-6e49820fac67 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:28.140410 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1477c8-6a76-4981-88c8-24e94ef44a12 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:28.174475 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76196ad-70ee-4356-879b-6e49820fac67 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:28.175709 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5116f5-5ca1-4acc-9599-c76300609f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:28.176386 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5116f5-5ca1-4acc-9599-c76300609f2a None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:28.176678 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5116f5-5ca1-4acc-9599-c76300609f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:28.176963 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5116f5-5ca1-4acc-9599-c76300609f2a None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:28.177773 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5116f5-5ca1-4acc-9599-c76300609f2a None admin] RBAC: Adding query filter params (name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:28.178080 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5116f5-5ca1-4acc-9599-c76300609f2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:28.179504 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5116f5-5ca1-4acc-9599-c76300609f2a None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:28.187368 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 374/738] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Mar 29 20:02:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:28.192012 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5116f5-5ca1-4acc-9599-c76300609f2a None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:28.214631 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37771251-9e76-4fa8-b1d8-84891a66edda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:28.215227 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37771251-9e76-4fa8-b1d8-84891a66edda None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:28.215515 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37771251-9e76-4fa8-b1d8-84891a66edda None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:28.215796 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37771251-9e76-4fa8-b1d8-84891a66edda None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:28.216529 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37771251-9e76-4fa8-b1d8-84891a66edda None admin] RBAC: Adding query filter params (name=admin) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:28.216852 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37771251-9e76-4fa8-b1d8-84891a66edda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:28.218240 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37771251-9e76-4fa8-b1d8-84891a66edda None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:28.226230 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 365/739] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:02:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:28.227361 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37771251-9e76-4fa8-b1d8-84891a66edda None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:28.295916 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5116f5-5ca1-4acc-9599-c76300609f2a None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:28.323582 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37771251-9e76-4fa8-b1d8-84891a66edda None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:28.334840 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04c60e-5d8d-4b1b-9bed-209c6950e866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:28.335588 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04c60e-5d8d-4b1b-9bed-209c6950e866 None admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:28.336612 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04c60e-5d8d-4b1b-9bed-209c6950e866 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:28.336964 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04c60e-5d8d-4b1b-9bed-209c6950e866 None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:28.337795 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04c60e-5d8d-4b1b-9bed-209c6950e866 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:28.339167 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04c60e-5d8d-4b1b-9bed-209c6950e866 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:28.357897 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d2455-06a2-40cc-966a-969df9c81cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:28.358559 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d2455-06a2-40cc-966a-969df9c81cbd None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:28.358983 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d2455-06a2-40cc-966a-969df9c81cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:28.359115 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d2455-06a2-40cc-966a-969df9c81cbd None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:28.359957 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d2455-06a2-40cc-966a-969df9c81cbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:28.360270 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d2455-06a2-40cc-966a-969df9c81cbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:28.361666 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d2455-06a2-40cc-966a-969df9c81cbd None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:28.374074 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 366/740] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:28.374866 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d2455-06a2-40cc-966a-969df9c81cbd None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:28.435453 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 375/741] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Mar 29 20:02:28 2022] POST /identity/v3/services => generated 240 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:02:28.436299 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04c60e-5d8d-4b1b-9bed-209c6950e866 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:28.477430 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d2455-06a2-40cc-966a-969df9c81cbd None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:28.532909 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d59be-4433-49e0-9d8c-6fe8b9265d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:28.533765 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d59be-4433-49e0-9d8c-6fe8b9265d85 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:28.534052 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d59be-4433-49e0-9d8c-6fe8b9265d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:28.534334 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d59be-4433-49e0-9d8c-6fe8b9265d85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:28.546444 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d59be-4433-49e0-9d8c-6fe8b9265d85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:28.547939 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d59be-4433-49e0-9d8c-6fe8b9265d85 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:28.551383 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04c60e-5d8d-4b1b-9bed-209c6950e866 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:28.565525 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-e22d59be-4433-49e0-9d8c-6fe8b9265d85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:28.572826 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 367/742] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:28.572826 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d59be-4433-49e0-9d8c-6fe8b9265d85 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:28.594850 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3ed60-6b53-48bf-a213-01ef155ca190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:28.595688 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3ed60-6b53-48bf-a213-01ef155ca190 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:28.595975 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3ed60-6b53-48bf-a213-01ef155ca190 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:28.596258 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3ed60-6b53-48bf-a213-01ef155ca190 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:28.607557 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3ed60-6b53-48bf-a213-01ef155ca190 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:28.609030 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3ed60-6b53-48bf-a213-01ef155ca190 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:28.626923 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-dcd3ed60-6b53-48bf-a213-01ef155ca190 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:28.628377 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 376/743] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:28.629689 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e7e6e-438c-4a90-8d63-c268df2399b7 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:28.629976 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e7e6e-438c-4a90-8d63-c268df2399b7 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:28.630254 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e7e6e-438c-4a90-8d63-c268df2399b7 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:28.631907 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 377/744] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:28.633424 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e7e6e-438c-4a90-8d63-c268df2399b7 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:28.686425 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d59be-4433-49e0-9d8c-6fe8b9265d85 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:28.720688 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a78a1-8430-4eb4-9d02-235f058c011a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:28.721508 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a78a1-8430-4eb4-9d02-235f058c011a None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:28.721790 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a78a1-8430-4eb4-9d02-235f058c011a None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:28.722058 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a78a1-8430-4eb4-9d02-235f058c011a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:28.731346 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a78a1-8430-4eb4-9d02-235f058c011a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:28.732725 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a78a1-8430-4eb4-9d02-235f058c011a None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:28.745481 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e7e6e-438c-4a90-8d63-c268df2399b7 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:28.748220 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-299a78a1-8430-4eb4-9d02-235f058c011a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:28.749509 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 368/745] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:28.750300 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a78a1-8430-4eb4-9d02-235f058c011a None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:28.782493 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349e43b-0649-4757-9142-b2804048daf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:28.783166 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349e43b-0649-4757-9142-b2804048daf7 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:28.783454 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349e43b-0649-4757-9142-b2804048daf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:28.783735 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349e43b-0649-4757-9142-b2804048daf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:28.784456 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349e43b-0649-4757-9142-b2804048daf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:28.784765 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349e43b-0649-4757-9142-b2804048daf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:28.786188 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349e43b-0649-4757-9142-b2804048daf7 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:28.804077 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 378/746] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:28.804077 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b096067-23c0-49e1-822d-99bbd6ddded9 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:28.804077 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b096067-23c0-49e1-822d-99bbd6ddded9 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:28.804077 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b096067-23c0-49e1-822d-99bbd6ddded9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:28.819099 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-8b096067-23c0-49e1-822d-99bbd6ddded9 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:28.821254 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-8b096067-23c0-49e1-822d-99bbd6ddded9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:28.861562 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a78a1-8430-4eb4-9d02-235f058c011a None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:28.896939 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 379/747] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:28 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 20:02:28.902746 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12315f56-f7d1-441b-a6fc-69a027fed2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:28.903264 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b096067-23c0-49e1-822d-99bbd6ddded9 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:28.903802 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12315f56-f7d1-441b-a6fc-69a027fed2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:28.904266 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12315f56-f7d1-441b-a6fc-69a027fed2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:28.904728 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12315f56-f7d1-441b-a6fc-69a027fed2b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:28.905969 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12315f56-f7d1-441b-a6fc-69a027fed2b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:28.906474 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12315f56-f7d1-441b-a6fc-69a027fed2b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:28.909028 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12315f56-f7d1-441b-a6fc-69a027fed2b6 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:28.921754 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 369/748] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:28.922621 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12315f56-f7d1-441b-a6fc-69a027fed2b6 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:29.025427 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b096067-23c0-49e1-822d-99bbd6ddded9 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:29.042557 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12315f56-f7d1-441b-a6fc-69a027fed2b6 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:29.066806 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c51fe-c0c7-4671-9e63-35a4f97f79c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:29.067839 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c51fe-c0c7-4671-9e63-35a4f97f79c9 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:29.068297 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c51fe-c0c7-4671-9e63-35a4f97f79c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:29.068760 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c51fe-c0c7-4671-9e63-35a4f97f79c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:29.071447 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c51fe-c0c7-4671-9e63-35a4f97f79c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:29.071447 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c51fe-c0c7-4671-9e63-35a4f97f79c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:29.072864 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c51fe-c0c7-4671-9e63-35a4f97f79c9 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:29.083587 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ab35d-9be6-4485-9c92-f732f8c3a8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:29.084405 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ab35d-9be6-4485-9c92-f732f8c3a8af None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:29.084687 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ab35d-9be6-4485-9c92-f732f8c3a8af None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:29.084962 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ab35d-9be6-4485-9c92-f732f8c3a8af None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:29.090832 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 380/749] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:29.091536 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c51fe-c0c7-4671-9e63-35a4f97f79c9 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:29.094387 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ab35d-9be6-4485-9c92-f732f8c3a8af None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:29.095817 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ab35d-9be6-4485-9c92-f732f8c3a8af None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:29.112171 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-336ab35d-9be6-4485-9c92-f732f8c3a8af None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 29 20:02:29.118794 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 370/750] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Mar 29 20:02:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:29.118794 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ab35d-9be6-4485-9c92-f732f8c3a8af None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:29.200338 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c51fe-c0c7-4671-9e63-35a4f97f79c9 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:29.235345 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ab35d-9be6-4485-9c92-f732f8c3a8af None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:29.242822 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce15145-7e89-4d7d-9bb9-0eb010cdc2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:29.243935 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce15145-7e89-4d7d-9bb9-0eb010cdc2cb None admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:29.244221 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce15145-7e89-4d7d-9bb9-0eb010cdc2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:29.244494 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce15145-7e89-4d7d-9bb9-0eb010cdc2cb None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:29.245487 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce15145-7e89-4d7d-9bb9-0eb010cdc2cb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:29.247176 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce15145-7e89-4d7d-9bb9-0eb010cdc2cb None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:29.275244 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706e72e-cb7e-411a-aea9-4c1176c5dbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:29.276100 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706e72e-cb7e-411a-aea9-4c1176c5dbdd None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:29.276335 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706e72e-cb7e-411a-aea9-4c1176c5dbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:29.276617 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706e72e-cb7e-411a-aea9-4c1176c5dbdd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:29.284687 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706e72e-cb7e-411a-aea9-4c1176c5dbdd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:29.286156 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706e72e-cb7e-411a-aea9-4c1176c5dbdd None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:29.299772 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-3706e72e-cb7e-411a-aea9-4c1176c5dbdd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 29 20:02:29.300970 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 371/751] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Mar 29 20:02:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:29.301775 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706e72e-cb7e-411a-aea9-4c1176c5dbdd None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:29.328939 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 381/752] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Mar 29 20:02:29 2022] POST /identity/v3/services => generated 251 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:02:29.330177 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce15145-7e89-4d7d-9bb9-0eb010cdc2cb None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:29.420240 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706e72e-cb7e-411a-aea9-4c1176c5dbdd None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:29.466795 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b7050-63a7-4c21-a1f6-6ee04a3a219c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:29.468733 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b7050-63a7-4c21-a1f6-6ee04a3a219c None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:29.469027 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b7050-63a7-4c21-a1f6-6ee04a3a219c None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:29.469353 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b7050-63a7-4c21-a1f6-6ee04a3a219c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:29.470814 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b7050-63a7-4c21-a1f6-6ee04a3a219c None admin] RBAC: Adding query filter params (role.id=8cfa924df1a1400986d9ecc9686a7f52, scope.project.id=ec1f2c5cb900473da1083830387e3ff4, user.id=9d6d8e7788494f2c92ad5c183c8fa283) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:29.471293 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b7050-63a7-4c21-a1f6-6ee04a3a219c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:29.474301 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b7050-63a7-4c21-a1f6-6ee04a3a219c None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:29.494662 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 372/753] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:02:29 2022] GET /identity/v3/role_assignments?user.id=9d6d8e7788494f2c92ad5c183c8fa283&scope.project.id=ec1f2c5cb900473da1083830387e3ff4&role.id=8cfa924df1a1400986d9ecc9686a7f52 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:29.494662 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b7050-63a7-4c21-a1f6-6ee04a3a219c None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:29.496182 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce15145-7e89-4d7d-9bb9-0eb010cdc2cb None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:29.629959 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcde464-363f-4785-a8e4-d06236c836ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:29.631344 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcde464-363f-4785-a8e4-d06236c836ee None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:29.631827 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcde464-363f-4785-a8e4-d06236c836ee None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:29.632348 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcde464-363f-4785-a8e4-d06236c836ee None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:29.634583 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcde464-363f-4785-a8e4-d06236c836ee None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:29.636070 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcde464-363f-4785-a8e4-d06236c836ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:29.637833 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcde464-363f-4785-a8e4-d06236c836ee None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:29.701510 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 382/754] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Mar 29 20:02:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:29.702845 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcde464-363f-4785-a8e4-d06236c836ee None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:29.732987 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b7050-63a7-4c21-a1f6-6ee04a3a219c None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:29.787280 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5904603-e9e2-4a88-946f-9195a138b4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:29.790633 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5904603-e9e2-4a88-946f-9195a138b4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:29.791841 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5904603-e9e2-4a88-946f-9195a138b4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:29.792820 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5904603-e9e2-4a88-946f-9195a138b4d7 None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:29.797438 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5904603-e9e2-4a88-946f-9195a138b4d7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:29.798314 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5904603-e9e2-4a88-946f-9195a138b4d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:29.800530 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5904603-e9e2-4a88-946f-9195a138b4d7 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:29.834696 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 373/755] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Mar 29 20:02:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:29.840355 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5904603-e9e2-4a88-946f-9195a138b4d7 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:29.915582 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcde464-363f-4785-a8e4-d06236c836ee None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:30.032758 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd72346-6954-43fc-903d-db4747318b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:30.033450 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd72346-6954-43fc-903d-db4747318b19 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:30.033739 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd72346-6954-43fc-903d-db4747318b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:30.034018 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd72346-6954-43fc-903d-db4747318b19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:30.155461 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5904603-e9e2-4a88-946f-9195a138b4d7 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:30.225823 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd72346-6954-43fc-903d-db4747318b19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:30.227280 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd72346-6954-43fc-903d-db4747318b19 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:30.233059 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b983e7-782f-4d5d-91f0-d3717c4f299a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:30.233916 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b983e7-782f-4d5d-91f0-d3717c4f299a None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:30.234201 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b983e7-782f-4d5d-91f0-d3717c4f299a None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:30.234477 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b983e7-782f-4d5d-91f0-d3717c4f299a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:30.253710 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b983e7-782f-4d5d-91f0-d3717c4f299a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:30.255176 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b983e7-782f-4d5d-91f0-d3717c4f299a None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:30.288628 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-33b983e7-782f-4d5d-91f0-d3717c4f299a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:30.293003 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 374/756] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 454 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:02:30.302246 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b983e7-782f-4d5d-91f0-d3717c4f299a None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:30.406372 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b983e7-782f-4d5d-91f0-d3717c4f299a None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:30.410588 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 383/757] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:02:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 708 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 20:02:30.415987 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd72346-6954-43fc-903d-db4747318b19 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:30.442520 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea2b56-dd79-45a6-960e-2b4c1ce418e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:30.443491 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea2b56-dd79-45a6-960e-2b4c1ce418e9 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:30.443979 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea2b56-dd79-45a6-960e-2b4c1ce418e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:30.444449 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea2b56-dd79-45a6-960e-2b4c1ce418e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:30.446199 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea2b56-dd79-45a6-960e-2b4c1ce418e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:30.446690 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea2b56-dd79-45a6-960e-2b4c1ce418e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:30.448483 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea2b56-dd79-45a6-960e-2b4c1ce418e9 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:30.460680 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 375/758] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:30.477798 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea2b56-dd79-45a6-960e-2b4c1ce418e9 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:30.528294 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd72346-6954-43fc-903d-db4747318b19 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:30.577363 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468c2a9-54ca-45fc-84c2-bc2a6c91e06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:30.578422 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468c2a9-54ca-45fc-84c2-bc2a6c91e06a None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:30.578849 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468c2a9-54ca-45fc-84c2-bc2a6c91e06a None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:30.579294 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468c2a9-54ca-45fc-84c2-bc2a6c91e06a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:30.606098 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea2b56-dd79-45a6-960e-2b4c1ce418e9 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:30.606404 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468c2a9-54ca-45fc-84c2-bc2a6c91e06a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:30.607886 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468c2a9-54ca-45fc-84c2-bc2a6c91e06a None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:30.640531 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd726ff0-bdc4-49bc-a573-967f3d322d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:30.641350 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd726ff0-bdc4-49bc-a573-967f3d322d3e None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:30.641639 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd726ff0-bdc4-49bc-a573-967f3d322d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:30.641919 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd726ff0-bdc4-49bc-a573-967f3d322d3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:30.645048 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-1468c2a9-54ca-45fc-84c2-bc2a6c91e06a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:30.649044 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd726ff0-bdc4-49bc-a573-967f3d322d3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:30.650568 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd726ff0-bdc4-49bc-a573-967f3d322d3e None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:30.654692 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 384/759] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:30.659975 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468c2a9-54ca-45fc-84c2-bc2a6c91e06a None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:30.665414 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-bd726ff0-bdc4-49bc-a573-967f3d322d3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:30.666760 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 376/760] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:30.672900 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd726ff0-bdc4-49bc-a573-967f3d322d3e None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:30.849545 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468c2a9-54ca-45fc-84c2-bc2a6c91e06a None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:30.887179 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd726ff0-bdc4-49bc-a573-967f3d322d3e None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:30.889850 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fbf90-1d96-402d-bdc7-fb8a581a96a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:30.890533 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fbf90-1d96-402d-bdc7-fb8a581a96a8 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:30.890815 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fbf90-1d96-402d-bdc7-fb8a581a96a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:30.891088 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fbf90-1d96-402d-bdc7-fb8a581a96a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:30.891818 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fbf90-1d96-402d-bdc7-fb8a581a96a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:30.892125 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fbf90-1d96-402d-bdc7-fb8a581a96a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:30.894543 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fbf90-1d96-402d-bdc7-fb8a581a96a8 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:30.919796 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 385/761] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:30.926247 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fbf90-1d96-402d-bdc7-fb8a581a96a8 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:30.952734 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6ee54-bc8a-43a5-a90b-890300c1d066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:30.953429 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6ee54-bc8a-43a5-a90b-890300c1d066 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:30.953721 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6ee54-bc8a-43a5-a90b-890300c1d066 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:30.954014 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6ee54-bc8a-43a5-a90b-890300c1d066 None admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:30.954798 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6ee54-bc8a-43a5-a90b-890300c1d066 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:30.955114 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6ee54-bc8a-43a5-a90b-890300c1d066 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:30.956537 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6ee54-bc8a-43a5-a90b-890300c1d066 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:30.971308 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 377/762] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:30.979424 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6ee54-bc8a-43a5-a90b-890300c1d066 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:31.166281 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fbf90-1d96-402d-bdc7-fb8a581a96a8 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:31.194524 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6ee54-bc8a-43a5-a90b-890300c1d066 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:31.208860 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ed0c4-3c7b-4979-97ad-19d76cefb1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:31.209718 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ed0c4-3c7b-4979-97ad-19d76cefb1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:31.210004 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ed0c4-3c7b-4979-97ad-19d76cefb1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:31.210288 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ed0c4-3c7b-4979-97ad-19d76cefb1e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:31.219452 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ed0c4-3c7b-4979-97ad-19d76cefb1e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:31.221598 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ed0c4-3c7b-4979-97ad-19d76cefb1e7 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:31.231157 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019a782-8ca5-4e9f-89b8-0fbf33c9436f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:31.232276 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019a782-8ca5-4e9f-89b8-0fbf33c9436f None admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:31.232773 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019a782-8ca5-4e9f-89b8-0fbf33c9436f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:31.233248 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019a782-8ca5-4e9f-89b8-0fbf33c9436f None admin] PATH_INFO: `/v3/projects/ec1f2c5cb900473da1083830387e3ff4/users/b797e15939694c9abf1f2b8e9aee4d67/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:31.235536 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019a782-8ca5-4e9f-89b8-0fbf33c9436f None admin] RBAC: Authorizing `identity:create_grant(project_id=ec1f2c5cb900473da1083830387e3ff4, user_id=b797e15939694c9abf1f2b8e9aee4d67, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:31.236601 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-9e3ed0c4-3c7b-4979-97ad-19d76cefb1e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:31.237811 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019a782-8ca5-4e9f-89b8-0fbf33c9436f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:31.238113 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 386/763] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:31.239364 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ac85d-c3d9-4b7f-9cb6-9782f9c9a941 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:31.239655 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ac85d-c3d9-4b7f-9cb6-9782f9c9a941 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:31.239941 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ac85d-c3d9-4b7f-9cb6-9782f9c9a941 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:31.246457 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 387/764] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:31.249422 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ac85d-c3d9-4b7f-9cb6-9782f9c9a941 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:31.311339 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 378/765] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Mar 29 20:02:30 2022] PUT /identity/v3/projects/ec1f2c5cb900473da1083830387e3ff4/users/b797e15939694c9abf1f2b8e9aee4d67/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:02:31.312797 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14da2e-f46c-41e6-889c-cf146e9d0f80 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:31.313276 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14da2e-f46c-41e6-889c-cf146e9d0f80 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:31.313638 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14da2e-f46c-41e6-889c-cf146e9d0f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:31.334653 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-fb14da2e-f46c-41e6-889c-cf146e9d0f80 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:31.340029 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-fb14da2e-f46c-41e6-889c-cf146e9d0f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:31.435279 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ac85d-c3d9-4b7f-9cb6-9782f9c9a941 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:31.442050 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 379/766] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:02:31.483955 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14da2e-f46c-41e6-889c-cf146e9d0f80 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:31.519040 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a8f9e-cada-430f-bcec-0075ea7ecdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:31.519728 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a8f9e-cada-430f-bcec-0075ea7ecdcb None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:31.520018 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a8f9e-cada-430f-bcec-0075ea7ecdcb None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:31.520293 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a8f9e-cada-430f-bcec-0075ea7ecdcb None admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:31.521088 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a8f9e-cada-430f-bcec-0075ea7ecdcb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:31.521429 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a8f9e-cada-430f-bcec-0075ea7ecdcb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:31.522871 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a8f9e-cada-430f-bcec-0075ea7ecdcb None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:31.538523 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 388/767] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:31.545875 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a8f9e-cada-430f-bcec-0075ea7ecdcb None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:31.606400 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14da2e-f46c-41e6-889c-cf146e9d0f80 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:31.649828 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd732f9e-92de-4cc8-a478-165625682748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:31.651034 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd732f9e-92de-4cc8-a478-165625682748 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:31.651858 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd732f9e-92de-4cc8-a478-165625682748 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:31.652292 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd732f9e-92de-4cc8-a478-165625682748 None admin] PATH_INFO: `/v3/services/network` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:31.653391 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd732f9e-92de-4cc8-a478-165625682748 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:31.655057 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd732f9e-92de-4cc8-a478-165625682748 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:31.681744 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-dd732f9e-92de-4cc8-a478-165625682748 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 29 20:02:31.685156 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 380/768] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:31 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:02:31.690534 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a8f9e-cada-430f-bcec-0075ea7ecdcb None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:31.691740 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd732f9e-92de-4cc8-a478-165625682748 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:31.765060 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43d076-30d0-46b4-b409-3c97a4a2fbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:31.766129 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43d076-30d0-46b4-b409-3c97a4a2fbe5 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:31.766416 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43d076-30d0-46b4-b409-3c97a4a2fbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:31.766700 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43d076-30d0-46b4-b409-3c97a4a2fbe5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:31.767540 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b43d076-30d0-46b4-b409-3c97a4a2fbe5 None admin] RBAC: Adding query filter params (role.id=04bfd9a52ca84b2db7f73121d5e57b41, scope.project.id=ec1f2c5cb900473da1083830387e3ff4, user.id=a706b6d0163549bc80285c4158331b94) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:31.767852 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b43d076-30d0-46b4-b409-3c97a4a2fbe5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:31.769315 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b43d076-30d0-46b4-b409-3c97a4a2fbe5 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:31.783238 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 389/769] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:02:31 2022] GET /identity/v3/role_assignments?user.id=a706b6d0163549bc80285c4158331b94&scope.project.id=ec1f2c5cb900473da1083830387e3ff4&role.id=04bfd9a52ca84b2db7f73121d5e57b41 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:31.871356 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd732f9e-92de-4cc8-a478-165625682748 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:31.927074 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5335d1e-e32e-443b-98b4-4baf0bf31a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:31.936616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5335d1e-e32e-443b-98b4-4baf0bf31a01 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:31.936616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5335d1e-e32e-443b-98b4-4baf0bf31a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:31.936616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5335d1e-e32e-443b-98b4-4baf0bf31a01 None admin] PATH_INFO: `/v3/services` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:31.936616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5335d1e-e32e-443b-98b4-4baf0bf31a01 None admin] RBAC: Adding query filter params (name=network) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:31.936616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5335d1e-e32e-443b-98b4-4baf0bf31a01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:31.936616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5335d1e-e32e-443b-98b4-4baf0bf31a01 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:31.941889 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 381/770] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Mar 29 20:02:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:31.950710 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43d076-30d0-46b4-b409-3c97a4a2fbe5 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:32.071198 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43d076-30d0-46b4-b409-3c97a4a2fbe5 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:32.105496 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67c2f5-8ac6-4c38-9102-5e745a603e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:32.106255 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67c2f5-8ac6-4c38-9102-5e745a603e78 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:32.106544 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67c2f5-8ac6-4c38-9102-5e745a603e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:32.106820 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67c2f5-8ac6-4c38-9102-5e745a603e78 None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:32.107530 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67c2f5-8ac6-4c38-9102-5e745a603e78 None admin] RBAC: Adding query filter params (type=network) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:32.107847 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67c2f5-8ac6-4c38-9102-5e745a603e78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:32.109215 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67c2f5-8ac6-4c38-9102-5e745a603e78 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:32.114738 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 390/771] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Mar 29 20:02:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:32.122671 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5335d1e-e32e-443b-98b4-4baf0bf31a01 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:32.255145 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ad50a-d9d8-426a-9cd2-4e5893263ba5 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:32.255697 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ad50a-d9d8-426a-9cd2-4e5893263ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:32.255697 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ad50a-d9d8-426a-9cd2-4e5893263ba5 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:32.258374 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 391/772] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:32.263960 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace0954-be43-46f6-b243-45b9ba2dfb03 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:32.264254 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace0954-be43-46f6-b243-45b9ba2dfb03 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:32.264540 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace0954-be43-46f6-b243-45b9ba2dfb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:32.268057 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5335d1e-e32e-443b-98b4-4baf0bf31a01 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:32.286193 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-1ace0954-be43-46f6-b243-45b9ba2dfb03 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:32.287546 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-1ace0954-be43-46f6-b243-45b9ba2dfb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:32.306703 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37e431-701f-4548-8142-5d88c5e937cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:32.308058 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37e431-701f-4548-8142-5d88c5e937cf None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:32.308690 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37e431-701f-4548-8142-5d88c5e937cf None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:32.309359 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37e431-701f-4548-8142-5d88c5e937cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:32.310321 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37e431-701f-4548-8142-5d88c5e937cf None admin] RBAC: Adding query filter params (interface=public, service_id=3e80b4404eaf4139b57c12e7805ba32a, region_id=RegionOne) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:32.310775 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37e431-701f-4548-8142-5d88c5e937cf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:32.312278 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37e431-701f-4548-8142-5d88c5e937cf None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:32.320846 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 382/773] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Mar 29 20:02:32 2022] GET /identity/v3/endpoints?service_id=3e80b4404eaf4139b57c12e7805ba32a&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:32.326961 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37e431-701f-4548-8142-5d88c5e937cf None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:32.381088 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 392/774] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 20:02:32.382955 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9832b30-4849-4f9a-8a7d-fe4dfedd01fe None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:32.383260 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9832b30-4849-4f9a-8a7d-fe4dfedd01fe None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:32.383549 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9832b30-4849-4f9a-8a7d-fe4dfedd01fe None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:32.389516 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 393/775] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:32.393312 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227bcf1-2954-4898-a38a-c7fbfbd23814 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:32.393312 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227bcf1-2954-4898-a38a-c7fbfbd23814 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:32.393312 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227bcf1-2954-4898-a38a-c7fbfbd23814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:32.416578 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-7227bcf1-2954-4898-a38a-c7fbfbd23814 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:32.417809 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-7227bcf1-2954-4898-a38a-c7fbfbd23814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:32.462010 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37e431-701f-4548-8142-5d88c5e937cf None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:32.489387 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 394/776] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:02:32.490255 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227bcf1-2954-4898-a38a-c7fbfbd23814 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:32.506238 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76be85a-a0ba-4d62-b3d4-9b6c8d66502a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:32.507156 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76be85a-a0ba-4d62-b3d4-9b6c8d66502a None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:32.507480 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76be85a-a0ba-4d62-b3d4-9b6c8d66502a None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:32.507771 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76be85a-a0ba-4d62-b3d4-9b6c8d66502a None admin] PATH_INFO: `/v3/services` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:32.508792 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76be85a-a0ba-4d62-b3d4-9b6c8d66502a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:32.510546 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76be85a-a0ba-4d62-b3d4-9b6c8d66502a None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:32.518572 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 383/777] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Mar 29 20:02:32 2022] GET /identity/v3/services => generated 772 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:32.536540 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76be85a-a0ba-4d62-b3d4-9b6c8d66502a None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:32.672059 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227bcf1-2954-4898-a38a-c7fbfbd23814 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:32.732987 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e22d0-dc6d-43b0-96fa-2a69a58f4517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:32.733798 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e22d0-dc6d-43b0-96fa-2a69a58f4517 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:32.734089 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e22d0-dc6d-43b0-96fa-2a69a58f4517 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:32.734372 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e22d0-dc6d-43b0-96fa-2a69a58f4517 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:32.749604 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76be85a-a0ba-4d62-b3d4-9b6c8d66502a None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:32.750142 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e22d0-dc6d-43b0-96fa-2a69a58f4517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:32.761044 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-066e22d0-dc6d-43b0-96fa-2a69a58f4517 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:02:32.762845 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 395/778] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:02:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:32.768499 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e22d0-dc6d-43b0-96fa-2a69a58f4517 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:32.793013 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f91bc8-8c75-4fd1-a7a6-759c73e39e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:32.795063 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f91bc8-8c75-4fd1-a7a6-759c73e39e3d None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:32.795584 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f91bc8-8c75-4fd1-a7a6-759c73e39e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:32.796073 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f91bc8-8c75-4fd1-a7a6-759c73e39e3d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:32.796961 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f91bc8-8c75-4fd1-a7a6-759c73e39e3d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:32.798843 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f91bc8-8c75-4fd1-a7a6-759c73e39e3d None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:32.812653 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-b5f91bc8-8c75-4fd1-a7a6-759c73e39e3d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 29 20:02:32.814574 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 384/779] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Mar 29 20:02:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:02:32.821059 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f91bc8-8c75-4fd1-a7a6-759c73e39e3d None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:32.888874 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e22d0-dc6d-43b0-96fa-2a69a58f4517 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:32.930448 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc88f02-3b65-428a-b97f-fe11669b1914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:32.931186 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc88f02-3b65-428a-b97f-fe11669b1914 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:32.931473 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc88f02-3b65-428a-b97f-fe11669b1914 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:32.931754 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc88f02-3b65-428a-b97f-fe11669b1914 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:32.932511 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc88f02-3b65-428a-b97f-fe11669b1914 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:32.932820 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc88f02-3b65-428a-b97f-fe11669b1914 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:32.934247 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc88f02-3b65-428a-b97f-fe11669b1914 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:32.950388 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 396/780] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:02:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:32.956193 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc88f02-3b65-428a-b97f-fe11669b1914 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:32.985117 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f91bc8-8c75-4fd1-a7a6-759c73e39e3d None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:33.047474 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880f982-fdf8-4106-bb1d-33bc0e0e21d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:33.048072 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880f982-fdf8-4106-bb1d-33bc0e0e21d4 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:33.048357 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880f982-fdf8-4106-bb1d-33bc0e0e21d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:33.048641 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880f982-fdf8-4106-bb1d-33bc0e0e21d4 None admin] PATH_INFO: `/v3/services` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:33.049381 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880f982-fdf8-4106-bb1d-33bc0e0e21d4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:33.049693 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880f982-fdf8-4106-bb1d-33bc0e0e21d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:33.051068 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880f982-fdf8-4106-bb1d-33bc0e0e21d4 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:33.056196 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 385/781] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Mar 29 20:02:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:33.061576 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880f982-fdf8-4106-bb1d-33bc0e0e21d4 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:33.088827 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc88f02-3b65-428a-b97f-fe11669b1914 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:33.137258 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972c326-245b-4337-9de2-02bff0a720d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:33.138093 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972c326-245b-4337-9de2-02bff0a720d7 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:33.138376 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972c326-245b-4337-9de2-02bff0a720d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:33.138654 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972c326-245b-4337-9de2-02bff0a720d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:33.163262 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972c326-245b-4337-9de2-02bff0a720d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:33.165915 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972c326-245b-4337-9de2-02bff0a720d7 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:33.204707 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-1972c326-245b-4337-9de2-02bff0a720d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:33.205420 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880f982-fdf8-4106-bb1d-33bc0e0e21d4 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:33.206332 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 397/782] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:33.214260 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972c326-245b-4337-9de2-02bff0a720d7 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:33.245740 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0eecd-a83d-4584-b5b4-b2121b4dbd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:33.246413 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0eecd-a83d-4584-b5b4-b2121b4dbd9e None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:33.246701 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0eecd-a83d-4584-b5b4-b2121b4dbd9e None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:33.246982 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0eecd-a83d-4584-b5b4-b2121b4dbd9e None admin] PATH_INFO: `/v3/services` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:33.247694 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0eecd-a83d-4584-b5b4-b2121b4dbd9e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:33.248010 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0eecd-a83d-4584-b5b4-b2121b4dbd9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:33.249388 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0eecd-a83d-4584-b5b4-b2121b4dbd9e None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:33.254725 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 386/783] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Mar 29 20:02:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:33.261022 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0eecd-a83d-4584-b5b4-b2121b4dbd9e None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:33.361976 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0eecd-a83d-4584-b5b4-b2121b4dbd9e None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:33.396260 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8d17c-df73-4e0c-80af-e4e574c9ad47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:33.396926 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8d17c-df73-4e0c-80af-e4e574c9ad47 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:33.397267 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8d17c-df73-4e0c-80af-e4e574c9ad47 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:33.397583 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8d17c-df73-4e0c-80af-e4e574c9ad47 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:33.399231 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8d17c-df73-4e0c-80af-e4e574c9ad47 None admin] RBAC: Adding query filter params (interface=public, service_id=14d75f79f3464bfca284d09f1dafd10f, region_id=RegionOne) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:33.399545 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8d17c-df73-4e0c-80af-e4e574c9ad47 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:33.400919 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8d17c-df73-4e0c-80af-e4e574c9ad47 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:33.406461 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 387/784] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Mar 29 20:02:33 2022] GET /identity/v3/endpoints?service_id=14d75f79f3464bfca284d09f1dafd10f&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:33.411715 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8d17c-df73-4e0c-80af-e4e574c9ad47 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:33.471235 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972c326-245b-4337-9de2-02bff0a720d7 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:33.515214 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8d17c-df73-4e0c-80af-e4e574c9ad47 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:33.551764 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862cc31-664c-4713-a189-ebbf2a37d55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:33.552011 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8bc25-7860-4314-a47d-cc7f82f30af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:33.552431 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862cc31-664c-4713-a189-ebbf2a37d55c None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:33.552540 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8bc25-7860-4314-a47d-cc7f82f30af3 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:33.552713 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862cc31-664c-4713-a189-ebbf2a37d55c None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:33.552822 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8bc25-7860-4314-a47d-cc7f82f30af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:33.552988 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862cc31-664c-4713-a189-ebbf2a37d55c None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:33.553168 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8bc25-7860-4314-a47d-cc7f82f30af3 None admin] PATH_INFO: `/v3/services` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:33.553703 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8bc25-7860-4314-a47d-cc7f82f30af3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:33.553894 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862cc31-664c-4713-a189-ebbf2a37d55c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:33.554040 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862cc31-664c-4713-a189-ebbf2a37d55c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:33.555695 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8bc25-7860-4314-a47d-cc7f82f30af3 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:33.556620 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862cc31-664c-4713-a189-ebbf2a37d55c None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:33.561169 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 388/785] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Mar 29 20:02:33 2022] GET /identity/v3/services => generated 772 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:33.569531 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 398/786] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:33.578759 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8bc25-7860-4314-a47d-cc7f82f30af3 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:33.703757 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8bc25-7860-4314-a47d-cc7f82f30af3 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:33.740343 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4fdaa-df49-4344-b6fb-421a3174392c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:33.741146 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4fdaa-df49-4344-b6fb-421a3174392c None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:33.741479 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4fdaa-df49-4344-b6fb-421a3174392c None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:33.741910 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4fdaa-df49-4344-b6fb-421a3174392c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:33.750469 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4fdaa-df49-4344-b6fb-421a3174392c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:33.751928 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4fdaa-df49-4344-b6fb-421a3174392c None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:33.767043 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-84c4fdaa-df49-4344-b6fb-421a3174392c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 29 20:02:33.768586 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 389/787] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:02:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:33.774530 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862cc31-664c-4713-a189-ebbf2a37d55c None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:33.915407 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862cc31-664c-4713-a189-ebbf2a37d55c None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:33.953863 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504215b1-3e2d-4a23-b890-609ed3d3f70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:33.954475 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504215b1-3e2d-4a23-b890-609ed3d3f70d None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:33.954762 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504215b1-3e2d-4a23-b890-609ed3d3f70d None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:33.955041 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504215b1-3e2d-4a23-b890-609ed3d3f70d None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:33.955882 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504215b1-3e2d-4a23-b890-609ed3d3f70d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:33.956194 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504215b1-3e2d-4a23-b890-609ed3d3f70d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:33.957654 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504215b1-3e2d-4a23-b890-609ed3d3f70d None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:33.979249 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 399/788] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Mar 29 20:02:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:33.984453 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4fdaa-df49-4344-b6fb-421a3174392c None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:34.070793 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed3749-347f-440c-99e1-db0854016e74 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:34.071103 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed3749-347f-440c-99e1-db0854016e74 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:34.071355 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed3749-347f-440c-99e1-db0854016e74 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:34.073711 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 400/789] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:02:34.078718 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7db470-8bbd-4ded-a622-19b5a780727b None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:34.079014 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7db470-8bbd-4ded-a622-19b5a780727b None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:34.079296 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7db470-8bbd-4ded-a622-19b5a780727b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:34.101142 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-ce7db470-8bbd-4ded-a622-19b5a780727b None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:34.104262 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-ce7db470-8bbd-4ded-a622-19b5a780727b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:34.110000 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4fdaa-df49-4344-b6fb-421a3174392c None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:34.172525 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cf2f6-5285-4101-9bd7-0774aad225f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:34.173342 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cf2f6-5285-4101-9bd7-0774aad225f5 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:34.173637 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cf2f6-5285-4101-9bd7-0774aad225f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:34.173921 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cf2f6-5285-4101-9bd7-0774aad225f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:34.196468 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73cf2f6-5285-4101-9bd7-0774aad225f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:34.198306 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73cf2f6-5285-4101-9bd7-0774aad225f5 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:34.215246 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-c73cf2f6-5285-4101-9bd7-0774aad225f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:34.216662 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 390/790] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:34.222140 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cf2f6-5285-4101-9bd7-0774aad225f5 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:34.243918 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 401/791] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 20:02:34.338587 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7db470-8bbd-4ded-a622-19b5a780727b None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:34.358485 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cf2f6-5285-4101-9bd7-0774aad225f5 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:34.392856 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f63cae-db21-48ef-8e57-80f766067969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:34.393539 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f63cae-db21-48ef-8e57-80f766067969 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:34.393826 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f63cae-db21-48ef-8e57-80f766067969 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:34.394104 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f63cae-db21-48ef-8e57-80f766067969 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:34.394829 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f63cae-db21-48ef-8e57-80f766067969 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:34.395140 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f63cae-db21-48ef-8e57-80f766067969 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:34.396505 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f63cae-db21-48ef-8e57-80f766067969 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:34.408941 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 391/792] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:34.415139 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f63cae-db21-48ef-8e57-80f766067969 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:34.515740 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f63cae-db21-48ef-8e57-80f766067969 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:34.550758 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9238200-c7ba-4019-9f45-18b8bb84146c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:34.551554 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9238200-c7ba-4019-9f45-18b8bb84146c None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:34.551842 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9238200-c7ba-4019-9f45-18b8bb84146c None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:34.552125 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9238200-c7ba-4019-9f45-18b8bb84146c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:34.557282 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7db470-8bbd-4ded-a622-19b5a780727b None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:34.564633 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9238200-c7ba-4019-9f45-18b8bb84146c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:34.566120 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9238200-c7ba-4019-9f45-18b8bb84146c None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:34.589207 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-d9238200-c7ba-4019-9f45-18b8bb84146c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:34.590751 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 392/793] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:34.596242 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9238200-c7ba-4019-9f45-18b8bb84146c None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:34.619570 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb98744-3e21-432f-900f-d97b84648a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:34.620370 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb98744-3e21-432f-900f-d97b84648a30 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:34.620652 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb98744-3e21-432f-900f-d97b84648a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:34.620918 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb98744-3e21-432f-900f-d97b84648a30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:34.632192 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb98744-3e21-432f-900f-d97b84648a30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:34.639785 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-ecb98744-3e21-432f-900f-d97b84648a30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:02:34.641270 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 402/794] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:02:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:02:34.646622 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b84d3-c084-441d-b730-bd540d343548 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:34.646911 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b84d3-c084-441d-b730-bd540d343548 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:34.647190 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b84d3-c084-441d-b730-bd540d343548 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:34.650111 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 403/795] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:34.651760 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b84d3-c084-441d-b730-bd540d343548 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:34.716692 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9238200-c7ba-4019-9f45-18b8bb84146c None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:34.751738 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963e3f4-272e-4c18-b273-cbeab6836a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:34.752406 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963e3f4-272e-4c18-b273-cbeab6836a77 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:34.752693 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963e3f4-272e-4c18-b273-cbeab6836a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:34.752972 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963e3f4-272e-4c18-b273-cbeab6836a77 None admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:34.753802 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963e3f4-272e-4c18-b273-cbeab6836a77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:34.754116 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963e3f4-272e-4c18-b273-cbeab6836a77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:34.755561 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963e3f4-272e-4c18-b273-cbeab6836a77 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:34.759751 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b84d3-c084-441d-b730-bd540d343548 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:34.774263 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 393/796] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:34.775562 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246d1b6-5eb9-4251-ac70-5c19bd2a8d2a None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:34.775854 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246d1b6-5eb9-4251-ac70-5c19bd2a8d2a None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:34.776157 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246d1b6-5eb9-4251-ac70-5c19bd2a8d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:34.792932 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-a246d1b6-5eb9-4251-ac70-5c19bd2a8d2a None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:34.794157 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-a246d1b6-5eb9-4251-ac70-5c19bd2a8d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:34.795836 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea07116-9ebb-4e0c-aa42-f77ccdbac54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:34.796556 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea07116-9ebb-4e0c-aa42-f77ccdbac54c None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:34.796855 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea07116-9ebb-4e0c-aa42-f77ccdbac54c None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:34.797113 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea07116-9ebb-4e0c-aa42-f77ccdbac54c None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:34.797977 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea07116-9ebb-4e0c-aa42-f77ccdbac54c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:34.798334 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea07116-9ebb-4e0c-aa42-f77ccdbac54c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:34.799725 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea07116-9ebb-4e0c-aa42-f77ccdbac54c None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:34.814726 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 404/797] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:02:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:34.815646 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea07116-9ebb-4e0c-aa42-f77ccdbac54c None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:34.869380 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 394/798] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:02:34.870293 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246d1b6-5eb9-4251-ac70-5c19bd2a8d2a None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:34.921580 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea07116-9ebb-4e0c-aa42-f77ccdbac54c None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:34.958178 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efae05-3b74-4654-a785-d3e149199cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:34.959121 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efae05-3b74-4654-a785-d3e149199cf6 None admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:34.959407 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efae05-3b74-4654-a785-d3e149199cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:34.959681 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efae05-3b74-4654-a785-d3e149199cf6 None admin] PATH_INFO: `/v3/projects/ec1f2c5cb900473da1083830387e3ff4/users/9d6d8e7788494f2c92ad5c183c8fa283/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:34.962417 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5efae05-3b74-4654-a785-d3e149199cf6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec1f2c5cb900473da1083830387e3ff4, user_id=9d6d8e7788494f2c92ad5c183c8fa283, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:34.963849 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5efae05-3b74-4654-a785-d3e149199cf6 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:34.992514 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246d1b6-5eb9-4251-ac70-5c19bd2a8d2a None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:35.029215 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeafe7e-2326-4329-87e0-8691ae361e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:35.031137 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeafe7e-2326-4329-87e0-8691ae361e14 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:35.034616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeafe7e-2326-4329-87e0-8691ae361e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:35.034616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeafe7e-2326-4329-87e0-8691ae361e14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:35.046103 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 405/799] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Mar 29 20:02:34 2022] PUT /identity/v3/projects/ec1f2c5cb900473da1083830387e3ff4/users/9d6d8e7788494f2c92ad5c183c8fa283/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:02:35.047556 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efae05-3b74-4654-a785-d3e149199cf6 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:35.062632 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeafe7e-2326-4329-87e0-8691ae361e14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:35.064507 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeafe7e-2326-4329-87e0-8691ae361e14 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:35.100777 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-ddeafe7e-2326-4329-87e0-8691ae361e14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:35.106474 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 395/800] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:35.112204 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeafe7e-2326-4329-87e0-8691ae361e14 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:35.245556 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efae05-3b74-4654-a785-d3e149199cf6 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:35.288916 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1026d-433f-4286-9534-6eb11481e06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:35.289998 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1026d-433f-4286-9534-6eb11481e06b None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:35.290431 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1026d-433f-4286-9534-6eb11481e06b None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:35.291352 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1026d-433f-4286-9534-6eb11481e06b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:35.307511 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a1026d-433f-4286-9534-6eb11481e06b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:35.310441 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeafe7e-2326-4329-87e0-8691ae361e14 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:35.314908 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-b0a1026d-433f-4286-9534-6eb11481e06b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 20:02:35.316510 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 406/801] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Mar 29 20:02:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:35.323704 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1026d-433f-4286-9534-6eb11481e06b None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:35.347195 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9f105-171f-4279-aaed-7cac97edf758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:35.348099 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9f105-171f-4279-aaed-7cac97edf758 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:35.348536 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9f105-171f-4279-aaed-7cac97edf758 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:35.348953 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9f105-171f-4279-aaed-7cac97edf758 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:35.349887 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9f105-171f-4279-aaed-7cac97edf758 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:35.350421 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9f105-171f-4279-aaed-7cac97edf758 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:35.352742 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9f105-171f-4279-aaed-7cac97edf758 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:35.365105 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 396/802] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:35.372436 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9f105-171f-4279-aaed-7cac97edf758 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:35.446666 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1026d-433f-4286-9534-6eb11481e06b None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:35.485409 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9f105-171f-4279-aaed-7cac97edf758 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:35.491418 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1f1bf-c254-4c17-90da-759cf3b628bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:35.492980 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1f1bf-c254-4c17-90da-759cf3b628bc None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:35.493537 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1f1bf-c254-4c17-90da-759cf3b628bc None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:35.494048 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1f1bf-c254-4c17-90da-759cf3b628bc None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:35.495000 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1f1bf-c254-4c17-90da-759cf3b628bc None admin] RBAC: Adding query filter params (name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:35.495512 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1f1bf-c254-4c17-90da-759cf3b628bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:35.497388 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1f1bf-c254-4c17-90da-759cf3b628bc None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:35.507925 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 407/803] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Mar 29 20:02:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:35.509684 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84faf8a6-ccd8-40ad-946c-a534ef8a568d None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:35.510187 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84faf8a6-ccd8-40ad-946c-a534ef8a568d None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:35.510670 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84faf8a6-ccd8-40ad-946c-a534ef8a568d None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:35.512949 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 408/804] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:35.513966 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84faf8a6-ccd8-40ad-946c-a534ef8a568d None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:35.524766 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa435b-2575-456d-aa7f-f30bc836c7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:35.525935 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa435b-2575-456d-aa7f-f30bc836c7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:35.526430 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa435b-2575-456d-aa7f-f30bc836c7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:35.526994 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa435b-2575-456d-aa7f-f30bc836c7d2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:35.535439 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa435b-2575-456d-aa7f-f30bc836c7d2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:35.537129 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa435b-2575-456d-aa7f-f30bc836c7d2 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:35.552506 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-74aa435b-2575-456d-aa7f-f30bc836c7d2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 29 20:02:35.554714 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 397/805] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Mar 29 20:02:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:35.556142 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db39c6-2c23-46cb-aabf-307c1c2a08a6 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:35.556664 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db39c6-2c23-46cb-aabf-307c1c2a08a6 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:35.557154 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db39c6-2c23-46cb-aabf-307c1c2a08a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:35.574885 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-a1db39c6-2c23-46cb-aabf-307c1c2a08a6 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:35.576217 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-a1db39c6-2c23-46cb-aabf-307c1c2a08a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:35.644000 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84faf8a6-ccd8-40ad-946c-a534ef8a568d None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:35.647560 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 398/806] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:02:35.648927 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db39c6-2c23-46cb-aabf-307c1c2a08a6 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:35.685321 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17ae13-940e-4750-99e9-62890bc41654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:35.686329 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17ae13-940e-4750-99e9-62890bc41654 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:35.686768 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17ae13-940e-4750-99e9-62890bc41654 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:35.687137 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17ae13-940e-4750-99e9-62890bc41654 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:35.699670 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17ae13-940e-4750-99e9-62890bc41654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:35.701254 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17ae13-940e-4750-99e9-62890bc41654 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:35.718830 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-fe17ae13-940e-4750-99e9-62890bc41654 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:35.720445 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 409/807] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:35.721412 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17ae13-940e-4750-99e9-62890bc41654 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:35.764133 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db39c6-2c23-46cb-aabf-307c1c2a08a6 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:35.799757 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ede13f-4339-4819-a71d-a9bbbabe5804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:35.800661 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ede13f-4339-4819-a71d-a9bbbabe5804 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:35.801043 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ede13f-4339-4819-a71d-a9bbbabe5804 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:35.801452 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ede13f-4339-4819-a71d-a9bbbabe5804 None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:35.802445 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ede13f-4339-4819-a71d-a9bbbabe5804 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:35.802913 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ede13f-4339-4819-a71d-a9bbbabe5804 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:35.805032 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ede13f-4339-4819-a71d-a9bbbabe5804 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:35.826546 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 399/808] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Mar 29 20:02:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:35.827602 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ede13f-4339-4819-a71d-a9bbbabe5804 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:35.839422 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17ae13-940e-4750-99e9-62890bc41654 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:35.876276 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212c6e1-42f2-4074-9651-2d86a925cb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:35.877085 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212c6e1-42f2-4074-9651-2d86a925cb08 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:35.877395 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212c6e1-42f2-4074-9651-2d86a925cb08 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:35.877677 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212c6e1-42f2-4074-9651-2d86a925cb08 None admin] PATH_INFO: `/v3/services/network` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:35.878331 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212c6e1-42f2-4074-9651-2d86a925cb08 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:35.879697 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212c6e1-42f2-4074-9651-2d86a925cb08 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:35.892952 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-4212c6e1-42f2-4074-9651-2d86a925cb08 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 29 20:02:35.894474 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 410/809] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:35 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:35.895337 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212c6e1-42f2-4074-9651-2d86a925cb08 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:35.957523 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ede13f-4339-4819-a71d-a9bbbabe5804 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:35.999249 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e89341-2da4-49cb-b809-cebf11b14b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:35.999938 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e89341-2da4-49cb-b809-cebf11b14b3d None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:36.000224 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e89341-2da4-49cb-b809-cebf11b14b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:36.000513 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e89341-2da4-49cb-b809-cebf11b14b3d None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:36.001257 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e89341-2da4-49cb-b809-cebf11b14b3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:36.001604 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e89341-2da4-49cb-b809-cebf11b14b3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:36.003113 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e89341-2da4-49cb-b809-cebf11b14b3d None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:36.008903 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212c6e1-42f2-4074-9651-2d86a925cb08 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:36.022398 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 400/810] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:36.023492 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e89341-2da4-49cb-b809-cebf11b14b3d None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:36.052475 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254fabe-b2da-4aa2-b9a9-ad27b0625606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:36.053474 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254fabe-b2da-4aa2-b9a9-ad27b0625606 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:36.054135 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254fabe-b2da-4aa2-b9a9-ad27b0625606 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:36.054425 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254fabe-b2da-4aa2-b9a9-ad27b0625606 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:36.126193 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e89341-2da4-49cb-b809-cebf11b14b3d None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:36.142224 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254fabe-b2da-4aa2-b9a9-ad27b0625606 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:36.144184 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254fabe-b2da-4aa2-b9a9-ad27b0625606 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:36.160199 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fc35a-77bf-4858-97a6-49a3a1fa6fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:36.160866 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fc35a-77bf-4858-97a6-49a3a1fa6fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:36.161210 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fc35a-77bf-4858-97a6-49a3a1fa6fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:36.161522 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fc35a-77bf-4858-97a6-49a3a1fa6fb3 None admin] PATH_INFO: `/v3/services` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:36.162278 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fc35a-77bf-4858-97a6-49a3a1fa6fb3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:36.162594 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fc35a-77bf-4858-97a6-49a3a1fa6fb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:36.164014 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fc35a-77bf-4858-97a6-49a3a1fa6fb3 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:36.168800 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 401/811] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Mar 29 20:02:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:36.169628 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fc35a-77bf-4858-97a6-49a3a1fa6fb3 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:36.262901 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 411/812] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:02:35 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 20:02:36.263824 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254fabe-b2da-4aa2-b9a9-ad27b0625606 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:36.282177 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fc35a-77bf-4858-97a6-49a3a1fa6fb3 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:36.326143 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc47129-df37-4c38-9bfb-08fc4ca5084f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:36.326890 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc47129-df37-4c38-9bfb-08fc4ca5084f None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:36.327174 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc47129-df37-4c38-9bfb-08fc4ca5084f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:36.327455 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc47129-df37-4c38-9bfb-08fc4ca5084f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:36.338577 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc47129-df37-4c38-9bfb-08fc4ca5084f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:36.340406 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc47129-df37-4c38-9bfb-08fc4ca5084f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:36.359669 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-7bc47129-df37-4c38-9bfb-08fc4ca5084f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 29 20:02:36.361332 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 402/813] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Mar 29 20:02:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:36.362132 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc47129-df37-4c38-9bfb-08fc4ca5084f None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:36.366274 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254fabe-b2da-4aa2-b9a9-ad27b0625606 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:36.401861 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32318b38-4bc4-46f3-963f-74849338dfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:36.402653 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32318b38-4bc4-46f3-963f-74849338dfc4 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:36.402991 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32318b38-4bc4-46f3-963f-74849338dfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:36.403275 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32318b38-4bc4-46f3-963f-74849338dfc4 None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:36.403994 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32318b38-4bc4-46f3-963f-74849338dfc4 None admin] RBAC: Adding query filter params (type=network) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:36.404306 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32318b38-4bc4-46f3-963f-74849338dfc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:36.405851 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32318b38-4bc4-46f3-963f-74849338dfc4 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:36.411705 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 412/814] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Mar 29 20:02:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:36.412378 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32318b38-4bc4-46f3-963f-74849338dfc4 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:36.471098 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc47129-df37-4c38-9bfb-08fc4ca5084f None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:36.503077 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ea071-5710-48e4-81c4-626e91e63c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:36.503895 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ea071-5710-48e4-81c4-626e91e63c77 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:36.504163 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ea071-5710-48e4-81c4-626e91e63c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:36.504440 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ea071-5710-48e4-81c4-626e91e63c77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:36.514976 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32318b38-4bc4-46f3-963f-74849338dfc4 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:36.515343 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ea071-5710-48e4-81c4-626e91e63c77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:36.516772 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ea071-5710-48e4-81c4-626e91e63c77 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:36.533470 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-5b4ea071-5710-48e4-81c4-626e91e63c77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:36.539392 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 403/815] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:36.539392 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a35e64-55b0-41b8-bb80-c7af96c59f76 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:36.539392 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a35e64-55b0-41b8-bb80-c7af96c59f76 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:36.539392 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a35e64-55b0-41b8-bb80-c7af96c59f76 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:36.539392 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 404/816] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:36.539766 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a35e64-55b0-41b8-bb80-c7af96c59f76 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:36.554427 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105c10f-4910-43f9-a963-cbe5b2304068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:36.555103 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105c10f-4910-43f9-a963-cbe5b2304068 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:36.555385 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105c10f-4910-43f9-a963-cbe5b2304068 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:36.555660 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105c10f-4910-43f9-a963-cbe5b2304068 None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:36.556485 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105c10f-4910-43f9-a963-cbe5b2304068 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:36.556792 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105c10f-4910-43f9-a963-cbe5b2304068 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:36.558263 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105c10f-4910-43f9-a963-cbe5b2304068 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:36.580629 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 413/817] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Mar 29 20:02:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:36.580629 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105c10f-4910-43f9-a963-cbe5b2304068 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:36.644976 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a35e64-55b0-41b8-bb80-c7af96c59f76 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:36.675627 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105c10f-4910-43f9-a963-cbe5b2304068 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:36.677385 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809ddd2-e79a-440f-adaa-d773a7b2bce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:36.678047 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809ddd2-e79a-440f-adaa-d773a7b2bce4 None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:36.678331 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809ddd2-e79a-440f-adaa-d773a7b2bce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:36.678616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809ddd2-e79a-440f-adaa-d773a7b2bce4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:36.679378 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809ddd2-e79a-440f-adaa-d773a7b2bce4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:36.680922 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809ddd2-e79a-440f-adaa-d773a7b2bce4 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:36.711317 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17697971-abe4-4634-aa30-632c1af99079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:36.712044 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17697971-abe4-4634-aa30-632c1af99079 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:36.712332 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17697971-abe4-4634-aa30-632c1af99079 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:36.713992 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17697971-abe4-4634-aa30-632c1af99079 None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:36.713992 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17697971-abe4-4634-aa30-632c1af99079 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:36.713992 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17697971-abe4-4634-aa30-632c1af99079 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:36.715018 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17697971-abe4-4634-aa30-632c1af99079 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:36.726048 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 414/818] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:36.727419 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba221e79-aa79-40d4-ae58-8fe406e1541a None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:36.727710 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba221e79-aa79-40d4-ae58-8fe406e1541a None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:36.727990 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba221e79-aa79-40d4-ae58-8fe406e1541a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:36.744088 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-ba221e79-aa79-40d4-ae58-8fe406e1541a None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:36.745271 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-ba221e79-aa79-40d4-ae58-8fe406e1541a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:36.805322 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 405/819] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Mar 29 20:02:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:02:36.805322 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809ddd2-e79a-440f-adaa-d773a7b2bce4 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:36.819162 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 415/820] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:02:36.821486 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba221e79-aa79-40d4-ae58-8fe406e1541a None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:36.970477 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809ddd2-e79a-440f-adaa-d773a7b2bce4 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:36.971049 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba221e79-aa79-40d4-ae58-8fe406e1541a None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:37.012578 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e57ff8-6843-4c88-a09f-698e460b4508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:37.013460 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e57ff8-6843-4c88-a09f-698e460b4508 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:37.013705 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e57ff8-6843-4c88-a09f-698e460b4508 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:37.014157 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e57ff8-6843-4c88-a09f-698e460b4508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:37.017204 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476ebef-4785-4099-bbea-d130ef253d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:37.018775 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476ebef-4785-4099-bbea-d130ef253d95 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:37.019063 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476ebef-4785-4099-bbea-d130ef253d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:37.019340 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476ebef-4785-4099-bbea-d130ef253d95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:37.028418 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476ebef-4785-4099-bbea-d130ef253d95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:37.028669 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e57ff8-6843-4c88-a09f-698e460b4508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:37.030769 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476ebef-4785-4099-bbea-d130ef253d95 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:37.030897 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e57ff8-6843-4c88-a09f-698e460b4508 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:37.046986 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-b476ebef-4785-4099-bbea-d130ef253d95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:37.053353 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 416/821] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:37.053353 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476ebef-4785-4099-bbea-d130ef253d95 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:37.056096 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-03e57ff8-6843-4c88-a09f-698e460b4508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:37.057711 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 406/822] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:37.058515 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e57ff8-6843-4c88-a09f-698e460b4508 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:37.154278 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476ebef-4785-4099-bbea-d130ef253d95 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:37.163278 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e57ff8-6843-4c88-a09f-698e460b4508 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:37.187634 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339200e-80ee-4c5a-a4d0-0fa62039e19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:37.188378 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339200e-80ee-4c5a-a4d0-0fa62039e19c None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:37.188667 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339200e-80ee-4c5a-a4d0-0fa62039e19c None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:37.188948 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339200e-80ee-4c5a-a4d0-0fa62039e19c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:37.190107 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339200e-80ee-4c5a-a4d0-0fa62039e19c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:37.191027 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339200e-80ee-4c5a-a4d0-0fa62039e19c None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:37.201519 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b5d91-ce88-4c4c-8b6c-43ff6f336ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:37.202274 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b5d91-ce88-4c4c-8b6c-43ff6f336ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:37.202563 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b5d91-ce88-4c4c-8b6c-43ff6f336ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:37.202836 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b5d91-ce88-4c4c-8b6c-43ff6f336ab2 None admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:37.203595 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-2339200e-80ee-4c5a-a4d0-0fa62039e19c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 29 20:02:37.203691 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b5d91-ce88-4c4c-8b6c-43ff6f336ab2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:37.203977 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b5d91-ce88-4c4c-8b6c-43ff6f336ab2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:37.204960 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 417/823] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Mar 29 20:02:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:37.207532 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339200e-80ee-4c5a-a4d0-0fa62039e19c None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:37.207647 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b5d91-ce88-4c4c-8b6c-43ff6f336ab2 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:37.218678 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 407/824] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:37.219775 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b5d91-ce88-4c4c-8b6c-43ff6f336ab2 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:37.315032 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339200e-80ee-4c5a-a4d0-0fa62039e19c None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:37.321481 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b5d91-ce88-4c4c-8b6c-43ff6f336ab2 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:37.347649 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce4dcb-256b-4973-861f-fe6b72ee9a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:37.348318 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce4dcb-256b-4973-861f-fe6b72ee9a51 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:37.348614 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce4dcb-256b-4973-861f-fe6b72ee9a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:37.348893 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce4dcb-256b-4973-861f-fe6b72ee9a51 None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:37.349648 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce4dcb-256b-4973-861f-fe6b72ee9a51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:37.349957 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce4dcb-256b-4973-861f-fe6b72ee9a51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:37.351922 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce4dcb-256b-4973-861f-fe6b72ee9a51 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:37.354907 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f730edf-49a0-4025-85a5-0f47f710da6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:37.355569 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f730edf-49a0-4025-85a5-0f47f710da6c None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:37.355854 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f730edf-49a0-4025-85a5-0f47f710da6c None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:37.356125 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f730edf-49a0-4025-85a5-0f47f710da6c None admin] PATH_INFO: `/v3/services` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:37.356822 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f730edf-49a0-4025-85a5-0f47f710da6c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:37.357126 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f730edf-49a0-4025-85a5-0f47f710da6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:37.358518 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f730edf-49a0-4025-85a5-0f47f710da6c None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:37.368068 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 408/825] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Mar 29 20:02:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:37.368068 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f730edf-49a0-4025-85a5-0f47f710da6c None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:37.368798 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 418/826] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:37.369652 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce4dcb-256b-4973-861f-fe6b72ee9a51 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:37.464086 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f730edf-49a0-4025-85a5-0f47f710da6c None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:37.465736 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce4dcb-256b-4973-861f-fe6b72ee9a51 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:37.499089 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee1c24-3bd7-48c4-9ecb-cfc41e80474f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:37.499414 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228cd514-f0ff-4fea-9ba7-c9859c328dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:37.499766 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee1c24-3bd7-48c4-9ecb-cfc41e80474f None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:37.500039 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee1c24-3bd7-48c4-9ecb-cfc41e80474f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:37.500148 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cd514-f0ff-4fea-9ba7-c9859c328dda None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:37.500315 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee1c24-3bd7-48c4-9ecb-cfc41e80474f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:37.500407 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cd514-f0ff-4fea-9ba7-c9859c328dda None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:37.500647 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cd514-f0ff-4fea-9ba7-c9859c328dda None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:37.501142 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee1c24-3bd7-48c4-9ecb-cfc41e80474f None admin] RBAC: Adding query filter params (role.id=8cfa924df1a1400986d9ecc9686a7f52, scope.project.id=ec1f2c5cb900473da1083830387e3ff4, user.id=b797e15939694c9abf1f2b8e9aee4d67) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:37.501369 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228cd514-f0ff-4fea-9ba7-c9859c328dda None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:37.501524 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee1c24-3bd7-48c4-9ecb-cfc41e80474f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:37.501670 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228cd514-f0ff-4fea-9ba7-c9859c328dda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:37.502938 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee1c24-3bd7-48c4-9ecb-cfc41e80474f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:37.503041 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228cd514-f0ff-4fea-9ba7-c9859c328dda None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:37.512912 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 419/827] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Mar 29 20:02:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:37.512912 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228cd514-f0ff-4fea-9ba7-c9859c328dda None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:37.513143 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 409/828] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:02:37 2022] GET /identity/v3/role_assignments?user.id=b797e15939694c9abf1f2b8e9aee4d67&scope.project.id=ec1f2c5cb900473da1083830387e3ff4&role.id=8cfa924df1a1400986d9ecc9686a7f52 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:37.513753 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee1c24-3bd7-48c4-9ecb-cfc41e80474f None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:37.626837 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee1c24-3bd7-48c4-9ecb-cfc41e80474f None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:37.629192 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228cd514-f0ff-4fea-9ba7-c9859c328dda None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:37.663092 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00179590-5534-401a-818e-60e618e44b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:37.664557 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00179590-5534-401a-818e-60e618e44b94 None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:37.665032 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00179590-5534-401a-818e-60e618e44b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:37.665347 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00179590-5534-401a-818e-60e618e44b94 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:37.666110 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00179590-5534-401a-818e-60e618e44b94 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:37.666805 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35e42c-8e81-4941-83f0-2351e4f9f88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:37.667506 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00179590-5534-401a-818e-60e618e44b94 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:37.667616 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35e42c-8e81-4941-83f0-2351e4f9f88b None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:37.667888 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35e42c-8e81-4941-83f0-2351e4f9f88b None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:37.668166 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35e42c-8e81-4941-83f0-2351e4f9f88b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:37.677187 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35e42c-8e81-4941-83f0-2351e4f9f88b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:37.678627 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35e42c-8e81-4941-83f0-2351e4f9f88b None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:37.692579 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-4e35e42c-8e81-4941-83f0-2351e4f9f88b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:37.696252 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 420/829] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:37.696252 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21267c4c-6672-46d3-b1fc-83055acabf5b None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:37.696252 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21267c4c-6672-46d3-b1fc-83055acabf5b None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:37.696252 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21267c4c-6672-46d3-b1fc-83055acabf5b None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:37.698252 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 421/830] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:37.699789 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21267c4c-6672-46d3-b1fc-83055acabf5b None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:37.755779 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 410/831] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Mar 29 20:02:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:02:37.756931 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a19f58-b275-4c04-ae4e-d9cac001d274 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:37.757212 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a19f58-b275-4c04-ae4e-d9cac001d274 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:37.757520 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a19f58-b275-4c04-ae4e-d9cac001d274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:37.781349 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-34a19f58-b275-4c04-ae4e-d9cac001d274 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:37.781349 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-34a19f58-b275-4c04-ae4e-d9cac001d274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:37.827727 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21267c4c-6672-46d3-b1fc-83055acabf5b None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:37.867299 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e851d-d06b-492c-8f34-ac8f3ba6af24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:37.867985 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e851d-d06b-492c-8f34-ac8f3ba6af24 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:37.868274 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e851d-d06b-492c-8f34-ac8f3ba6af24 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:37.868552 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e851d-d06b-492c-8f34-ac8f3ba6af24 None admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:37.869380 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e851d-d06b-492c-8f34-ac8f3ba6af24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:37.869699 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e851d-d06b-492c-8f34-ac8f3ba6af24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:37.871182 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e851d-d06b-492c-8f34-ac8f3ba6af24 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:37.881428 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 411/832] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:02:37.892221 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 422/833] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:37.898752 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a19f58-b275-4c04-ae4e-d9cac001d274 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:37.903590 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e851d-d06b-492c-8f34-ac8f3ba6af24 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:38.037405 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a19f58-b275-4c04-ae4e-d9cac001d274 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:38.044997 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e851d-d06b-492c-8f34-ac8f3ba6af24 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:38.067659 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a8508-e8ff-408a-b53e-2504841b168c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:38.068651 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a8508-e8ff-408a-b53e-2504841b168c None admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:38.069005 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a8508-e8ff-408a-b53e-2504841b168c None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:38.069387 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a8508-e8ff-408a-b53e-2504841b168c None admin] PATH_INFO: `/v3/projects/ec1f2c5cb900473da1083830387e3ff4/users/a706b6d0163549bc80285c4158331b94/roles/04bfd9a52ca84b2db7f73121d5e57b41` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:38.084165 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a8508-e8ff-408a-b53e-2504841b168c None admin] RBAC: Authorizing `identity:create_grant(project_id=ec1f2c5cb900473da1083830387e3ff4, user_id=a706b6d0163549bc80285c4158331b94, role_id=04bfd9a52ca84b2db7f73121d5e57b41)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:38.085799 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a8508-e8ff-408a-b53e-2504841b168c None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:38.092406 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515d408-095d-45bf-9830-bc31a41a8291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:38.093197 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515d408-095d-45bf-9830-bc31a41a8291 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:38.093515 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515d408-095d-45bf-9830-bc31a41a8291 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:38.093792 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515d408-095d-45bf-9830-bc31a41a8291 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:38.105240 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515d408-095d-45bf-9830-bc31a41a8291 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:38.112254 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-1515d408-095d-45bf-9830-bc31a41a8291 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:02:38.118895 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 423/834] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:02:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:38.119888 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515d408-095d-45bf-9830-bc31a41a8291 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:38.156179 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 412/835] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Mar 29 20:02:37 2022] PUT /identity/v3/projects/ec1f2c5cb900473da1083830387e3ff4/users/a706b6d0163549bc80285c4158331b94/roles/04bfd9a52ca84b2db7f73121d5e57b41 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:02:38.230239 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515d408-095d-45bf-9830-bc31a41a8291 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:38.268752 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc65808-8673-4dda-85b0-2a69c1914bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:38.269567 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc65808-8673-4dda-85b0-2a69c1914bed None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:38.269916 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc65808-8673-4dda-85b0-2a69c1914bed None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:38.270261 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc65808-8673-4dda-85b0-2a69c1914bed None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:38.271085 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc65808-8673-4dda-85b0-2a69c1914bed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:38.271460 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc65808-8673-4dda-85b0-2a69c1914bed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:38.273743 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc65808-8673-4dda-85b0-2a69c1914bed None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:38.283414 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 424/836] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:02:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:38.290025 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a8508-e8ff-408a-b53e-2504841b168c None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:38.399944 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a8508-e8ff-408a-b53e-2504841b168c None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:38.436112 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452de07c-3459-4d6f-b61f-8baf33dc91e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:38.437228 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452de07c-3459-4d6f-b61f-8baf33dc91e2 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:38.437686 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452de07c-3459-4d6f-b61f-8baf33dc91e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:38.438108 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452de07c-3459-4d6f-b61f-8baf33dc91e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:38.449258 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452de07c-3459-4d6f-b61f-8baf33dc91e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:38.450931 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452de07c-3459-4d6f-b61f-8baf33dc91e2 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:38.468566 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-452de07c-3459-4d6f-b61f-8baf33dc91e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:38.470269 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 413/837] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:38.476128 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc65808-8673-4dda-85b0-2a69c1914bed None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:38.580373 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc65808-8673-4dda-85b0-2a69c1914bed None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:38.619316 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacdedb-5ac8-49c7-9048-5ad12dff4217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:38.620337 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacdedb-5ac8-49c7-9048-5ad12dff4217 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:38.620803 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacdedb-5ac8-49c7-9048-5ad12dff4217 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:38.621234 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacdedb-5ac8-49c7-9048-5ad12dff4217 None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:38.622123 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacdedb-5ac8-49c7-9048-5ad12dff4217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:38.622583 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacdedb-5ac8-49c7-9048-5ad12dff4217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:38.624218 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacdedb-5ac8-49c7-9048-5ad12dff4217 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:38.637060 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 425/838] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:38.642845 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452de07c-3459-4d6f-b61f-8baf33dc91e2 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:38.746288 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452de07c-3459-4d6f-b61f-8baf33dc91e2 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:38.781876 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa1581-6e82-44f1-b0e6-5aff3a3d6f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:38.782685 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa1581-6e82-44f1-b0e6-5aff3a3d6f7e None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:38.782974 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa1581-6e82-44f1-b0e6-5aff3a3d6f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:38.783252 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa1581-6e82-44f1-b0e6-5aff3a3d6f7e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:38.791190 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa1581-6e82-44f1-b0e6-5aff3a3d6f7e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:38.792650 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa1581-6e82-44f1-b0e6-5aff3a3d6f7e None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:38.807636 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-75fa1581-6e82-44f1-b0e6-5aff3a3d6f7e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 29 20:02:38.809098 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 414/839] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:02:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:38.814771 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacdedb-5ac8-49c7-9048-5ad12dff4217 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:38.918928 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacdedb-5ac8-49c7-9048-5ad12dff4217 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:38.955345 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5fd8b-620b-455f-a8f0-fcd13c6e0c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:38.956138 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5fd8b-620b-455f-a8f0-fcd13c6e0c14 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:38.956429 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5fd8b-620b-455f-a8f0-fcd13c6e0c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:38.956708 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5fd8b-620b-455f-a8f0-fcd13c6e0c14 None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:38.957567 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5fd8b-620b-455f-a8f0-fcd13c6e0c14 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:38.957878 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5fd8b-620b-455f-a8f0-fcd13c6e0c14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:38.959314 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5fd8b-620b-455f-a8f0-fcd13c6e0c14 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:38.978302 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 426/840] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Mar 29 20:02:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:38.983903 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa1581-6e82-44f1-b0e6-5aff3a3d6f7e None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:39.090726 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa1581-6e82-44f1-b0e6-5aff3a3d6f7e None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:39.125662 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b2adb-0ae9-466c-82d2-c6768c3667a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:39.126672 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b2adb-0ae9-466c-82d2-c6768c3667a1 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:39.127167 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b2adb-0ae9-466c-82d2-c6768c3667a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:39.127667 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b2adb-0ae9-466c-82d2-c6768c3667a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:39.195368 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b2adb-0ae9-466c-82d2-c6768c3667a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:39.197478 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b2adb-0ae9-466c-82d2-c6768c3667a1 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:39.308707 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 415/841] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:02:38 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 20:02:39.314112 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5fd8b-620b-455f-a8f0-fcd13c6e0c14 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:39.416945 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5fd8b-620b-455f-a8f0-fcd13c6e0c14 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:39.452793 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4e6d8-670a-49b1-a24f-9eba8afee673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:39.453618 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4e6d8-670a-49b1-a24f-9eba8afee673 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:39.453908 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4e6d8-670a-49b1-a24f-9eba8afee673 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:39.454189 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4e6d8-670a-49b1-a24f-9eba8afee673 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:39.464450 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4e6d8-670a-49b1-a24f-9eba8afee673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:39.465944 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4e6d8-670a-49b1-a24f-9eba8afee673 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:39.483387 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-5da4e6d8-670a-49b1-a24f-9eba8afee673 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:39.484884 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 427/842] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:39.490407 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b2adb-0ae9-466c-82d2-c6768c3667a1 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:39.592918 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b2adb-0ae9-466c-82d2-c6768c3667a1 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:39.630102 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421bdc4-4bc0-4386-b390-8a727f467586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:39.631187 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421bdc4-4bc0-4386-b390-8a727f467586 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:39.631720 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421bdc4-4bc0-4386-b390-8a727f467586 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:39.632962 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421bdc4-4bc0-4386-b390-8a727f467586 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:39.633967 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421bdc4-4bc0-4386-b390-8a727f467586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:39.634504 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421bdc4-4bc0-4386-b390-8a727f467586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:39.636135 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421bdc4-4bc0-4386-b390-8a727f467586 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:39.649391 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 416/843] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:39.657524 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4e6d8-670a-49b1-a24f-9eba8afee673 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:39.756044 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4e6d8-670a-49b1-a24f-9eba8afee673 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:39.791457 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d40a8c-5e25-415c-ad9d-2def94c05ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:39.792261 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d40a8c-5e25-415c-ad9d-2def94c05ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:39.792552 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d40a8c-5e25-415c-ad9d-2def94c05ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:39.792831 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d40a8c-5e25-415c-ad9d-2def94c05ac3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:39.800013 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d40a8c-5e25-415c-ad9d-2def94c05ac3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:39.801500 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d40a8c-5e25-415c-ad9d-2def94c05ac3 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:39.815848 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-81d40a8c-5e25-415c-ad9d-2def94c05ac3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:39.817474 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 428/844] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:39.824021 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421bdc4-4bc0-4386-b390-8a727f467586 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:39.926709 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421bdc4-4bc0-4386-b390-8a727f467586 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:39.962489 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c56d2d-f28d-4008-a640-739aeebf3994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:39.963161 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c56d2d-f28d-4008-a640-739aeebf3994 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:39.963447 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c56d2d-f28d-4008-a640-739aeebf3994 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:39.963726 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c56d2d-f28d-4008-a640-739aeebf3994 None admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:39.964515 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c56d2d-f28d-4008-a640-739aeebf3994 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:39.964830 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c56d2d-f28d-4008-a640-739aeebf3994 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:39.966295 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c56d2d-f28d-4008-a640-739aeebf3994 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:39.979164 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 417/845] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:39.984999 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d40a8c-5e25-415c-ad9d-2def94c05ac3 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:40.013488 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51bc3f-c5d6-4616-8b2a-005b59c28ca5 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:40.014014 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51bc3f-c5d6-4616-8b2a-005b59c28ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:40.014448 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51bc3f-c5d6-4616-8b2a-005b59c28ca5 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:40.017653 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 418/846] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:02:40.022386 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6aebb-bb4a-45a6-83a5-271a21d62b32 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:40.024197 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6aebb-bb4a-45a6-83a5-271a21d62b32 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:40.024648 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6aebb-bb4a-45a6-83a5-271a21d62b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:40.042046 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-45b6aebb-bb4a-45a6-83a5-271a21d62b32 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:40.043535 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-45b6aebb-bb4a-45a6-83a5-271a21d62b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:40.094536 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d40a8c-5e25-415c-ad9d-2def94c05ac3 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:40.129796 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ca5c6-dc42-4ef1-96dd-bc489b37535a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:40.130419 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ca5c6-dc42-4ef1-96dd-bc489b37535a None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:40.130702 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ca5c6-dc42-4ef1-96dd-bc489b37535a None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:40.130979 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ca5c6-dc42-4ef1-96dd-bc489b37535a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:40.131890 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ca5c6-dc42-4ef1-96dd-bc489b37535a None admin] RBAC: Adding query filter params (role.id=8cfa924df1a1400986d9ecc9686a7f52, scope.project.id=ec1f2c5cb900473da1083830387e3ff4, user.id=9d6d8e7788494f2c92ad5c183c8fa283) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:40.133572 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ca5c6-dc42-4ef1-96dd-bc489b37535a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:40.140844 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ca5c6-dc42-4ef1-96dd-bc489b37535a None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:40.141009 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 419/847] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 20:02:40.146074 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 429/848] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:02:39 2022] GET /identity/v3/role_assignments?user.id=9d6d8e7788494f2c92ad5c183c8fa283&scope.project.id=ec1f2c5cb900473da1083830387e3ff4&role.id=8cfa924df1a1400986d9ecc9686a7f52 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:40.157510 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6aebb-bb4a-45a6-83a5-271a21d62b32 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:40.190126 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2889127-773e-49cb-8e41-2930d0f50ce2 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:40.190430 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2889127-773e-49cb-8e41-2930d0f50ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:40.190695 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2889127-773e-49cb-8e41-2930d0f50ce2 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:40.192845 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 430/849] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:40.199409 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7824a-4101-465a-b35c-aadbea34c036 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:40.199708 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7824a-4101-465a-b35c-aadbea34c036 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:40.199981 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7824a-4101-465a-b35c-aadbea34c036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:40.219800 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-95f7824a-4101-465a-b35c-aadbea34c036 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:40.221041 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-95f7824a-4101-465a-b35c-aadbea34c036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:40.292224 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6aebb-bb4a-45a6-83a5-271a21d62b32 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:40.308561 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 431/850] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:02:40.332042 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7824a-4101-465a-b35c-aadbea34c036 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:40.339545 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0cdc0-581d-4884-ba74-6a33a90f4c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:40.340511 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0cdc0-581d-4884-ba74-6a33a90f4c1f None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:40.340892 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0cdc0-581d-4884-ba74-6a33a90f4c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:40.341266 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0cdc0-581d-4884-ba74-6a33a90f4c1f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:40.342057 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0cdc0-581d-4884-ba74-6a33a90f4c1f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:40.343527 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0cdc0-581d-4884-ba74-6a33a90f4c1f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:40.356368 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-78e0cdc0-581d-4884-ba74-6a33a90f4c1f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 29 20:02:40.363051 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 420/851] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Mar 29 20:02:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:40.364294 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0cdc0-581d-4884-ba74-6a33a90f4c1f None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:40.457476 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7824a-4101-465a-b35c-aadbea34c036 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:40.473926 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0cdc0-581d-4884-ba74-6a33a90f4c1f None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:40.501536 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa78007-92e0-4bcc-b5c5-cbd5982354b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:40.502606 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa78007-92e0-4bcc-b5c5-cbd5982354b6 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:40.502891 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa78007-92e0-4bcc-b5c5-cbd5982354b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:40.503176 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa78007-92e0-4bcc-b5c5-cbd5982354b6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:40.504281 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa78007-92e0-4bcc-b5c5-cbd5982354b6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:40.505960 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa78007-92e0-4bcc-b5c5-cbd5982354b6 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:40.509195 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773d329-1552-43a6-998a-a11712d9f02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:40.509898 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773d329-1552-43a6-998a-a11712d9f02d None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:40.510187 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773d329-1552-43a6-998a-a11712d9f02d None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:40.510469 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773d329-1552-43a6-998a-a11712d9f02d None admin] PATH_INFO: `/v3/services` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:40.511180 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773d329-1552-43a6-998a-a11712d9f02d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:40.511493 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773d329-1552-43a6-998a-a11712d9f02d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:40.512851 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773d329-1552-43a6-998a-a11712d9f02d None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:40.517866 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 421/852] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Mar 29 20:02:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:40.518217 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-baa78007-92e0-4bcc-b5c5-cbd5982354b6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 29 20:02:40.519421 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 432/853] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Mar 29 20:02:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:02:40.525143 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773d329-1552-43a6-998a-a11712d9f02d None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:40.525399 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa78007-92e0-4bcc-b5c5-cbd5982354b6 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:40.634754 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa78007-92e0-4bcc-b5c5-cbd5982354b6 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:40.649987 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773d329-1552-43a6-998a-a11712d9f02d None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:40.669195 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f33f94-2ca7-4aa9-b927-189679301ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:40.669936 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f33f94-2ca7-4aa9-b927-189679301ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:40.670230 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f33f94-2ca7-4aa9-b927-189679301ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:40.670512 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f33f94-2ca7-4aa9-b927-189679301ac8 None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:40.671219 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f33f94-2ca7-4aa9-b927-189679301ac8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:40.671532 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f33f94-2ca7-4aa9-b927-189679301ac8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:40.672903 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f33f94-2ca7-4aa9-b927-189679301ac8 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:40.677402 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 433/854] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Mar 29 20:02:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:40.678490 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937cdff-3307-4443-8b07-de07ee22e7af None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:40.679532 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937cdff-3307-4443-8b07-de07ee22e7af None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:40.680021 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937cdff-3307-4443-8b07-de07ee22e7af None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:40.687528 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 434/855] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:40.687528 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937cdff-3307-4443-8b07-de07ee22e7af None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:40.696122 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ed63f-311a-4d46-b78f-e62b30f2bc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:40.697354 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ed63f-311a-4d46-b78f-e62b30f2bc65 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:40.697868 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ed63f-311a-4d46-b78f-e62b30f2bc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:40.698290 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ed63f-311a-4d46-b78f-e62b30f2bc65 None admin] PATH_INFO: `/v3/services` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:40.699149 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ed63f-311a-4d46-b78f-e62b30f2bc65 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:40.699631 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ed63f-311a-4d46-b78f-e62b30f2bc65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:40.701128 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ed63f-311a-4d46-b78f-e62b30f2bc65 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:40.708723 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 422/856] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Mar 29 20:02:40 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:40.710662 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fb6f0-6ddd-44f5-9414-b46b1cfaf16d None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:40.710952 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fb6f0-6ddd-44f5-9414-b46b1cfaf16d None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:40.711219 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fb6f0-6ddd-44f5-9414-b46b1cfaf16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:40.730512 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-2c5fb6f0-6ddd-44f5-9414-b46b1cfaf16d None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:40.731838 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-2c5fb6f0-6ddd-44f5-9414-b46b1cfaf16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:40.797895 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937cdff-3307-4443-8b07-de07ee22e7af None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:40.813721 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 423/857] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:02:40.831909 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fb6f0-6ddd-44f5-9414-b46b1cfaf16d None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:40.837620 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd1a72-f786-475a-822b-cf8a1176cc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:40.838998 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd1a72-f786-475a-822b-cf8a1176cc1c None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:40.839507 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd1a72-f786-475a-822b-cf8a1176cc1c None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:40.839997 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd1a72-f786-475a-822b-cf8a1176cc1c None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:40.840946 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd1a72-f786-475a-822b-cf8a1176cc1c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:40.841506 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd1a72-f786-475a-822b-cf8a1176cc1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:40.843243 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd1a72-f786-475a-822b-cf8a1176cc1c None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:40.848929 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 435/858] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Mar 29 20:02:40 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:40.962042 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fb6f0-6ddd-44f5-9414-b46b1cfaf16d None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:40.999628 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8092abe-ea1d-43ca-adc9-ca115e5a56ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:41.000444 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8092abe-ea1d-43ca-adc9-ca115e5a56ac None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:41.000728 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8092abe-ea1d-43ca-adc9-ca115e5a56ac None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:41.001005 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8092abe-ea1d-43ca-adc9-ca115e5a56ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:41.013382 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8092abe-ea1d-43ca-adc9-ca115e5a56ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:41.020799 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-c8092abe-ea1d-43ca-adc9-ca115e5a56ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 20:02:41.022568 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 424/859] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Mar 29 20:02:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:02:41.028104 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd1a72-f786-475a-822b-cf8a1176cc1c None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:41.136239 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd1a72-f786-475a-822b-cf8a1176cc1c None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:41.170399 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592137b5-442c-4e38-bfd7-ab92a2297fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:41.171077 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592137b5-442c-4e38-bfd7-ab92a2297fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:41.171360 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592137b5-442c-4e38-bfd7-ab92a2297fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:41.171644 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592137b5-442c-4e38-bfd7-ab92a2297fd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:41.172388 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592137b5-442c-4e38-bfd7-ab92a2297fd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:41.172695 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592137b5-442c-4e38-bfd7-ab92a2297fd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:41.174158 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592137b5-442c-4e38-bfd7-ab92a2297fd6 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:41.183089 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 436/860] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Mar 29 20:02:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:41.188538 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8092abe-ea1d-43ca-adc9-ca115e5a56ac None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:41.295024 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8092abe-ea1d-43ca-adc9-ca115e5a56ac None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:41.330053 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f4cba-5431-43ce-ac4a-6766e22aa68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:41.331169 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f4cba-5431-43ce-ac4a-6766e22aa68c None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:41.331689 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f4cba-5431-43ce-ac4a-6766e22aa68c None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:41.332137 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f4cba-5431-43ce-ac4a-6766e22aa68c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:41.343509 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f4cba-5431-43ce-ac4a-6766e22aa68c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:41.345232 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f4cba-5431-43ce-ac4a-6766e22aa68c None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:41.362928 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-149f4cba-5431-43ce-ac4a-6766e22aa68c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:41.364646 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 425/861] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:41.370185 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592137b5-442c-4e38-bfd7-ab92a2297fd6 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:41.475493 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592137b5-442c-4e38-bfd7-ab92a2297fd6 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:41.509028 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79368db7-94cb-41ac-881f-9b590a7d8332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:41.509733 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79368db7-94cb-41ac-881f-9b590a7d8332 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:41.510011 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79368db7-94cb-41ac-881f-9b590a7d8332 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:41.510287 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79368db7-94cb-41ac-881f-9b590a7d8332 None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:41.511005 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79368db7-94cb-41ac-881f-9b590a7d8332 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:41.511310 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79368db7-94cb-41ac-881f-9b590a7d8332 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:41.512668 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79368db7-94cb-41ac-881f-9b590a7d8332 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:41.525017 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 437/862] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:41.530512 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f4cba-5431-43ce-ac4a-6766e22aa68c None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:41.631809 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f4cba-5431-43ce-ac4a-6766e22aa68c None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:41.667199 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33e7bf-e693-4b97-b516-6e84b728b958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:41.668786 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33e7bf-e693-4b97-b516-6e84b728b958 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:41.669322 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33e7bf-e693-4b97-b516-6e84b728b958 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:41.669811 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33e7bf-e693-4b97-b516-6e84b728b958 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:41.677874 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33e7bf-e693-4b97-b516-6e84b728b958 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:41.679731 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33e7bf-e693-4b97-b516-6e84b728b958 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:41.694013 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-8e33e7bf-e693-4b97-b516-6e84b728b958 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 29 20:02:41.696293 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 426/863] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Mar 29 20:02:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:41.701975 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79368db7-94cb-41ac-881f-9b590a7d8332 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:41.808992 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79368db7-94cb-41ac-881f-9b590a7d8332 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:41.846527 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69648d4a-37d7-4107-86b8-61bdd09f1c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:41.848015 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69648d4a-37d7-4107-86b8-61bdd09f1c2b None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:41.848493 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69648d4a-37d7-4107-86b8-61bdd09f1c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:41.848982 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69648d4a-37d7-4107-86b8-61bdd09f1c2b None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:41.850053 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69648d4a-37d7-4107-86b8-61bdd09f1c2b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:41.851140 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69648d4a-37d7-4107-86b8-61bdd09f1c2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:41.852902 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69648d4a-37d7-4107-86b8-61bdd09f1c2b None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:41.875954 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 438/864] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Mar 29 20:02:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:41.877699 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33e7bf-e693-4b97-b516-6e84b728b958 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:41.982811 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33e7bf-e693-4b97-b516-6e84b728b958 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:42.018127 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3f1f8-f69a-4a1f-ac63-b9b670833bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:42.019174 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3f1f8-f69a-4a1f-ac63-b9b670833bab None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:42.019829 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3f1f8-f69a-4a1f-ac63-b9b670833bab None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:42.020315 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3f1f8-f69a-4a1f-ac63-b9b670833bab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:42.090232 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3f1f8-f69a-4a1f-ac63-b9b670833bab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:42.092084 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3f1f8-f69a-4a1f-ac63-b9b670833bab None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:42.197272 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 427/865] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:02:41 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 20:02:42.202485 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69648d4a-37d7-4107-86b8-61bdd09f1c2b None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:42.305168 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69648d4a-37d7-4107-86b8-61bdd09f1c2b None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:42.340174 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdb911-8028-4587-bf95-20c81997c81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:42.341406 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdb911-8028-4587-bf95-20c81997c81f None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:42.341889 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdb911-8028-4587-bf95-20c81997c81f None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:42.342359 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdb911-8028-4587-bf95-20c81997c81f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:42.353043 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdb911-8028-4587-bf95-20c81997c81f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:42.354779 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdb911-8028-4587-bf95-20c81997c81f None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:42.372260 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-eefdb911-8028-4587-bf95-20c81997c81f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:42.377412 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 439/866] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:42.379845 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3f1f8-f69a-4a1f-ac63-b9b670833bab None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:42.482450 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3f1f8-f69a-4a1f-ac63-b9b670833bab None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:42.517411 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad0ace-ae4a-42f1-b2c0-38e1f3d888d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:42.518427 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad0ace-ae4a-42f1-b2c0-38e1f3d888d0 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:42.518905 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad0ace-ae4a-42f1-b2c0-38e1f3d888d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:42.519375 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad0ace-ae4a-42f1-b2c0-38e1f3d888d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:42.520280 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad0ace-ae4a-42f1-b2c0-38e1f3d888d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:42.520802 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad0ace-ae4a-42f1-b2c0-38e1f3d888d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:42.522510 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad0ace-ae4a-42f1-b2c0-38e1f3d888d0 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:42.540089 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 428/867] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:42.541818 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdb911-8028-4587-bf95-20c81997c81f None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:42.572968 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317586c-6e5d-49bb-a103-0ce416de7887 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:42.573334 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317586c-6e5d-49bb-a103-0ce416de7887 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:42.573578 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317586c-6e5d-49bb-a103-0ce416de7887 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:42.575483 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 429/868] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:02:42.582630 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecc9ea-f9fe-46bb-b8ff-2ddd2e370bd8 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:42.583167 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecc9ea-f9fe-46bb-b8ff-2ddd2e370bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:42.583665 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecc9ea-f9fe-46bb-b8ff-2ddd2e370bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:42.607568 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-88ecc9ea-f9fe-46bb-b8ff-2ddd2e370bd8 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:42.609317 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-88ecc9ea-f9fe-46bb-b8ff-2ddd2e370bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:42.644561 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdb911-8028-4587-bf95-20c81997c81f None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:42.679672 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b87cb-5546-4e1a-81a4-935f1d59dfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:42.680459 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b87cb-5546-4e1a-81a4-935f1d59dfcd None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:42.680749 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b87cb-5546-4e1a-81a4-935f1d59dfcd None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:42.681025 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b87cb-5546-4e1a-81a4-935f1d59dfcd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:42.688075 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b87cb-5546-4e1a-81a4-935f1d59dfcd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:42.689581 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b87cb-5546-4e1a-81a4-935f1d59dfcd None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:42.695590 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 430/869] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 20:02:42.704447 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-ac8b87cb-5546-4e1a-81a4-935f1d59dfcd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:42.705973 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 440/870] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:42.711739 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecc9ea-f9fe-46bb-b8ff-2ddd2e370bd8 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:42.717766 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b87cb-5546-4e1a-81a4-935f1d59dfcd None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:42.816078 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecc9ea-f9fe-46bb-b8ff-2ddd2e370bd8 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:42.822786 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b87cb-5546-4e1a-81a4-935f1d59dfcd None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:42.852664 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d66f92-c9af-4b5b-a295-4c8d65f861ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:42.853684 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d66f92-c9af-4b5b-a295-4c8d65f861ea None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:42.854111 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d66f92-c9af-4b5b-a295-4c8d65f861ea None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:42.854560 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d66f92-c9af-4b5b-a295-4c8d65f861ea None admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:42.855495 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d66f92-c9af-4b5b-a295-4c8d65f861ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:42.855804 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d66f92-c9af-4b5b-a295-4c8d65f861ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:42.857105 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492d5bc-f309-4d1c-b3bb-dd4212b75ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:42.857653 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d66f92-c9af-4b5b-a295-4c8d65f861ea None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:42.858699 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492d5bc-f309-4d1c-b3bb-dd4212b75ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:42.859193 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492d5bc-f309-4d1c-b3bb-dd4212b75ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:42.859672 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492d5bc-f309-4d1c-b3bb-dd4212b75ed6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:42.860530 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492d5bc-f309-4d1c-b3bb-dd4212b75ed6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:42.862120 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492d5bc-f309-4d1c-b3bb-dd4212b75ed6 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:42.874451 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-9492d5bc-f309-4d1c-b3bb-dd4212b75ed6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 29 20:02:42.875100 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 431/871] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:42.880867 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d66f92-c9af-4b5b-a295-4c8d65f861ea None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:42.881144 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 441/872] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Mar 29 20:02:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:42.883079 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492d5bc-f309-4d1c-b3bb-dd4212b75ed6 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:42.984410 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d66f92-c9af-4b5b-a295-4c8d65f861ea None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:42.990085 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492d5bc-f309-4d1c-b3bb-dd4212b75ed6 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:43.019215 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2445cef-7713-44db-989c-a7dd22e186f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:43.020049 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2445cef-7713-44db-989c-a7dd22e186f6 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:43.020338 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2445cef-7713-44db-989c-a7dd22e186f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:43.020619 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2445cef-7713-44db-989c-a7dd22e186f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:43.021577 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2445cef-7713-44db-989c-a7dd22e186f6 None admin] RBAC: Adding query filter params (role.id=04bfd9a52ca84b2db7f73121d5e57b41, scope.project.id=ec1f2c5cb900473da1083830387e3ff4, user.id=a706b6d0163549bc80285c4158331b94) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:43.021780 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2445cef-7713-44db-989c-a7dd22e186f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:43.024269 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2445cef-7713-44db-989c-a7dd22e186f6 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:43.027490 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e5ed9-5222-4ef0-b513-28e607884f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:43.028401 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e5ed9-5222-4ef0-b513-28e607884f3f None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:43.028882 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e5ed9-5222-4ef0-b513-28e607884f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:43.029426 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e5ed9-5222-4ef0-b513-28e607884f3f None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:43.030339 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e5ed9-5222-4ef0-b513-28e607884f3f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:43.030860 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e5ed9-5222-4ef0-b513-28e607884f3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:43.032410 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e5ed9-5222-4ef0-b513-28e607884f3f None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:43.037469 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 432/873] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:02:42 2022] GET /identity/v3/role_assignments?user.id=a706b6d0163549bc80285c4158331b94&scope.project.id=ec1f2c5cb900473da1083830387e3ff4&role.id=04bfd9a52ca84b2db7f73121d5e57b41 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:43.043027 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 442/874] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Mar 29 20:02:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:43.044038 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2445cef-7713-44db-989c-a7dd22e186f6 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:43.107397 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c541d-8496-4031-979b-73dca7701b3c None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:43.107797 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c541d-8496-4031-979b-73dca7701b3c None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:43.107983 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c541d-8496-4031-979b-73dca7701b3c None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:43.110157 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 443/875] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:02:43.115850 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d90451-3528-4bfb-bf06-f24f988580cc None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:43.116715 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d90451-3528-4bfb-bf06-f24f988580cc None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:43.116988 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d90451-3528-4bfb-bf06-f24f988580cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:43.136622 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-15d90451-3528-4bfb-bf06-f24f988580cc None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:43.138035 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-15d90451-3528-4bfb-bf06-f24f988580cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:43.155952 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2445cef-7713-44db-989c-a7dd22e186f6 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:43.201848 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ddd6e-7fb5-4023-bab7-d826ff7f5c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:43.202822 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ddd6e-7fb5-4023-bab7-d826ff7f5c21 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:43.203249 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ddd6e-7fb5-4023-bab7-d826ff7f5c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:43.203658 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ddd6e-7fb5-4023-bab7-d826ff7f5c21 None admin] PATH_INFO: `/v3/services` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:43.204528 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ddd6e-7fb5-4023-bab7-d826ff7f5c21 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:43.205065 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ddd6e-7fb5-4023-bab7-d826ff7f5c21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:43.207044 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ddd6e-7fb5-4023-bab7-d826ff7f5c21 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:43.215913 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 433/876] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Mar 29 20:02:43 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:43.226491 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 444/877] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:02:43.251397 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ddd6e-7fb5-4023-bab7-d826ff7f5c21 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:43.328695 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70587541-27f1-4fa8-b2f3-2ee87ae7b75d None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:43.328695 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70587541-27f1-4fa8-b2f3-2ee87ae7b75d None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:43.328947 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70587541-27f1-4fa8-b2f3-2ee87ae7b75d None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:43.330864 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 445/878] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:02:43.336854 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54408b4e-cbd1-41bc-9794-aadd53ab8bc7 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:43.337149 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54408b4e-cbd1-41bc-9794-aadd53ab8bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:43.337457 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54408b4e-cbd1-41bc-9794-aadd53ab8bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:43.358272 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-54408b4e-cbd1-41bc-9794-aadd53ab8bc7 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:43.359410 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-54408b4e-cbd1-41bc-9794-aadd53ab8bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:43.364613 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ddd6e-7fb5-4023-bab7-d826ff7f5c21 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:43.408189 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4789ac-19b5-4262-8a7b-06af3a06ba93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:43.408864 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4789ac-19b5-4262-8a7b-06af3a06ba93 None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:43.409147 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4789ac-19b5-4262-8a7b-06af3a06ba93 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:43.409458 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4789ac-19b5-4262-8a7b-06af3a06ba93 None admin] PATH_INFO: `/v3/services` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:43.410203 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4789ac-19b5-4262-8a7b-06af3a06ba93 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:43.411565 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4789ac-19b5-4262-8a7b-06af3a06ba93 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:43.445103 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 446/879] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:02:43.467603 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54408b4e-cbd1-41bc-9794-aadd53ab8bc7 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:43.503736 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 434/880] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Mar 29 20:02:43 2022] POST /identity/v3/services => generated 269 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:02:43.580499 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54408b4e-cbd1-41bc-9794-aadd53ab8bc7 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:43.626141 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc03906-8789-4f01-90a5-49b8ee89d2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:43.627149 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc03906-8789-4f01-90a5-49b8ee89d2b9 None admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:43.627617 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc03906-8789-4f01-90a5-49b8ee89d2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:43.628086 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc03906-8789-4f01-90a5-49b8ee89d2b9 None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:43.628992 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc03906-8789-4f01-90a5-49b8ee89d2b9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:43.630644 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc03906-8789-4f01-90a5-49b8ee89d2b9 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:43.734243 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 447/881] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Mar 29 20:02:43 2022] POST /identity/v3/services => generated 251 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:02:45.528387 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfac75-4289-4ce4-a72e-b1c7150237da None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:45.528919 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfac75-4289-4ce4-a72e-b1c7150237da None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:45.528919 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfac75-4289-4ce4-a72e-b1c7150237da None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:45.531038 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 435/882] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:45.536306 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb983285-1188-4909-bba8-d627e8df3434 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:45.537047 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb983285-1188-4909-bba8-d627e8df3434 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:45.537506 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb983285-1188-4909-bba8-d627e8df3434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:45.555851 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-eb983285-1188-4909-bba8-d627e8df3434 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:45.557309 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-eb983285-1188-4909-bba8-d627e8df3434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:45.617679 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20085cb-df37-4599-96f7-23de35f4a2c8 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:45.618299 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20085cb-df37-4599-96f7-23de35f4a2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:45.618778 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20085cb-df37-4599-96f7-23de35f4a2c8 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:45.620984 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 436/883] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:45.626730 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658a21e-e115-406d-b0c4-f348e8062c92 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:45.627014 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658a21e-e115-406d-b0c4-f348e8062c92 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:45.627526 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658a21e-e115-406d-b0c4-f348e8062c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:45.636885 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 448/884] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:02:45.646146 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-9658a21e-e115-406d-b0c4-f348e8062c92 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:45.648894 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9658a21e-e115-406d-b0c4-f348e8062c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:45.660174 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb983285-1188-4909-bba8-d627e8df3434 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:45.732847 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 437/885] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 20:02:45.758448 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658a21e-e115-406d-b0c4-f348e8062c92 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:45.793717 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb983285-1188-4909-bba8-d627e8df3434 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:45.836757 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c1d76-40e0-46d8-9814-23a69da89c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:45.837642 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c1d76-40e0-46d8-9814-23a69da89c16 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:45.838274 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c1d76-40e0-46d8-9814-23a69da89c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:45.838559 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c1d76-40e0-46d8-9814-23a69da89c16 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:45.851831 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c1d76-40e0-46d8-9814-23a69da89c16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:45.860996 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-852c1d76-40e0-46d8-9814-23a69da89c16 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 29 20:02:45.864958 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658a21e-e115-406d-b0c4-f348e8062c92 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:45.867687 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 449/886] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Mar 29 20:02:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:02:45.869102 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c1d76-40e0-46d8-9814-23a69da89c16 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:45.901690 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a52e1f-8469-4a57-8029-141c97523276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:45.902454 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a52e1f-8469-4a57-8029-141c97523276 None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:45.902746 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a52e1f-8469-4a57-8029-141c97523276 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:45.903023 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a52e1f-8469-4a57-8029-141c97523276 None admin] PATH_INFO: `/v3/services` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:45.903762 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a52e1f-8469-4a57-8029-141c97523276 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:45.906029 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a52e1f-8469-4a57-8029-141c97523276 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:45.972639 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c1d76-40e0-46d8-9814-23a69da89c16 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:45.993044 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 438/887] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Mar 29 20:02:45 2022] POST /identity/v3/services => generated 241 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:02:45.994592 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e99f2-778c-4673-ae4d-c781a2fab95c None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:45.994885 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e99f2-778c-4673-ae4d-c781a2fab95c None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:45.995250 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e99f2-778c-4673-ae4d-c781a2fab95c None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:46.001205 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 439/888] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:46.003065 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686562a-fb55-48df-bbef-6435446aa7b9 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:46.003359 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686562a-fb55-48df-bbef-6435446aa7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:46.003692 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686562a-fb55-48df-bbef-6435446aa7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:46.021625 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-0686562a-fb55-48df-bbef-6435446aa7b9 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:46.023531 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-0686562a-fb55-48df-bbef-6435446aa7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:46.032624 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5546d8f-b7f8-45b1-a55c-9ffacc6ef4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:46.033806 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5546d8f-b7f8-45b1-a55c-9ffacc6ef4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:46.034269 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5546d8f-b7f8-45b1-a55c-9ffacc6ef4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:46.034609 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5546d8f-b7f8-45b1-a55c-9ffacc6ef4b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:46.035457 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5546d8f-b7f8-45b1-a55c-9ffacc6ef4b5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:46.035769 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5546d8f-b7f8-45b1-a55c-9ffacc6ef4b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:46.037226 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5546d8f-b7f8-45b1-a55c-9ffacc6ef4b5 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:46.047621 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 450/889] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Mar 29 20:02:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:46.053662 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5546d8f-b7f8-45b1-a55c-9ffacc6ef4b5 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:46.126151 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 440/890] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:02:46.133950 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b02b8-68e8-4870-a177-786ff5aefb90 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:46.134310 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b02b8-68e8-4870-a177-786ff5aefb90 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:46.134603 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b02b8-68e8-4870-a177-786ff5aefb90 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:46.136604 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 441/891] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:46.142060 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9288e-b91d-40c1-8c3b-42bb2d493d5b None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:46.142355 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9288e-b91d-40c1-8c3b-42bb2d493d5b None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:46.142640 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9288e-b91d-40c1-8c3b-42bb2d493d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:46.162578 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-05c9288e-b91d-40c1-8c3b-42bb2d493d5b None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:46.164069 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-05c9288e-b91d-40c1-8c3b-42bb2d493d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:46.183376 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5546d8f-b7f8-45b1-a55c-9ffacc6ef4b5 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:46.225052 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c6fdb-6e25-48a5-8879-273ccb9c9647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:46.226497 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c6fdb-6e25-48a5-8879-273ccb9c9647 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:46.227369 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c6fdb-6e25-48a5-8879-273ccb9c9647 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:46.227369 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c6fdb-6e25-48a5-8879-273ccb9c9647 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:46.239217 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c6fdb-6e25-48a5-8879-273ccb9c9647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:46.240672 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c6fdb-6e25-48a5-8879-273ccb9c9647 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:46.243112 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 442/892] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 20:02:46.243775 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9288e-b91d-40c1-8c3b-42bb2d493d5b None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:46.260339 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-374c6fdb-6e25-48a5-8879-273ccb9c9647 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:46.262243 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 451/893] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:46.267206 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c6fdb-6e25-48a5-8879-273ccb9c9647 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:46.359471 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9288e-b91d-40c1-8c3b-42bb2d493d5b None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:46.379371 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c6fdb-6e25-48a5-8879-273ccb9c9647 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:46.400796 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65744da3-136e-436c-99e5-f57e228ee630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:46.401639 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65744da3-136e-436c-99e5-f57e228ee630 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:46.401921 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65744da3-136e-436c-99e5-f57e228ee630 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:46.402189 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65744da3-136e-436c-99e5-f57e228ee630 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:46.402835 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65744da3-136e-436c-99e5-f57e228ee630 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:46.404183 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65744da3-136e-436c-99e5-f57e228ee630 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:46.412567 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88565d-f623-45b0-ac7e-5274c0c0bc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:46.414193 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88565d-f623-45b0-ac7e-5274c0c0bc59 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:46.414484 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88565d-f623-45b0-ac7e-5274c0c0bc59 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:46.414763 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88565d-f623-45b0-ac7e-5274c0c0bc59 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:46.415412 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88565d-f623-45b0-ac7e-5274c0c0bc59 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:46.416474 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-65744da3-136e-436c-99e5-f57e228ee630 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 29 20:02:46.416780 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88565d-f623-45b0-ac7e-5274c0c0bc59 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:46.417827 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 443/894] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Mar 29 20:02:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:46.418515 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65744da3-136e-436c-99e5-f57e228ee630 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:46.429332 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-be88565d-f623-45b0-ac7e-5274c0c0bc59 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 29 20:02:46.429615 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 452/895] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Mar 29 20:02:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:02:46.434726 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88565d-f623-45b0-ac7e-5274c0c0bc59 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:46.528196 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65744da3-136e-436c-99e5-f57e228ee630 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:46.534025 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88565d-f623-45b0-ac7e-5274c0c0bc59 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:46.563623 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caef5cb-af25-4f92-bedf-76f568930089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:46.564294 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caef5cb-af25-4f92-bedf-76f568930089 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:46.564581 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caef5cb-af25-4f92-bedf-76f568930089 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:46.564858 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caef5cb-af25-4f92-bedf-76f568930089 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:46.565609 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caef5cb-af25-4f92-bedf-76f568930089 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:46.565920 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caef5cb-af25-4f92-bedf-76f568930089 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:46.567476 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caef5cb-af25-4f92-bedf-76f568930089 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:46.570255 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78935a6f-a262-4a3c-a977-e3cb521243ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:46.570921 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78935a6f-a262-4a3c-a977-e3cb521243ed None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:46.571203 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78935a6f-a262-4a3c-a977-e3cb521243ed None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:46.571480 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78935a6f-a262-4a3c-a977-e3cb521243ed None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:46.572440 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78935a6f-a262-4a3c-a977-e3cb521243ed None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:46.572743 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78935a6f-a262-4a3c-a977-e3cb521243ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:46.574123 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78935a6f-a262-4a3c-a977-e3cb521243ed None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:46.585648 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 453/896] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Mar 29 20:02:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:46.585921 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 444/897] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:46.586064 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78935a6f-a262-4a3c-a977-e3cb521243ed None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:46.586188 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caef5cb-af25-4f92-bedf-76f568930089 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:46.684143 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caef5cb-af25-4f92-bedf-76f568930089 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:46.691582 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78935a6f-a262-4a3c-a977-e3cb521243ed None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:46.719174 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ab8d8-040c-40ff-87aa-317a4394cf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:46.719987 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ab8d8-040c-40ff-87aa-317a4394cf82 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:46.720268 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ab8d8-040c-40ff-87aa-317a4394cf82 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:46.720657 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ab8d8-040c-40ff-87aa-317a4394cf82 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:46.725986 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44836ac-69a8-4297-9932-d944d75c7dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:46.726613 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44836ac-69a8-4297-9932-d944d75c7dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:46.726853 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44836ac-69a8-4297-9932-d944d75c7dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:46.727127 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44836ac-69a8-4297-9932-d944d75c7dd0 None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:46.727829 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44836ac-69a8-4297-9932-d944d75c7dd0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:46.728135 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44836ac-69a8-4297-9932-d944d75c7dd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:46.729069 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ab8d8-040c-40ff-87aa-317a4394cf82 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:46.729527 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44836ac-69a8-4297-9932-d944d75c7dd0 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:46.730537 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ab8d8-040c-40ff-87aa-317a4394cf82 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:46.739069 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 454/898] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Mar 29 20:02:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:46.739069 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44836ac-69a8-4297-9932-d944d75c7dd0 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:46.744850 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-d54ab8d8-040c-40ff-87aa-317a4394cf82 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 29 20:02:46.750567 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 445/899] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Mar 29 20:02:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:46.750567 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ab8d8-040c-40ff-87aa-317a4394cf82 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:46.844108 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44836ac-69a8-4297-9932-d944d75c7dd0 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:46.846959 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ab8d8-040c-40ff-87aa-317a4394cf82 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:46.881113 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fe41c-11a9-4f38-9050-22818ab91d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:46.882430 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fe41c-11a9-4f38-9050-22818ab91d37 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:46.882621 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7fdaa-35ba-484d-bc87-a92468d57636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:46.882795 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fe41c-11a9-4f38-9050-22818ab91d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:46.882968 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fe41c-11a9-4f38-9050-22818ab91d37 None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:46.883672 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fe41c-11a9-4f38-9050-22818ab91d37 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:46.883903 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7fdaa-35ba-484d-bc87-a92468d57636 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:46.884010 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fe41c-11a9-4f38-9050-22818ab91d37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:46.884414 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7fdaa-35ba-484d-bc87-a92468d57636 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:46.884847 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7fdaa-35ba-484d-bc87-a92468d57636 None admin] PATH_INFO: `/v3/services` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:46.885346 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fe41c-11a9-4f38-9050-22818ab91d37 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:46.885892 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7fdaa-35ba-484d-bc87-a92468d57636 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:46.886344 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7fdaa-35ba-484d-bc87-a92468d57636 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:46.887834 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7fdaa-35ba-484d-bc87-a92468d57636 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:46.894757 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 455/900] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Mar 29 20:02:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:46.894757 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fe41c-11a9-4f38-9050-22818ab91d37 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:46.896411 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 446/901] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Mar 29 20:02:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:46.896411 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7fdaa-35ba-484d-bc87-a92468d57636 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:46.998364 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7fdaa-35ba-484d-bc87-a92468d57636 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:47.004286 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fe41c-11a9-4f38-9050-22818ab91d37 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:47.030220 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150853f8-0f78-4135-92e6-d7131c84f047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:47.030874 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150853f8-0f78-4135-92e6-d7131c84f047 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:47.031157 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150853f8-0f78-4135-92e6-d7131c84f047 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:47.031433 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150853f8-0f78-4135-92e6-d7131c84f047 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:47.032221 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150853f8-0f78-4135-92e6-d7131c84f047 None admin] RBAC: Adding query filter params (interface=public, service_id=4bda32c20e6f48d2bd6e18b49372b73c, region_id=RegionOne) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:47.032529 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150853f8-0f78-4135-92e6-d7131c84f047 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:47.033908 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150853f8-0f78-4135-92e6-d7131c84f047 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:47.043762 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 447/902] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Mar 29 20:02:46 2022] GET /identity/v3/endpoints?service_id=4bda32c20e6f48d2bd6e18b49372b73c&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:47.043762 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150853f8-0f78-4135-92e6-d7131c84f047 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:47.043995 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5a782-1c7d-41a8-98c9-458967eb72a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:47.043995 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5a782-1c7d-41a8-98c9-458967eb72a8 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:47.043995 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5a782-1c7d-41a8-98c9-458967eb72a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:47.043995 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5a782-1c7d-41a8-98c9-458967eb72a8 None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:47.044440 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5a782-1c7d-41a8-98c9-458967eb72a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:47.044717 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5a782-1c7d-41a8-98c9-458967eb72a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:47.046934 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5a782-1c7d-41a8-98c9-458967eb72a8 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:47.068160 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 456/903] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Mar 29 20:02:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:47.068160 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5a782-1c7d-41a8-98c9-458967eb72a8 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:47.157734 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150853f8-0f78-4135-92e6-d7131c84f047 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:47.162355 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5a782-1c7d-41a8-98c9-458967eb72a8 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:47.198298 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c6e31-e776-47f8-80e2-396dbad54264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:47.198511 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef45b9-1e4f-4477-8fe0-7b0d5e0a18ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:47.198965 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef45b9-1e4f-4477-8fe0-7b0d5e0a18ef None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:47.199090 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c6e31-e776-47f8-80e2-396dbad54264 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:47.199270 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c6e31-e776-47f8-80e2-396dbad54264 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:47.199362 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef45b9-1e4f-4477-8fe0-7b0d5e0a18ef None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:47.199521 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c6e31-e776-47f8-80e2-396dbad54264 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:47.199613 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef45b9-1e4f-4477-8fe0-7b0d5e0a18ef None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:47.200197 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef45b9-1e4f-4477-8fe0-7b0d5e0a18ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:47.200346 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c6e31-e776-47f8-80e2-396dbad54264 None admin] RBAC: Adding query filter params (interface=public, service_id=c0131f5b201847b6960617f7bcf44555, region_id=RegionOne) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:47.200627 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c6e31-e776-47f8-80e2-396dbad54264 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:47.201592 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef45b9-1e4f-4477-8fe0-7b0d5e0a18ef None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:47.202008 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c6e31-e776-47f8-80e2-396dbad54264 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:47.213549 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 448/904] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Mar 29 20:02:47 2022] GET /identity/v3/endpoints?service_id=c0131f5b201847b6960617f7bcf44555&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:47.213549 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c6e31-e776-47f8-80e2-396dbad54264 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:47.213860 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 457/905] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Mar 29 20:02:47 2022] GET /identity/v3/services => generated 1497 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:02:47.231383 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef45b9-1e4f-4477-8fe0-7b0d5e0a18ef None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:47.314700 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c6e31-e776-47f8-80e2-396dbad54264 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:47.357888 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef45b9-1e4f-4477-8fe0-7b0d5e0a18ef None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:47.361359 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0016abc-9ac2-4e38-8511-ca06e6c2ecc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:47.362116 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0016abc-9ac2-4e38-8511-ca06e6c2ecc8 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:47.362471 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0016abc-9ac2-4e38-8511-ca06e6c2ecc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:47.362816 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0016abc-9ac2-4e38-8511-ca06e6c2ecc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:47.395386 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ea8f8-960e-4242-913a-6885a26a17ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:47.396071 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ea8f8-960e-4242-913a-6885a26a17ea None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:47.396356 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ea8f8-960e-4242-913a-6885a26a17ea None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:47.396697 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ea8f8-960e-4242-913a-6885a26a17ea None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:47.397995 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ea8f8-960e-4242-913a-6885a26a17ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:47.399167 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ea8f8-960e-4242-913a-6885a26a17ea None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:47.406090 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 458/906] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Mar 29 20:02:47 2022] GET /identity/v3/services => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:02:47.445935 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0016abc-9ac2-4e38-8511-ca06e6c2ecc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:47.447735 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0016abc-9ac2-4e38-8511-ca06e6c2ecc8 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:47.558645 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 449/907] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:02:47 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 20:02:47.564482 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ea8f8-960e-4242-913a-6885a26a17ea None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:47.668569 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ea8f8-960e-4242-913a-6885a26a17ea None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:47.703624 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6704c-6374-4fcf-99dd-5597c85c9673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:47.704423 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6704c-6374-4fcf-99dd-5597c85c9673 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:47.704709 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6704c-6374-4fcf-99dd-5597c85c9673 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:47.704987 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6704c-6374-4fcf-99dd-5597c85c9673 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:47.715369 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6704c-6374-4fcf-99dd-5597c85c9673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:47.716834 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6704c-6374-4fcf-99dd-5597c85c9673 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:47.734218 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-eca6704c-6374-4fcf-99dd-5597c85c9673 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:47.735729 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 459/908] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:47.741851 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0016abc-9ac2-4e38-8511-ca06e6c2ecc8 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:47.846092 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0016abc-9ac2-4e38-8511-ca06e6c2ecc8 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:47.881233 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05de2f0-75c7-440f-a6ac-9708de1c5a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:47.882916 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05de2f0-75c7-440f-a6ac-9708de1c5a4c None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:47.883204 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05de2f0-75c7-440f-a6ac-9708de1c5a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:47.883458 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05de2f0-75c7-440f-a6ac-9708de1c5a4c None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:47.884186 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05de2f0-75c7-440f-a6ac-9708de1c5a4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:47.884490 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05de2f0-75c7-440f-a6ac-9708de1c5a4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:47.885887 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05de2f0-75c7-440f-a6ac-9708de1c5a4c None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:47.902756 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 450/909] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:47.904085 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6704c-6374-4fcf-99dd-5597c85c9673 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:48.012495 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6704c-6374-4fcf-99dd-5597c85c9673 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:48.057633 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b94391-8b18-4c05-96a3-dfe34df3f324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:48.058438 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b94391-8b18-4c05-96a3-dfe34df3f324 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:48.058724 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b94391-8b18-4c05-96a3-dfe34df3f324 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:48.059003 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b94391-8b18-4c05-96a3-dfe34df3f324 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:48.066097 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b94391-8b18-4c05-96a3-dfe34df3f324 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:48.067599 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b94391-8b18-4c05-96a3-dfe34df3f324 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:48.081747 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-43b94391-8b18-4c05-96a3-dfe34df3f324 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:48.083320 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 460/910] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:48.089539 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05de2f0-75c7-440f-a6ac-9708de1c5a4c None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:48.195165 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05de2f0-75c7-440f-a6ac-9708de1c5a4c None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:48.231522 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60c563-5428-4111-a1b2-885b9b36dbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:48.232667 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60c563-5428-4111-a1b2-885b9b36dbdb None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:48.233180 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60c563-5428-4111-a1b2-885b9b36dbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:48.233716 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60c563-5428-4111-a1b2-885b9b36dbdb None admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:48.234552 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60c563-5428-4111-a1b2-885b9b36dbdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:48.234874 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60c563-5428-4111-a1b2-885b9b36dbdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:48.236335 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60c563-5428-4111-a1b2-885b9b36dbdb None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:48.251273 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 451/911] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:48.258614 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b94391-8b18-4c05-96a3-dfe34df3f324 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:48.372028 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b94391-8b18-4c05-96a3-dfe34df3f324 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:48.399283 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebf40e-2dcc-49a7-bec3-05af197d0dce None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:48.399735 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebf40e-2dcc-49a7-bec3-05af197d0dce None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:48.400127 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebf40e-2dcc-49a7-bec3-05af197d0dce None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:48.405859 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 452/912] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:02:48.407404 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848ede5-6b74-4f77-9c25-051186aded51 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:48.407795 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848ede5-6b74-4f77-9c25-051186aded51 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:48.408176 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848ede5-6b74-4f77-9c25-051186aded51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:48.412395 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc861db-2a65-4e02-8b01-9a56183985eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:48.413484 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc861db-2a65-4e02-8b01-9a56183985eb None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:48.413965 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc861db-2a65-4e02-8b01-9a56183985eb None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:48.414382 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc861db-2a65-4e02-8b01-9a56183985eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:48.415358 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc861db-2a65-4e02-8b01-9a56183985eb None admin] RBAC: Adding query filter params (role.id=cb894452030c4656aaa8ad80b903bef6, scope.project.id=ec1f2c5cb900473da1083830387e3ff4, user.id=a706b6d0163549bc80285c4158331b94) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:48.415824 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc861db-2a65-4e02-8b01-9a56183985eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:48.417424 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc861db-2a65-4e02-8b01-9a56183985eb None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:48.423843 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 461/913] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:02:48 2022] GET /identity/v3/role_assignments?user.id=a706b6d0163549bc80285c4158331b94&scope.project.id=ec1f2c5cb900473da1083830387e3ff4&role.id=cb894452030c4656aaa8ad80b903bef6 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:48.429104 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-b848ede5-6b74-4f77-9c25-051186aded51 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:48.430688 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-b848ede5-6b74-4f77-9c25-051186aded51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:48.506006 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 453/914] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 20:02:48.531241 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc861db-2a65-4e02-8b01-9a56183985eb None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:48.648773 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc861db-2a65-4e02-8b01-9a56183985eb None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:48.686466 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a5dd3-2b8e-46f3-ae85-d3bc18ff23dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:48.688070 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a5dd3-2b8e-46f3-ae85-d3bc18ff23dd None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:48.688572 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a5dd3-2b8e-46f3-ae85-d3bc18ff23dd None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:48.689051 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a5dd3-2b8e-46f3-ae85-d3bc18ff23dd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:48.689915 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a5dd3-2b8e-46f3-ae85-d3bc18ff23dd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:48.691469 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a5dd3-2b8e-46f3-ae85-d3bc18ff23dd None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:48.704548 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-bd6a5dd3-2b8e-46f3-ae85-d3bc18ff23dd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 29 20:02:48.711515 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 462/915] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Mar 29 20:02:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:48.714438 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848ede5-6b74-4f77-9c25-051186aded51 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:48.817853 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848ede5-6b74-4f77-9c25-051186aded51 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:48.855409 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf27309-b523-48f5-9f1f-557e37d588c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:48.856419 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf27309-b523-48f5-9f1f-557e37d588c0 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:48.856928 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf27309-b523-48f5-9f1f-557e37d588c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:48.857426 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf27309-b523-48f5-9f1f-557e37d588c0 None admin] PATH_INFO: `/v3/services` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:48.858319 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf27309-b523-48f5-9f1f-557e37d588c0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:48.858850 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf27309-b523-48f5-9f1f-557e37d588c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:48.860410 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf27309-b523-48f5-9f1f-557e37d588c0 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:48.870933 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 454/916] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Mar 29 20:02:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:48.872505 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a5dd3-2b8e-46f3-ae85-d3bc18ff23dd None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:48.978775 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a5dd3-2b8e-46f3-ae85-d3bc18ff23dd None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:49.013179 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159979e-f125-40fa-ae25-e47788617945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:49.013876 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159979e-f125-40fa-ae25-e47788617945 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:49.014157 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159979e-f125-40fa-ae25-e47788617945 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:49.014433 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159979e-f125-40fa-ae25-e47788617945 None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:49.015135 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159979e-f125-40fa-ae25-e47788617945 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:49.015441 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159979e-f125-40fa-ae25-e47788617945 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:49.016805 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159979e-f125-40fa-ae25-e47788617945 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:49.027673 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 463/917] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Mar 29 20:02:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:49.029033 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf27309-b523-48f5-9f1f-557e37d588c0 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:49.135730 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf27309-b523-48f5-9f1f-557e37d588c0 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:49.172560 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6fad2-5d15-476c-a2ad-e716cd75b7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:49.173224 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6fad2-5d15-476c-a2ad-e716cd75b7ae None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:49.173617 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6fad2-5d15-476c-a2ad-e716cd75b7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:49.173896 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6fad2-5d15-476c-a2ad-e716cd75b7ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:49.174680 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6fad2-5d15-476c-a2ad-e716cd75b7ae None admin] RBAC: Adding query filter params (interface=public, service_id=4feb0f5381e84dda87b096fb277ef65a, region_id=RegionOne) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:49.174989 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6fad2-5d15-476c-a2ad-e716cd75b7ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:49.176360 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6fad2-5d15-476c-a2ad-e716cd75b7ae None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:49.186712 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 455/918] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Mar 29 20:02:49 2022] GET /identity/v3/endpoints?service_id=4feb0f5381e84dda87b096fb277ef65a&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:49.188068 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159979e-f125-40fa-ae25-e47788617945 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:49.300245 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159979e-f125-40fa-ae25-e47788617945 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:49.336899 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75eaa0-32c7-499c-a889-77b508e076b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:49.337621 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75eaa0-32c7-499c-a889-77b508e076b9 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:49.337905 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75eaa0-32c7-499c-a889-77b508e076b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:49.338194 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75eaa0-32c7-499c-a889-77b508e076b9 None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:49.338910 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75eaa0-32c7-499c-a889-77b508e076b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:49.340383 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75eaa0-32c7-499c-a889-77b508e076b9 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:49.352010 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 464/919] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Mar 29 20:02:49 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:02:49.634342 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e9879-7c07-40e8-936c-561bbe3b683b None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:49.634719 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e9879-7c07-40e8-936c-561bbe3b683b None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:49.634912 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e9879-7c07-40e8-936c-561bbe3b683b None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:49.636811 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 456/920] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:49.642319 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287ae3c-59e1-4720-9a2b-a74713929c4b None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:49.642855 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287ae3c-59e1-4720-9a2b-a74713929c4b None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:49.643336 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287ae3c-59e1-4720-9a2b-a74713929c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:49.661093 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-b287ae3c-59e1-4720-9a2b-a74713929c4b None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:49.662785 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b287ae3c-59e1-4720-9a2b-a74713929c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:49.730258 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 465/921] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 20:02:49.754303 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e9879-7c07-40e8-936c-561bbe3b683b None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:49.865322 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e9879-7c07-40e8-936c-561bbe3b683b None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:49.888039 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebca36-e96e-4f11-beb7-1a1f1816d8c5 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:49.888297 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebca36-e96e-4f11-beb7-1a1f1816d8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:49.888557 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebca36-e96e-4f11-beb7-1a1f1816d8c5 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:49.890669 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 466/922] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:49.894806 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207dde0-eaea-4be6-84a8-3fb29e613108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:49.895563 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf2013-ce44-41e7-abcf-d0184ba12c67 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:49.895671 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207dde0-eaea-4be6-84a8-3fb29e613108 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:49.895850 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf2013-ce44-41e7-abcf-d0184ba12c67 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:49.895945 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207dde0-eaea-4be6-84a8-3fb29e613108 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:49.896134 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207dde0-eaea-4be6-84a8-3fb29e613108 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:49.896242 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf2013-ce44-41e7-abcf-d0184ba12c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:49.897365 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207dde0-eaea-4be6-84a8-3fb29e613108 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:49.899445 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207dde0-eaea-4be6-84a8-3fb29e613108 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:49.911195 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-a207dde0-eaea-4be6-84a8-3fb29e613108 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 29 20:02:49.913856 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 457/923] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Mar 29 20:02:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:49.915674 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-07cf2013-ce44-41e7-abcf-d0184ba12c67 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:49.916890 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-07cf2013-ce44-41e7-abcf-d0184ba12c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:49.922929 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207dde0-eaea-4be6-84a8-3fb29e613108 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:50.005028 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 467/924] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 20:02:50.028726 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf2013-ce44-41e7-abcf-d0184ba12c67 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:50.039740 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207dde0-eaea-4be6-84a8-3fb29e613108 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:50.074115 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1ea83-0f71-46ec-a8e6-26a5de30b5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:50.075130 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1ea83-0f71-46ec-a8e6-26a5de30b5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:50.075437 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1ea83-0f71-46ec-a8e6-26a5de30b5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:50.075717 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1ea83-0f71-46ec-a8e6-26a5de30b5f0 None admin] PATH_INFO: `/v3/services` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:50.076436 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1ea83-0f71-46ec-a8e6-26a5de30b5f0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:50.076742 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1ea83-0f71-46ec-a8e6-26a5de30b5f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:50.078252 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1ea83-0f71-46ec-a8e6-26a5de30b5f0 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:50.087862 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 458/925] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Mar 29 20:02:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:50.093445 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1ea83-0f71-46ec-a8e6-26a5de30b5f0 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:50.141659 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf2013-ce44-41e7-abcf-d0184ba12c67 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:50.177222 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2d4fb-7fa9-400c-ba0c-5c528d95657a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:50.179096 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2d4fb-7fa9-400c-ba0c-5c528d95657a None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:50.179585 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2d4fb-7fa9-400c-ba0c-5c528d95657a None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:50.180073 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2d4fb-7fa9-400c-ba0c-5c528d95657a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:50.181009 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2d4fb-7fa9-400c-ba0c-5c528d95657a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:50.183096 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2d4fb-7fa9-400c-ba0c-5c528d95657a None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:50.195939 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1ea83-0f71-46ec-a8e6-26a5de30b5f0 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:50.197876 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-46f2d4fb-7fa9-400c-ba0c-5c528d95657a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 29 20:02:50.204351 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 468/926] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Mar 29 20:02:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:02:50.205502 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2d4fb-7fa9-400c-ba0c-5c528d95657a None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:50.233063 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d40df-9f00-437f-9b5b-799599a55be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:50.233765 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d40df-9f00-437f-9b5b-799599a55be8 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:50.234051 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d40df-9f00-437f-9b5b-799599a55be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:50.234339 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d40df-9f00-437f-9b5b-799599a55be8 None admin] PATH_INFO: `/v3/services` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:50.235055 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d40df-9f00-437f-9b5b-799599a55be8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:50.235365 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d40df-9f00-437f-9b5b-799599a55be8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:50.236739 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d40df-9f00-437f-9b5b-799599a55be8 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:50.243449 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 459/927] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Mar 29 20:02:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:50.248665 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d40df-9f00-437f-9b5b-799599a55be8 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:50.336252 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2d4fb-7fa9-400c-ba0c-5c528d95657a None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:50.351378 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d40df-9f00-437f-9b5b-799599a55be8 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:50.371951 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafccd1-bae8-40ab-954a-d7e67e11823c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:50.372939 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafccd1-bae8-40ab-954a-d7e67e11823c None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:50.373496 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafccd1-bae8-40ab-954a-d7e67e11823c None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:50.373995 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafccd1-bae8-40ab-954a-d7e67e11823c None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:50.374913 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafccd1-bae8-40ab-954a-d7e67e11823c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:50.375444 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafccd1-bae8-40ab-954a-d7e67e11823c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:50.377112 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafccd1-bae8-40ab-954a-d7e67e11823c None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:50.387412 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 469/928] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Mar 29 20:02:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:50.388186 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafccd1-bae8-40ab-954a-d7e67e11823c None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:50.389158 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d38d2-288d-4685-9ff7-49373f73a918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:50.389852 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d38d2-288d-4685-9ff7-49373f73a918 None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:50.390138 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d38d2-288d-4685-9ff7-49373f73a918 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:50.390416 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d38d2-288d-4685-9ff7-49373f73a918 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:50.391167 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d38d2-288d-4685-9ff7-49373f73a918 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:50.392573 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d38d2-288d-4685-9ff7-49373f73a918 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:50.493636 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 460/929] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Mar 29 20:02:50 2022] POST /identity/v3/endpoints => generated 347 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:02:50.500913 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafccd1-bae8-40ab-954a-d7e67e11823c None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:50.547659 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4778cc-3a06-4dee-be54-669c9448b01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:50.548757 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4778cc-3a06-4dee-be54-669c9448b01b None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:50.549264 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4778cc-3a06-4dee-be54-669c9448b01b None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:50.549797 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4778cc-3a06-4dee-be54-669c9448b01b None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:50.550810 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4778cc-3a06-4dee-be54-669c9448b01b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:50.551400 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4778cc-3a06-4dee-be54-669c9448b01b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:50.553125 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4778cc-3a06-4dee-be54-669c9448b01b None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:50.560047 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 470/930] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Mar 29 20:02:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:50.568616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d38d2-288d-4685-9ff7-49373f73a918 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:50.691193 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d38d2-288d-4685-9ff7-49373f73a918 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:50.733157 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25de0c-546e-4b52-a866-177d84ff2801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:50.733901 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25de0c-546e-4b52-a866-177d84ff2801 None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:50.734185 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25de0c-546e-4b52-a866-177d84ff2801 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:50.734462 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25de0c-546e-4b52-a866-177d84ff2801 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:50.735208 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25de0c-546e-4b52-a866-177d84ff2801 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:50.736609 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25de0c-546e-4b52-a866-177d84ff2801 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:50.781462 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd11255-519a-4675-ab5d-58942ed8f974 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:50.781999 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd11255-519a-4675-ab5d-58942ed8f974 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:50.781999 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd11255-519a-4675-ab5d-58942ed8f974 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:50.784160 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 471/931] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:02:50.790344 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110145b-6c5d-4dd9-9a55-aefbe189e9e0 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:50.790634 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110145b-6c5d-4dd9-9a55-aefbe189e9e0 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:50.790981 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110145b-6c5d-4dd9-9a55-aefbe189e9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:50.809519 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-f110145b-6c5d-4dd9-9a55-aefbe189e9e0 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:50.810675 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-f110145b-6c5d-4dd9-9a55-aefbe189e9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:50.842576 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 461/932] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Mar 29 20:02:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:02:50.900592 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 472/933] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 20:02:50.924711 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25de0c-546e-4b52-a866-177d84ff2801 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:51.040949 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25de0c-546e-4b52-a866-177d84ff2801 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:51.076993 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafb3be-3771-4ad8-b0b1-60af8b244801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:51.077885 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafb3be-3771-4ad8-b0b1-60af8b244801 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:51.078173 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafb3be-3771-4ad8-b0b1-60af8b244801 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:51.078453 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafb3be-3771-4ad8-b0b1-60af8b244801 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:51.088690 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafb3be-3771-4ad8-b0b1-60af8b244801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:51.096153 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-5fafb3be-3771-4ad8-b0b1-60af8b244801 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 29 20:02:51.097679 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 462/934] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Mar 29 20:02:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:51.104030 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110145b-6c5d-4dd9-9a55-aefbe189e9e0 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:51.206887 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110145b-6c5d-4dd9-9a55-aefbe189e9e0 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:51.242734 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077dc74e-f14f-423e-9cb3-e7429fa4b51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:51.243708 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077dc74e-f14f-423e-9cb3-e7429fa4b51c None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:51.244176 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077dc74e-f14f-423e-9cb3-e7429fa4b51c None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:51.244668 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077dc74e-f14f-423e-9cb3-e7429fa4b51c None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:51.245618 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077dc74e-f14f-423e-9cb3-e7429fa4b51c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:51.246108 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077dc74e-f14f-423e-9cb3-e7429fa4b51c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:51.247661 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077dc74e-f14f-423e-9cb3-e7429fa4b51c None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:51.257222 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 473/935] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Mar 29 20:02:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:51.266777 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafb3be-3771-4ad8-b0b1-60af8b244801 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:51.371738 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafb3be-3771-4ad8-b0b1-60af8b244801 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:51.406172 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816986d-98ef-48fa-b7b1-8ef57f824eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:51.407027 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816986d-98ef-48fa-b7b1-8ef57f824eff None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:51.407321 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816986d-98ef-48fa-b7b1-8ef57f824eff None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:51.407598 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816986d-98ef-48fa-b7b1-8ef57f824eff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:51.418322 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816986d-98ef-48fa-b7b1-8ef57f824eff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:51.419774 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816986d-98ef-48fa-b7b1-8ef57f824eff None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:51.437225 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-5816986d-98ef-48fa-b7b1-8ef57f824eff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:51.438775 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 463/936] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:51.445074 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077dc74e-f14f-423e-9cb3-e7429fa4b51c None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:51.551755 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077dc74e-f14f-423e-9cb3-e7429fa4b51c None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:51.589995 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce212d5-feee-46c5-9930-e78a63a203b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:51.591027 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce212d5-feee-46c5-9930-e78a63a203b3 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:51.591514 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce212d5-feee-46c5-9930-e78a63a203b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:51.592014 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce212d5-feee-46c5-9930-e78a63a203b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:51.592932 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce212d5-feee-46c5-9930-e78a63a203b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:51.593480 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce212d5-feee-46c5-9930-e78a63a203b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:51.595039 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce212d5-feee-46c5-9930-e78a63a203b3 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:51.608222 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 474/937] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:51.613723 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816986d-98ef-48fa-b7b1-8ef57f824eff None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:51.719425 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816986d-98ef-48fa-b7b1-8ef57f824eff None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:51.754351 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e3034-d7d7-4d1a-ad90-8362bdc0b742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:51.755199 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e3034-d7d7-4d1a-ad90-8362bdc0b742 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:51.755479 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e3034-d7d7-4d1a-ad90-8362bdc0b742 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:51.755753 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e3034-d7d7-4d1a-ad90-8362bdc0b742 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:51.765800 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e3034-d7d7-4d1a-ad90-8362bdc0b742 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:51.767344 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e3034-d7d7-4d1a-ad90-8362bdc0b742 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:51.782897 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-dd1e3034-d7d7-4d1a-ad90-8362bdc0b742 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 29 20:02:51.789426 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 464/938] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Mar 29 20:02:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:51.791487 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce212d5-feee-46c5-9930-e78a63a203b3 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:51.859299 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df07df-ac38-4655-ae8a-23a659ca32f2 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:51.859594 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df07df-ac38-4655-ae8a-23a659ca32f2 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:51.859872 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df07df-ac38-4655-ae8a-23a659ca32f2 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:51.861934 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 465/939] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:51.867119 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db29bf5-72fb-4a80-b979-65691ce7c80d None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:51.867411 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db29bf5-72fb-4a80-b979-65691ce7c80d None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:51.867694 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db29bf5-72fb-4a80-b979-65691ce7c80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:51.884434 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-5db29bf5-72fb-4a80-b979-65691ce7c80d None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:51.885675 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-5db29bf5-72fb-4a80-b979-65691ce7c80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:51.902846 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce212d5-feee-46c5-9930-e78a63a203b3 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:51.947657 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc93474-ffb9-4d05-b95a-4a1c6a953112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:51.948612 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc93474-ffb9-4d05-b95a-4a1c6a953112 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:51.949042 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc93474-ffb9-4d05-b95a-4a1c6a953112 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:51.949552 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc93474-ffb9-4d05-b95a-4a1c6a953112 None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:51.950529 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc93474-ffb9-4d05-b95a-4a1c6a953112 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:51.950981 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc93474-ffb9-4d05-b95a-4a1c6a953112 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:51.952616 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc93474-ffb9-4d05-b95a-4a1c6a953112 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:51.971283 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 466/940] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 20:02:51.977655 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 475/941] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Mar 29 20:02:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:51.978344 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db29bf5-72fb-4a80-b979-65691ce7c80d None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:51.995367 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc93474-ffb9-4d05-b95a-4a1c6a953112 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:52.100548 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc93474-ffb9-4d05-b95a-4a1c6a953112 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:52.105969 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db29bf5-72fb-4a80-b979-65691ce7c80d None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:52.140695 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8554c-43fe-4894-8638-1c07c29c270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:52.142269 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8554c-43fe-4894-8638-1c07c29c270d None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:52.142954 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8554c-43fe-4894-8638-1c07c29c270d None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:52.143480 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8554c-43fe-4894-8638-1c07c29c270d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:52.144444 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8554c-43fe-4894-8638-1c07c29c270d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:52.146398 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8554c-43fe-4894-8638-1c07c29c270d None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:52.147370 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39184e01-3808-4dbc-81b5-cd68787bd3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:52.148315 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39184e01-3808-4dbc-81b5-cd68787bd3dc None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:52.148607 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39184e01-3808-4dbc-81b5-cd68787bd3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:52.148889 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39184e01-3808-4dbc-81b5-cd68787bd3dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:52.160912 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39184e01-3808-4dbc-81b5-cd68787bd3dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:52.162111 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-37e8554c-43fe-4894-8638-1c07c29c270d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 29 20:02:52.162493 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39184e01-3808-4dbc-81b5-cd68787bd3dc None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:52.164982 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 476/942] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Mar 29 20:02:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:52.170262 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8554c-43fe-4894-8638-1c07c29c270d None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:52.186119 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-39184e01-3808-4dbc-81b5-cd68787bd3dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:52.192633 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 467/943] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:52.194956 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39184e01-3808-4dbc-81b5-cd68787bd3dc None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:52.285946 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8554c-43fe-4894-8638-1c07c29c270d None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:52.311022 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39184e01-3808-4dbc-81b5-cd68787bd3dc None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:52.330686 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afdeca-6955-4940-ae56-075400477f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:52.331716 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afdeca-6955-4940-ae56-075400477f6a None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:52.332195 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afdeca-6955-4940-ae56-075400477f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:52.333078 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afdeca-6955-4940-ae56-075400477f6a None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:52.334865 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afdeca-6955-4940-ae56-075400477f6a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:52.336145 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afdeca-6955-4940-ae56-075400477f6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:52.338304 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afdeca-6955-4940-ae56-075400477f6a None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:52.345085 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 477/944] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Mar 29 20:02:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:52.346969 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f328f1c-2978-4f2b-a3dc-577df663a3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:52.347718 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f328f1c-2978-4f2b-a3dc-577df663a3fc None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:52.348070 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f328f1c-2978-4f2b-a3dc-577df663a3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:52.348414 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f328f1c-2978-4f2b-a3dc-577df663a3fc None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:52.349200 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f328f1c-2978-4f2b-a3dc-577df663a3fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:52.349617 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f328f1c-2978-4f2b-a3dc-577df663a3fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:52.351158 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afdeca-6955-4940-ae56-075400477f6a None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:52.352388 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f328f1c-2978-4f2b-a3dc-577df663a3fc None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:52.369258 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 468/945] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:52.371314 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f328f1c-2978-4f2b-a3dc-577df663a3fc None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:52.478232 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afdeca-6955-4940-ae56-075400477f6a None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:52.480638 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f328f1c-2978-4f2b-a3dc-577df663a3fc None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:52.515047 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258bbb0-2d12-4cc1-8fb5-b6a4944d0c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:52.515842 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258bbb0-2d12-4cc1-8fb5-b6a4944d0c4b None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:52.516120 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258bbb0-2d12-4cc1-8fb5-b6a4944d0c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:52.516392 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258bbb0-2d12-4cc1-8fb5-b6a4944d0c4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:52.516576 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e3da2-28bc-441d-95dc-7c53f357826a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:52.517513 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e3da2-28bc-441d-95dc-7c53f357826a None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:52.517990 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e3da2-28bc-441d-95dc-7c53f357826a None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:52.518458 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e3da2-28bc-441d-95dc-7c53f357826a None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:52.519359 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e3da2-28bc-441d-95dc-7c53f357826a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:52.519857 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e3da2-28bc-441d-95dc-7c53f357826a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:52.521447 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e3da2-28bc-441d-95dc-7c53f357826a None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:52.523742 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258bbb0-2d12-4cc1-8fb5-b6a4944d0c4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:52.525159 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258bbb0-2d12-4cc1-8fb5-b6a4944d0c4b None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:52.527995 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 478/946] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Mar 29 20:02:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:52.538041 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e3da2-28bc-441d-95dc-7c53f357826a None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:52.539877 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-f258bbb0-2d12-4cc1-8fb5-b6a4944d0c4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:52.541346 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 469/947] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:52.551207 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258bbb0-2d12-4cc1-8fb5-b6a4944d0c4b None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:52.659144 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e3da2-28bc-441d-95dc-7c53f357826a None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:52.680178 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258bbb0-2d12-4cc1-8fb5-b6a4944d0c4b None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:52.694319 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be49ca7-9173-4b5d-b8c9-b72ce863f75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:52.695310 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be49ca7-9173-4b5d-b8c9-b72ce863f75e None admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:52.695798 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be49ca7-9173-4b5d-b8c9-b72ce863f75e None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:52.696277 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be49ca7-9173-4b5d-b8c9-b72ce863f75e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:52.697710 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be49ca7-9173-4b5d-b8c9-b72ce863f75e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:52.699346 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be49ca7-9173-4b5d-b8c9-b72ce863f75e None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:52.720468 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03e861-1651-458a-b07f-bc4a19c524a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:52.721131 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03e861-1651-458a-b07f-bc4a19c524a5 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:52.721453 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03e861-1651-458a-b07f-bc4a19c524a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:52.721737 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03e861-1651-458a-b07f-bc4a19c524a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:52.722523 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03e861-1651-458a-b07f-bc4a19c524a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:52.722837 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03e861-1651-458a-b07f-bc4a19c524a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:52.724263 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03e861-1651-458a-b07f-bc4a19c524a5 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:52.736381 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 470/948] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:52.742805 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03e861-1651-458a-b07f-bc4a19c524a5 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:52.794171 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 479/949] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Mar 29 20:02:52 2022] POST /identity/v3/endpoints => generated 349 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:02:52.864442 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03e861-1651-458a-b07f-bc4a19c524a5 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:52.910107 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37222ad0-0baa-4d2d-9500-13a8c3590c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:52.911009 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37222ad0-0baa-4d2d-9500-13a8c3590c2b None admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:52.911298 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37222ad0-0baa-4d2d-9500-13a8c3590c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:52.911576 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37222ad0-0baa-4d2d-9500-13a8c3590c2b None admin] PATH_INFO: `/v3/projects/ec1f2c5cb900473da1083830387e3ff4/users/a706b6d0163549bc80285c4158331b94/roles/cb894452030c4656aaa8ad80b903bef6` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:52.914041 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37222ad0-0baa-4d2d-9500-13a8c3590c2b None admin] RBAC: Authorizing `identity:create_grant(project_id=ec1f2c5cb900473da1083830387e3ff4, user_id=a706b6d0163549bc80285c4158331b94, role_id=cb894452030c4656aaa8ad80b903bef6)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:52.915501 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37222ad0-0baa-4d2d-9500-13a8c3590c2b None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:52.961900 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18758323-25ef-42c7-b1c9-ae642204ab52 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:52.962272 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18758323-25ef-42c7-b1c9-ae642204ab52 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:52.962484 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18758323-25ef-42c7-b1c9-ae642204ab52 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:52.964477 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 480/950] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:02:52.970634 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4afa6f-b450-4181-b86a-289f7bdd83a7 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:52.970945 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4afa6f-b450-4181-b86a-289f7bdd83a7 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:52.971212 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4afa6f-b450-4181-b86a-289f7bdd83a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:52.984673 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 471/951] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Mar 29 20:02:52 2022] PUT /identity/v3/projects/ec1f2c5cb900473da1083830387e3ff4/users/a706b6d0163549bc80285c4158331b94/roles/cb894452030c4656aaa8ad80b903bef6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:02:52.991212 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-3a4afa6f-b450-4181-b86a-289f7bdd83a7 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:52.992490 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-3a4afa6f-b450-4181-b86a-289f7bdd83a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:53.076475 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 481/952] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 20:02:53.100936 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37222ad0-0baa-4d2d-9500-13a8c3590c2b None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:53.211695 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37222ad0-0baa-4d2d-9500-13a8c3590c2b None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:53.249004 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065c0bf-fa20-498d-9239-09264897bb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:53.249868 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065c0bf-fa20-498d-9239-09264897bb6b None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:53.250149 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065c0bf-fa20-498d-9239-09264897bb6b None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:53.250465 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065c0bf-fa20-498d-9239-09264897bb6b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:53.251122 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065c0bf-fa20-498d-9239-09264897bb6b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:53.252475 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065c0bf-fa20-498d-9239-09264897bb6b None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:53.263474 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-d065c0bf-fa20-498d-9239-09264897bb6b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 29 20:02:53.264979 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 472/953] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:53.270992 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4afa6f-b450-4181-b86a-289f7bdd83a7 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:53.372100 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f68f69-4947-40a0-b362-9f90e69d28ff None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:53.372394 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f68f69-4947-40a0-b362-9f90e69d28ff None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:53.372589 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f68f69-4947-40a0-b362-9f90e69d28ff None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:53.374502 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4afa6f-b450-4181-b86a-289f7bdd83a7 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:53.378095 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 473/954] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:02:53.379590 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a8d3f-ac1d-4038-bdb7-09e2ca45bf93 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:53.379885 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a8d3f-ac1d-4038-bdb7-09e2ca45bf93 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:53.380170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a8d3f-ac1d-4038-bdb7-09e2ca45bf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:53.397687 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-2d9a8d3f-ac1d-4038-bdb7-09e2ca45bf93 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:53.398915 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-2d9a8d3f-ac1d-4038-bdb7-09e2ca45bf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:53.418162 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a0a7c-17e1-45a3-a970-a683cff711da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:53.418832 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a0a7c-17e1-45a3-a970-a683cff711da None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:53.419131 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a0a7c-17e1-45a3-a970-a683cff711da None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:53.419420 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a0a7c-17e1-45a3-a970-a683cff711da None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:53.420092 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a0a7c-17e1-45a3-a970-a683cff711da None admin] RBAC: Adding query filter params (name=compute) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:53.420398 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a0a7c-17e1-45a3-a970-a683cff711da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:53.421802 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a0a7c-17e1-45a3-a970-a683cff711da None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:53.426914 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 482/955] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Mar 29 20:02:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:53.433274 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a0a7c-17e1-45a3-a970-a683cff711da None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:53.487882 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 474/956] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 20:02:53.512885 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a8d3f-ac1d-4038-bdb7-09e2ca45bf93 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:53.552270 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a0a7c-17e1-45a3-a970-a683cff711da None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:53.589205 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68b21e-8584-44f1-94d7-7c20150d1ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:53.589205 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68b21e-8584-44f1-94d7-7c20150d1ecb None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:53.589524 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68b21e-8584-44f1-94d7-7c20150d1ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:53.589801 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68b21e-8584-44f1-94d7-7c20150d1ecb None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:53.590504 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68b21e-8584-44f1-94d7-7c20150d1ecb None admin] RBAC: Adding query filter params (type=compute) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:53.590814 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68b21e-8584-44f1-94d7-7c20150d1ecb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:53.592242 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68b21e-8584-44f1-94d7-7c20150d1ecb None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:53.601808 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 483/957] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Mar 29 20:02:53 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:53.628659 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a8d3f-ac1d-4038-bdb7-09e2ca45bf93 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:53.665158 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4af86-a90f-4890-9fed-18ad3039f822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:53.665876 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4af86-a90f-4890-9fed-18ad3039f822 None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:53.666160 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4af86-a90f-4890-9fed-18ad3039f822 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:53.666439 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4af86-a90f-4890-9fed-18ad3039f822 None admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:53.667173 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4af86-a90f-4890-9fed-18ad3039f822 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:53.668637 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4af86-a90f-4890-9fed-18ad3039f822 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:53.670191 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.common [None req-b2e4af86-a90f-4890-9fed-18ad3039f822 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Mar 29 20:02:53.736283 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.sql.core [None req-b2e4af86-a90f-4890-9fed-18ad3039f822 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Mar 29 20:02:53.736283 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Mar 29 20:02:53.736283 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [parameters: {'id': '53c5fd381a744266be1ac4c7c1067692', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Mar 29 20:02:53.736283 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80093) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 29 20:02:53.753038 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-b2e4af86-a90f-4890-9fed-18ad3039f822 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 53c5fd381a744266be1ac4c7c1067692.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 53c5fd381a744266be1ac4c7c1067692. Mar 29 20:02:53.759564 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 475/958] 10.222.0.43 () {60 vars in 1140 bytes} [Tue Mar 29 20:02:53 2022] POST /identity/v3/projects => generated 262 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:53.761434 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68b21e-8584-44f1-94d7-7c20150d1ecb None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:53.868688 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68b21e-8584-44f1-94d7-7c20150d1ecb None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:53.903900 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26033002-c9f1-4aea-a841-847c483fbcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:53.904617 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26033002-c9f1-4aea-a841-847c483fbcef None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:53.904897 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26033002-c9f1-4aea-a841-847c483fbcef None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:53.905170 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26033002-c9f1-4aea-a841-847c483fbcef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:53.912092 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26033002-c9f1-4aea-a841-847c483fbcef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:53.914446 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26033002-c9f1-4aea-a841-847c483fbcef None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:53.927940 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-26033002-c9f1-4aea-a841-847c483fbcef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:53.933552 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 484/959] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:53.940335 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4af86-a90f-4890-9fed-18ad3039f822 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:54.044353 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4af86-a90f-4890-9fed-18ad3039f822 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:54.079806 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cc1d6-3386-40e7-be45-677e315f9bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:54.080524 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cc1d6-3386-40e7-be45-677e315f9bdd None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:54.080812 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cc1d6-3386-40e7-be45-677e315f9bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:54.081089 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cc1d6-3386-40e7-be45-677e315f9bdd None admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:54.081920 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cc1d6-3386-40e7-be45-677e315f9bdd None admin] RBAC: Adding query filter params (name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:54.082233 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cc1d6-3386-40e7-be45-677e315f9bdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:54.083930 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cc1d6-3386-40e7-be45-677e315f9bdd None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:54.109438 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 476/960] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Mar 29 20:02:53 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:55.231210 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f17de-9acb-4b9c-93a4-dbd115d2c1ff None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:55.231701 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f17de-9acb-4b9c-93a4-dbd115d2c1ff None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:55.231701 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f17de-9acb-4b9c-93a4-dbd115d2c1ff None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:55.233816 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 485/961] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:55.239493 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5ddec-fcea-4477-adf8-21433018c30d None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:55.239899 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5ddec-fcea-4477-adf8-21433018c30d None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:55.240064 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5ddec-fcea-4477-adf8-21433018c30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:55.258197 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-ddf5ddec-fcea-4477-adf8-21433018c30d None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:55.259775 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-ddf5ddec-fcea-4477-adf8-21433018c30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:55.336203 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 477/962] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:02:55.355190 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f17de-9acb-4b9c-93a4-dbd115d2c1ff None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:55.368761 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7d799-5ea6-4381-ae93-bb370901e90e None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:55.369055 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7d799-5ea6-4381-ae93-bb370901e90e None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:55.369368 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7d799-5ea6-4381-ae93-bb370901e90e None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:55.371398 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 478/963] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:55.376322 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa659d3e-3de6-4a70-8f77-c335ba86185b None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:55.376638 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa659d3e-3de6-4a70-8f77-c335ba86185b None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:55.376923 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa659d3e-3de6-4a70-8f77-c335ba86185b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:55.393727 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-aa659d3e-3de6-4a70-8f77-c335ba86185b None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:55.394916 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-aa659d3e-3de6-4a70-8f77-c335ba86185b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:55.464352 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f17de-9acb-4b9c-93a4-dbd115d2c1ff None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:55.473390 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 479/964] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 20:02:55.492411 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa659d3e-3de6-4a70-8f77-c335ba86185b None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:55.501209 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1faf4b-5de6-49f2-9cff-d71dc9273320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:55.505315 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1faf4b-5de6-49f2-9cff-d71dc9273320 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:55.505315 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1faf4b-5de6-49f2-9cff-d71dc9273320 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:55.505315 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1faf4b-5de6-49f2-9cff-d71dc9273320 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:55.505315 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1faf4b-5de6-49f2-9cff-d71dc9273320 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:55.505315 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1faf4b-5de6-49f2-9cff-d71dc9273320 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:55.516361 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-cc1faf4b-5de6-49f2-9cff-d71dc9273320 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 29 20:02:55.517877 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 486/965] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Mar 29 20:02:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:55.523664 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1faf4b-5de6-49f2-9cff-d71dc9273320 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:55.597178 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa659d3e-3de6-4a70-8f77-c335ba86185b None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:55.634957 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c093a-4b2c-4fe6-82df-2ab6a9a323f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:55.635795 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c093a-4b2c-4fe6-82df-2ab6a9a323f9 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:55.636079 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c093a-4b2c-4fe6-82df-2ab6a9a323f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:55.636358 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c093a-4b2c-4fe6-82df-2ab6a9a323f9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:55.644455 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1faf4b-5de6-49f2-9cff-d71dc9273320 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:55.648496 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c093a-4b2c-4fe6-82df-2ab6a9a323f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:02:55.656326 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-3e4c093a-4b2c-4fe6-82df-2ab6a9a323f9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 29 20:02:55.661387 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 480/966] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Mar 29 20:02:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:55.663974 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c093a-4b2c-4fe6-82df-2ab6a9a323f9 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:55.681550 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34519e3f-ba42-4838-a987-1a65fca7bee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:55.682568 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34519e3f-ba42-4838-a987-1a65fca7bee8 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:55.683075 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34519e3f-ba42-4838-a987-1a65fca7bee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:55.683557 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34519e3f-ba42-4838-a987-1a65fca7bee8 None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:55.684453 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34519e3f-ba42-4838-a987-1a65fca7bee8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:55.684957 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34519e3f-ba42-4838-a987-1a65fca7bee8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:55.686566 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34519e3f-ba42-4838-a987-1a65fca7bee8 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:55.696765 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 487/967] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Mar 29 20:02:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:55.698532 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34519e3f-ba42-4838-a987-1a65fca7bee8 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:55.787176 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c093a-4b2c-4fe6-82df-2ab6a9a323f9 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:55.820325 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34519e3f-ba42-4838-a987-1a65fca7bee8 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:55.823035 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac811092-181c-4996-8f14-9b68af9a8337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:55.823980 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac811092-181c-4996-8f14-9b68af9a8337 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:55.824162 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac811092-181c-4996-8f14-9b68af9a8337 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:55.824532 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac811092-181c-4996-8f14-9b68af9a8337 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:55.825435 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac811092-181c-4996-8f14-9b68af9a8337 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:55.825843 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac811092-181c-4996-8f14-9b68af9a8337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:55.827319 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac811092-181c-4996-8f14-9b68af9a8337 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:55.841525 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 481/968] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Mar 29 20:02:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:55.842661 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac811092-181c-4996-8f14-9b68af9a8337 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:55.859410 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9582412-fece-4732-a350-eca17fb6c0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:55.860362 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9582412-fece-4732-a350-eca17fb6c0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:55.860817 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9582412-fece-4732-a350-eca17fb6c0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:55.861240 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9582412-fece-4732-a350-eca17fb6c0f1 None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:55.862135 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9582412-fece-4732-a350-eca17fb6c0f1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:55.862598 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9582412-fece-4732-a350-eca17fb6c0f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:55.864099 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9582412-fece-4732-a350-eca17fb6c0f1 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:55.874696 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 488/969] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Mar 29 20:02:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:55.876074 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9582412-fece-4732-a350-eca17fb6c0f1 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:55.953007 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac811092-181c-4996-8f14-9b68af9a8337 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:55.978636 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9582412-fece-4732-a350-eca17fb6c0f1 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:55.988897 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6344e-a1a6-4db6-93f8-55f39065b8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:55.989810 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6344e-a1a6-4db6-93f8-55f39065b8cb None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:55.990271 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6344e-a1a6-4db6-93f8-55f39065b8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:55.991243 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6344e-a1a6-4db6-93f8-55f39065b8cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:56.002350 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6344e-a1a6-4db6-93f8-55f39065b8cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:56.003783 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6344e-a1a6-4db6-93f8-55f39065b8cb None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:56.015109 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f30f5-e23e-4032-9910-dc98cdb7365e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:56.015769 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f30f5-e23e-4032-9910-dc98cdb7365e None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:56.016051 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f30f5-e23e-4032-9910-dc98cdb7365e None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:56.016330 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f30f5-e23e-4032-9910-dc98cdb7365e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:56.017173 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f30f5-e23e-4032-9910-dc98cdb7365e None admin] RBAC: Adding query filter params (interface=admin, service_id=4feb0f5381e84dda87b096fb277ef65a, region_id=RegionOne) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:56.017516 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f30f5-e23e-4032-9910-dc98cdb7365e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:56.018871 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f30f5-e23e-4032-9910-dc98cdb7365e None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:56.021919 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-85f6344e-a1a6-4db6-93f8-55f39065b8cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:56.027690 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 482/970] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:02:56.027690 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75522f22-6b95-47a0-a505-b087bbdf49b9 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:56.027690 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75522f22-6b95-47a0-a505-b087bbdf49b9 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:56.027690 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75522f22-6b95-47a0-a505-b087bbdf49b9 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:56.029059 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 483/971] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:56.030412 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75522f22-6b95-47a0-a505-b087bbdf49b9 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:56.031720 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 489/972] 10.222.0.43 () {56 vars in 1249 bytes} [Tue Mar 29 20:02:55 2022] GET /identity/v3/endpoints?service_id=4feb0f5381e84dda87b096fb277ef65a&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:56.033075 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5c2f8-1879-47e9-8823-9b62923a4c1c None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:56.033592 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5c2f8-1879-47e9-8823-9b62923a4c1c None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:56.033984 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5c2f8-1879-47e9-8823-9b62923a4c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:56.051884 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-f2e5c2f8-1879-47e9-8823-9b62923a4c1c None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:56.053808 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-f2e5c2f8-1879-47e9-8823-9b62923a4c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:56.122140 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 490/973] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:02:56.123341 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5c2f8-1879-47e9-8823-9b62923a4c1c None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:56.150227 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75522f22-6b95-47a0-a505-b087bbdf49b9 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:56.184578 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf69c4-1a61-4f4c-815a-8d24df0374e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:56.185368 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf69c4-1a61-4f4c-815a-8d24df0374e6 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:56.185660 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf69c4-1a61-4f4c-815a-8d24df0374e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:56.185938 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf69c4-1a61-4f4c-815a-8d24df0374e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:56.186662 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf69c4-1a61-4f4c-815a-8d24df0374e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:56.186971 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf69c4-1a61-4f4c-815a-8d24df0374e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:56.188335 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf69c4-1a61-4f4c-815a-8d24df0374e6 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:56.204555 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 484/974] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:56.204555 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf69c4-1a61-4f4c-815a-8d24df0374e6 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:56.239418 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5c2f8-1879-47e9-8823-9b62923a4c1c None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:56.273338 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97387ad8-6156-4063-bf23-0f7e21222611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:56.274012 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97387ad8-6156-4063-bf23-0f7e21222611 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:56.274299 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97387ad8-6156-4063-bf23-0f7e21222611 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:56.274581 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97387ad8-6156-4063-bf23-0f7e21222611 None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:56.275262 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97387ad8-6156-4063-bf23-0f7e21222611 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:56.276659 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97387ad8-6156-4063-bf23-0f7e21222611 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:56.293324 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 491/975] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Mar 29 20:02:56 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:02:56.293324 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97387ad8-6156-4063-bf23-0f7e21222611 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:56.322285 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf69c4-1a61-4f4c-815a-8d24df0374e6 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:56.368555 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d33f28-c007-442d-94e2-6ec5f7ebfd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:56.369343 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d33f28-c007-442d-94e2-6ec5f7ebfd41 None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:56.369701 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d33f28-c007-442d-94e2-6ec5f7ebfd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:56.370216 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d33f28-c007-442d-94e2-6ec5f7ebfd41 None admin] PATH_INFO: `/v3/services` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:56.371450 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d33f28-c007-442d-94e2-6ec5f7ebfd41 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:56.373392 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d33f28-c007-442d-94e2-6ec5f7ebfd41 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:56.390303 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97387ad8-6156-4063-bf23-0f7e21222611 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:56.427136 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ea614-7de6-4209-9d75-1f96ad0b4b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:56.428058 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ea614-7de6-4209-9d75-1f96ad0b4b34 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:56.428345 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ea614-7de6-4209-9d75-1f96ad0b4b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:56.428647 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ea614-7de6-4209-9d75-1f96ad0b4b34 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:56.436970 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ea614-7de6-4209-9d75-1f96ad0b4b34 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:56.438497 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ea614-7de6-4209-9d75-1f96ad0b4b34 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:56.457532 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-523ea614-7de6-4209-9d75-1f96ad0b4b34 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 29 20:02:56.457839 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 485/976] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Mar 29 20:02:56 2022] POST /identity/v3/services => generated 242 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:02:56.460277 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 492/977] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Mar 29 20:02:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:56.466210 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d33f28-c007-442d-94e2-6ec5f7ebfd41 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:56.496899 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0e19a-1da8-4867-a275-2d1eeeccfb65 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:56.497210 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0e19a-1da8-4867-a275-2d1eeeccfb65 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:56.497692 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0e19a-1da8-4867-a275-2d1eeeccfb65 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:56.499724 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 493/978] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:02:56.505449 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7af8de-5ec5-48f7-a594-8f091a539feb None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:56.505789 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7af8de-5ec5-48f7-a594-8f091a539feb None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:56.506057 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7af8de-5ec5-48f7-a594-8f091a539feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:56.527552 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-7f7af8de-5ec5-48f7-a594-8f091a539feb None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:56.528750 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-7f7af8de-5ec5-48f7-a594-8f091a539feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:56.603260 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d33f28-c007-442d-94e2-6ec5f7ebfd41 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:56.615974 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 494/979] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:02:56.636169 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7af8de-5ec5-48f7-a594-8f091a539feb None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:56.640384 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c513cd7-351b-4bb1-bf32-e4216b353296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:56.640587 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c513cd7-351b-4bb1-bf32-e4216b353296 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:56.640776 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c513cd7-351b-4bb1-bf32-e4216b353296 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:56.640987 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c513cd7-351b-4bb1-bf32-e4216b353296 None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:56.641889 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c513cd7-351b-4bb1-bf32-e4216b353296 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:56.642200 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c513cd7-351b-4bb1-bf32-e4216b353296 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:56.643677 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c513cd7-351b-4bb1-bf32-e4216b353296 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:56.667987 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 486/980] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Mar 29 20:02:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:56.670073 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c513cd7-351b-4bb1-bf32-e4216b353296 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:56.751430 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7af8de-5ec5-48f7-a594-8f091a539feb None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:56.786128 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720ecd5-a120-4f3b-b647-94d687526f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:56.787771 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720ecd5-a120-4f3b-b647-94d687526f7d None admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:56.788129 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720ecd5-a120-4f3b-b647-94d687526f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:56.788481 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720ecd5-a120-4f3b-b647-94d687526f7d None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:56.789540 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8720ecd5-a120-4f3b-b647-94d687526f7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:56.791533 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8720ecd5-a120-4f3b-b647-94d687526f7d None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:56.793360 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.common [None req-8720ecd5-a120-4f3b-b647-94d687526f7d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Mar 29 20:02:56.796937 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c513cd7-351b-4bb1-bf32-e4216b353296 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:56.831922 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fbdb4-fdee-4b43-8d05-2a3502bea33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:56.832911 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fbdb4-fdee-4b43-8d05-2a3502bea33b None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:56.833398 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fbdb4-fdee-4b43-8d05-2a3502bea33b None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:56.833942 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fbdb4-fdee-4b43-8d05-2a3502bea33b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:56.836010 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.sql.core [None req-8720ecd5-a120-4f3b-b647-94d687526f7d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Mar 29 20:02:56.836010 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Mar 29 20:02:56.836010 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [parameters: {'user_id': '974a8a3eda9e404284966cbcb2b928a5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Mar 29 20:02:56.836010 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80092) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 29 20:02:56.844219 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-8720ecd5-a120-4f3b-b647-94d687526f7d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Mar 29 20:02:56.849366 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 495/981] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Mar 29 20:02:56 2022] POST /identity/v3/users => generated 160 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:02:56.854071 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720ecd5-a120-4f3b-b647-94d687526f7d None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:56.910901 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904fbdb4-fdee-4b43-8d05-2a3502bea33b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:56.913391 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904fbdb4-fdee-4b43-8d05-2a3502bea33b None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:56.986219 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720ecd5-a120-4f3b-b647-94d687526f7d None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:57.031394 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4640e5e-36f3-469c-bd81-5ebe2db0081d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:57.031394 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4640e5e-36f3-469c-bd81-5ebe2db0081d None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:57.031394 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4640e5e-36f3-469c-bd81-5ebe2db0081d None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:57.031394 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4640e5e-36f3-469c-bd81-5ebe2db0081d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:57.031980 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 487/982] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:02:56 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 20:02:57.033063 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fbdb4-fdee-4b43-8d05-2a3502bea33b None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:57.041235 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4640e5e-36f3-469c-bd81-5ebe2db0081d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:57.043729 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4640e5e-36f3-469c-bd81-5ebe2db0081d None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:57.061973 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-b4640e5e-36f3-469c-bd81-5ebe2db0081d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 29 20:02:57.065375 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 496/983] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:02:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:02:57.070451 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4640e5e-36f3-469c-bd81-5ebe2db0081d None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:57.155245 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fbdb4-fdee-4b43-8d05-2a3502bea33b None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:57.169420 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4640e5e-36f3-469c-bd81-5ebe2db0081d None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:57.198052 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1a0c5-f1d8-4768-a810-416ab6b6653a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:57.199017 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1a0c5-f1d8-4768-a810-416ab6b6653a None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:57.199306 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1a0c5-f1d8-4768-a810-416ab6b6653a None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:57.199587 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1a0c5-f1d8-4768-a810-416ab6b6653a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:57.204901 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf9f91-7564-4e37-b010-4cdb163e5fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:57.205867 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf9f91-7564-4e37-b010-4cdb163e5fdc None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:57.206378 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf9f91-7564-4e37-b010-4cdb163e5fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:57.206861 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf9f91-7564-4e37-b010-4cdb163e5fdc None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:57.207847 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf9f91-7564-4e37-b010-4cdb163e5fdc None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:57.208350 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf9f91-7564-4e37-b010-4cdb163e5fdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:57.210759 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf9f91-7564-4e37-b010-4cdb163e5fdc None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:57.211741 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1a0c5-f1d8-4768-a810-416ab6b6653a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:57.213392 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1a0c5-f1d8-4768-a810-416ab6b6653a None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:57.232119 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-11d1a0c5-f1d8-4768-a810-416ab6b6653a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:02:57.233728 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 488/984] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:57.242210 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1a0c5-f1d8-4768-a810-416ab6b6653a None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:57.265937 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 497/985] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Mar 29 20:02:57 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:57.355525 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1a0c5-f1d8-4768-a810-416ab6b6653a None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:57.393020 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9017f5f-50d6-4133-9632-4eb06f27effe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:57.393747 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9017f5f-50d6-4133-9632-4eb06f27effe None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:57.394039 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9017f5f-50d6-4133-9632-4eb06f27effe None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:57.394320 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9017f5f-50d6-4133-9632-4eb06f27effe None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:57.395073 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9017f5f-50d6-4133-9632-4eb06f27effe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:57.395388 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9017f5f-50d6-4133-9632-4eb06f27effe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:57.397518 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9017f5f-50d6-4133-9632-4eb06f27effe None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:57.410990 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 489/986] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:57.416915 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf9f91-7564-4e37-b010-4cdb163e5fdc None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:57.522128 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf9f91-7564-4e37-b010-4cdb163e5fdc None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:57.560246 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47311b84-0717-417b-89b5-794d238cc6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:57.561042 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47311b84-0717-417b-89b5-794d238cc6ee None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:57.561350 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47311b84-0717-417b-89b5-794d238cc6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:57.561631 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47311b84-0717-417b-89b5-794d238cc6ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:57.568540 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47311b84-0717-417b-89b5-794d238cc6ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:57.570135 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47311b84-0717-417b-89b5-794d238cc6ee None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:57.583817 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-47311b84-0717-417b-89b5-794d238cc6ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:02:57.585282 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 498/987] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:57.590941 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9017f5f-50d6-4133-9632-4eb06f27effe None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:57.688882 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9017f5f-50d6-4133-9632-4eb06f27effe None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:57.721821 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823fb521-057f-40e9-a264-d5dc676fa9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:57.722479 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fb521-057f-40e9-a264-d5dc676fa9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:57.722764 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fb521-057f-40e9-a264-d5dc676fa9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:57.723040 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fb521-057f-40e9-a264-d5dc676fa9a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:57.723818 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823fb521-057f-40e9-a264-d5dc676fa9a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:57.724129 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823fb521-057f-40e9-a264-d5dc676fa9a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:57.726344 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823fb521-057f-40e9-a264-d5dc676fa9a3 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:57.738977 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 490/988] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:02:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:57.744937 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47311b84-0717-417b-89b5-794d238cc6ee None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:57.840610 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47311b84-0717-417b-89b5-794d238cc6ee None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:57.872590 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d59192-31a1-4b0f-b85a-801389bbb624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:57.873242 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d59192-31a1-4b0f-b85a-801389bbb624 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:57.873564 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d59192-31a1-4b0f-b85a-801389bbb624 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:57.873846 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d59192-31a1-4b0f-b85a-801389bbb624 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:57.874661 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d59192-31a1-4b0f-b85a-801389bbb624 None admin] RBAC: Adding query filter params (role.id=cb894452030c4656aaa8ad80b903bef6, scope.project.id=ec1f2c5cb900473da1083830387e3ff4, user.id=a706b6d0163549bc80285c4158331b94) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:57.874975 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d59192-31a1-4b0f-b85a-801389bbb624 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:57.876396 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d59192-31a1-4b0f-b85a-801389bbb624 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:57.882418 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 499/989] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:02:57 2022] GET /identity/v3/role_assignments?user.id=a706b6d0163549bc80285c4158331b94&scope.project.id=ec1f2c5cb900473da1083830387e3ff4&role.id=cb894452030c4656aaa8ad80b903bef6 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:58.692766 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc7592-b536-45af-bc37-19754a0a573b None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:58.693513 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc7592-b536-45af-bc37-19754a0a573b None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:58.693649 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc7592-b536-45af-bc37-19754a0a573b None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:58.696031 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 491/990] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:02:58.701577 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9d6f4-b46b-445e-a618-5be47832d5fe None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:58.702052 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9d6f4-b46b-445e-a618-5be47832d5fe None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:58.702130 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9d6f4-b46b-445e-a618-5be47832d5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:58.720773 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-20f9d6f4-b46b-445e-a618-5be47832d5fe None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:58.722496 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-20f9d6f4-b46b-445e-a618-5be47832d5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:58.786678 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 500/991] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:58 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:02:58.810030 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc7592-b536-45af-bc37-19754a0a573b None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:58.854080 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b82e0b-610f-4b35-9aa3-2d90619a91ee None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:58.854389 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b82e0b-610f-4b35-9aa3-2d90619a91ee None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:58.854648 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b82e0b-610f-4b35-9aa3-2d90619a91ee None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:58.860125 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 501/992] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:02:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:02:58.861350 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92aed01-fa96-4526-b784-1311cfefe271 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:58.861642 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92aed01-fa96-4526-b784-1311cfefe271 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:58.861929 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92aed01-fa96-4526-b784-1311cfefe271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:58.879226 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-a92aed01-fa96-4526-b784-1311cfefe271 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:02:58.880399 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a92aed01-fa96-4526-b784-1311cfefe271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:02:58.911884 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc7592-b536-45af-bc37-19754a0a573b None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:58.950093 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 502/993] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:02:58 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:02:58.956427 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19da8b-17a7-4ee6-8d77-8553e17e3d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:58.957245 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19da8b-17a7-4ee6-8d77-8553e17e3d3e None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:58.957560 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19da8b-17a7-4ee6-8d77-8553e17e3d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:58.957936 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19da8b-17a7-4ee6-8d77-8553e17e3d3e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:58.958597 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19da8b-17a7-4ee6-8d77-8553e17e3d3e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:58.960195 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19da8b-17a7-4ee6-8d77-8553e17e3d3e None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:58.971906 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92aed01-fa96-4526-b784-1311cfefe271 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:58.972068 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-ed19da8b-17a7-4ee6-8d77-8553e17e3d3e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 29 20:02:58.978543 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 492/994] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Mar 29 20:02:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:02:58.979729 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19da8b-17a7-4ee6-8d77-8553e17e3d3e None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:59.073733 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92aed01-fa96-4526-b784-1311cfefe271 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:59.086980 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19da8b-17a7-4ee6-8d77-8553e17e3d3e None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:59.107064 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb960d-7abe-4028-8874-36c296006390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:59.107863 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb960d-7abe-4028-8874-36c296006390 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:59.108156 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb960d-7abe-4028-8874-36c296006390 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:59.108441 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb960d-7abe-4028-8874-36c296006390 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:59.109084 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb960d-7abe-4028-8874-36c296006390 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:59.110493 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb960d-7abe-4028-8874-36c296006390 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:59.119602 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89974e99-9b7e-4ef2-9fff-c13d6f41d535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:59.120265 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89974e99-9b7e-4ef2-9fff-c13d6f41d535 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:59.120563 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89974e99-9b7e-4ef2-9fff-c13d6f41d535 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:59.120830 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89974e99-9b7e-4ef2-9fff-c13d6f41d535 None admin] PATH_INFO: `/v3/services` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:59.121541 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-21fb960d-7abe-4028-8874-36c296006390 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 29 20:02:59.121641 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89974e99-9b7e-4ef2-9fff-c13d6f41d535 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:59.121866 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89974e99-9b7e-4ef2-9fff-c13d6f41d535 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:59.122928 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 503/995] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:02:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:02:59.123213 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89974e99-9b7e-4ef2-9fff-c13d6f41d535 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:59.133672 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb960d-7abe-4028-8874-36c296006390 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:59.133850 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 493/996] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Mar 29 20:02:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:02:59.135214 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89974e99-9b7e-4ef2-9fff-c13d6f41d535 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:59.229508 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb960d-7abe-4028-8874-36c296006390 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:59.234934 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89974e99-9b7e-4ef2-9fff-c13d6f41d535 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:59.261969 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e63df5-c76c-4e90-a5ef-d6ebbd20d1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:59.262716 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e63df5-c76c-4e90-a5ef-d6ebbd20d1cf None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:59.263075 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e63df5-c76c-4e90-a5ef-d6ebbd20d1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:59.263452 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e63df5-c76c-4e90-a5ef-d6ebbd20d1cf None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:59.264227 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e63df5-c76c-4e90-a5ef-d6ebbd20d1cf None admin] RBAC: Adding query filter params (name=compute) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:59.264545 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e63df5-c76c-4e90-a5ef-d6ebbd20d1cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:59.265959 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e63df5-c76c-4e90-a5ef-d6ebbd20d1cf None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:59.270169 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7cdc0-f2f2-4964-9e03-627638824574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:59.270842 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 504/997] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Mar 29 20:02:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:59.270948 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7cdc0-f2f2-4964-9e03-627638824574 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:59.271120 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7cdc0-f2f2-4964-9e03-627638824574 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:59.271491 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7cdc0-f2f2-4964-9e03-627638824574 None admin] PATH_INFO: `/v3/services` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:59.272198 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7cdc0-f2f2-4964-9e03-627638824574 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:59.272509 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7cdc0-f2f2-4964-9e03-627638824574 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:59.273925 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7cdc0-f2f2-4964-9e03-627638824574 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:59.276212 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e63df5-c76c-4e90-a5ef-d6ebbd20d1cf None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:59.283828 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 494/998] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Mar 29 20:02:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:59.284645 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7cdc0-f2f2-4964-9e03-627638824574 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:59.383465 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e63df5-c76c-4e90-a5ef-d6ebbd20d1cf None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:59.390011 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7cdc0-f2f2-4964-9e03-627638824574 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:59.419069 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85da067-a78f-4e39-a3f2-2035b3536248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:59.419824 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85da067-a78f-4e39-a3f2-2035b3536248 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:59.420002 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85da067-a78f-4e39-a3f2-2035b3536248 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:59.420274 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85da067-a78f-4e39-a3f2-2035b3536248 None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:59.420969 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85da067-a78f-4e39-a3f2-2035b3536248 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:59.421277 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85da067-a78f-4e39-a3f2-2035b3536248 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:59.422950 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85da067-a78f-4e39-a3f2-2035b3536248 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:59.425274 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94181be9-b5fc-4810-9f38-b0a302fbcf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:59.425955 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94181be9-b5fc-4810-9f38-b0a302fbcf9a None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:59.426241 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94181be9-b5fc-4810-9f38-b0a302fbcf9a None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:59.426516 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94181be9-b5fc-4810-9f38-b0a302fbcf9a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:59.427250 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94181be9-b5fc-4810-9f38-b0a302fbcf9a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:59.427847 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 505/999] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Mar 29 20:02:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:59.428786 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94181be9-b5fc-4810-9f38-b0a302fbcf9a None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:59.433218 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85da067-a78f-4e39-a3f2-2035b3536248 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:59.513327 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 495/1000] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Mar 29 20:02:59 2022] POST /identity/v3/endpoints => generated 325 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:02:59.533347 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85da067-a78f-4e39-a3f2-2035b3536248 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:59.576845 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fb1b9-af47-4e91-8066-f70d2e70f72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:59.577548 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fb1b9-af47-4e91-8066-f70d2e70f72e None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:59.577837 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fb1b9-af47-4e91-8066-f70d2e70f72e None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:59.578118 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fb1b9-af47-4e91-8066-f70d2e70f72e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:59.578913 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1fb1b9-af47-4e91-8066-f70d2e70f72e None admin] RBAC: Adding query filter params (interface=public, service_id=fba8216e16a443b79db498536ae8aaa8, region_id=RegionOne) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:02:59.579231 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1fb1b9-af47-4e91-8066-f70d2e70f72e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:59.580660 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1fb1b9-af47-4e91-8066-f70d2e70f72e None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:59.591454 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 506/1001] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Mar 29 20:02:59 2022] GET /identity/v3/endpoints?service_id=fba8216e16a443b79db498536ae8aaa8&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:02:59.592847 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94181be9-b5fc-4810-9f38-b0a302fbcf9a None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:02:59.698048 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94181be9-b5fc-4810-9f38-b0a302fbcf9a None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:02:59.733264 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b24c5-12ac-4780-9c93-4229156abbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:02:59.733993 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b24c5-12ac-4780-9c93-4229156abbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:02:59.734288 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b24c5-12ac-4780-9c93-4229156abbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:02:59.734557 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b24c5-12ac-4780-9c93-4229156abbe1 None admin] PATH_INFO: `/v3/services` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:02:59.735240 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b24c5-12ac-4780-9c93-4229156abbe1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:02:59.736598 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b24c5-12ac-4780-9c93-4229156abbe1 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:02:59.742904 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 496/1002] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Mar 29 20:02:59 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:03:00.252206 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777a0bd-5ca3-42a5-aae2-1a38f4a6c053 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:00.252767 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777a0bd-5ca3-42a5-aae2-1a38f4a6c053 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:00.252767 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777a0bd-5ca3-42a5-aae2-1a38f4a6c053 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:00.254730 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 507/1003] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:03:00.260371 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e212d0-cf77-4e5b-a8bc-95ac7fec197d None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:00.260673 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e212d0-cf77-4e5b-a8bc-95ac7fec197d None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:00.260956 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e212d0-cf77-4e5b-a8bc-95ac7fec197d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:00.278399 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-37e212d0-cf77-4e5b-a8bc-95ac7fec197d None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:00.279583 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-37e212d0-cf77-4e5b-a8bc-95ac7fec197d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:00.345340 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 497/1004] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:00 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:03:00.370104 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777a0bd-5ca3-42a5-aae2-1a38f4a6c053 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:00.473109 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777a0bd-5ca3-42a5-aae2-1a38f4a6c053 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:00.507306 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7205ba6-08ac-40f6-b5b3-3753d9b8a4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:00.508030 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7205ba6-08ac-40f6-b5b3-3753d9b8a4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:00.508311 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7205ba6-08ac-40f6-b5b3-3753d9b8a4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:00.508588 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7205ba6-08ac-40f6-b5b3-3753d9b8a4b1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:00.509231 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7205ba6-08ac-40f6-b5b3-3753d9b8a4b1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:00.510615 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7205ba6-08ac-40f6-b5b3-3753d9b8a4b1 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:00.521267 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-b7205ba6-08ac-40f6-b5b3-3753d9b8a4b1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 29 20:03:00.523143 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 508/1005] 10.222.0.43 () {56 vars in 1105 bytes} [Tue Mar 29 20:03:00 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:03:00.528836 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e212d0-cf77-4e5b-a8bc-95ac7fec197d None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:00.628506 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e212d0-cf77-4e5b-a8bc-95ac7fec197d None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:00.660949 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda2f56-7fd3-4d92-941f-1866c2ab1966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:00.661631 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda2f56-7fd3-4d92-941f-1866c2ab1966 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:00.662453 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda2f56-7fd3-4d92-941f-1866c2ab1966 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:00.663344 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda2f56-7fd3-4d92-941f-1866c2ab1966 None admin] PATH_INFO: `/v3/services` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:00.664050 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda2f56-7fd3-4d92-941f-1866c2ab1966 None admin] RBAC: Adding query filter params (name=image) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:00.664359 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda2f56-7fd3-4d92-941f-1866c2ab1966 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:00.665731 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda2f56-7fd3-4d92-941f-1866c2ab1966 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:00.674916 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 498/1006] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:03:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:00.676005 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7205ba6-08ac-40f6-b5b3-3753d9b8a4b1 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:00.775928 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7205ba6-08ac-40f6-b5b3-3753d9b8a4b1 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:00.808615 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4336f66-e950-4408-b3c0-6082d9fd86c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:00.809283 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4336f66-e950-4408-b3c0-6082d9fd86c8 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:00.809595 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4336f66-e950-4408-b3c0-6082d9fd86c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:00.809874 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4336f66-e950-4408-b3c0-6082d9fd86c8 None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:00.810575 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4336f66-e950-4408-b3c0-6082d9fd86c8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:00.810885 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4336f66-e950-4408-b3c0-6082d9fd86c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:00.812247 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4336f66-e950-4408-b3c0-6082d9fd86c8 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:00.816724 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 509/1007] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:03:00 2022] GET /identity/v3/services?type=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:03:01.870763 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd841a-e3ef-4593-8583-b0ef518491c4 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:01.871286 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd841a-e3ef-4593-8583-b0ef518491c4 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:01.871364 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd841a-e3ef-4593-8583-b0ef518491c4 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:01.873282 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 499/1008] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:03:01.878208 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee3b84-0e89-46ca-9581-104ed0190927 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:01.878610 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee3b84-0e89-46ca-9581-104ed0190927 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:01.878779 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee3b84-0e89-46ca-9581-104ed0190927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:01.895279 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-f0ee3b84-0e89-46ca-9581-104ed0190927 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:01.897740 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-f0ee3b84-0e89-46ca-9581-104ed0190927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:01.968889 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 510/1009] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:01 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:03:01.993227 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd841a-e3ef-4593-8583-b0ef518491c4 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:02.090638 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e359730-3641-4dec-bd61-42f81e7f0a30 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:02.090936 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e359730-3641-4dec-bd61-42f81e7f0a30 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:02.091224 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e359730-3641-4dec-bd61-42f81e7f0a30 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:02.093011 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 511/1010] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:03:02.097744 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d7d03-7411-4a06-8c3d-cf084a0ac54a None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:02.098036 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d7d03-7411-4a06-8c3d-cf084a0ac54a None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:02.098325 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d7d03-7411-4a06-8c3d-cf084a0ac54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:02.116296 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd841a-e3ef-4593-8583-b0ef518491c4 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:02.116498 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-920d7d03-7411-4a06-8c3d-cf084a0ac54a None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:02.117513 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-920d7d03-7411-4a06-8c3d-cf084a0ac54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:02.156177 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28d744-7005-4949-ad80-e8faf3fd804a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:02.156882 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28d744-7005-4949-ad80-e8faf3fd804a None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:02.157161 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28d744-7005-4949-ad80-e8faf3fd804a None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:02.157464 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28d744-7005-4949-ad80-e8faf3fd804a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:02.158611 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28d744-7005-4949-ad80-e8faf3fd804a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:02.160136 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28d744-7005-4949-ad80-e8faf3fd804a None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:02.162460 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 500/1011] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:03:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:02.168318 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28d744-7005-4949-ad80-e8faf3fd804a None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:02.182707 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 512/1012] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:02 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 20:03:02.205857 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d7d03-7411-4a06-8c3d-cf084a0ac54a None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:02.264520 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28d744-7005-4949-ad80-e8faf3fd804a None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:02.297826 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a52be1-904c-48ce-a341-9775dffe676f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:02.298483 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a52be1-904c-48ce-a341-9775dffe676f None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:02.298885 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a52be1-904c-48ce-a341-9775dffe676f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:02.299165 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a52be1-904c-48ce-a341-9775dffe676f None admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:02.299867 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a52be1-904c-48ce-a341-9775dffe676f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:02.301269 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a52be1-904c-48ce-a341-9775dffe676f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:02.303273 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d7d03-7411-4a06-8c3d-cf084a0ac54a None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:02.338501 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54681e7c-9cee-45cd-8ca1-4704db8ed141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:02.339318 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54681e7c-9cee-45cd-8ca1-4704db8ed141 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:02.339595 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54681e7c-9cee-45cd-8ca1-4704db8ed141 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:02.339902 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54681e7c-9cee-45cd-8ca1-4704db8ed141 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:02.340545 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54681e7c-9cee-45cd-8ca1-4704db8ed141 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:02.341920 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54681e7c-9cee-45cd-8ca1-4704db8ed141 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:02.352670 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-54681e7c-9cee-45cd-8ca1-4704db8ed141 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 29 20:03:02.353860 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 513/1013] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:03:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:03:02.359824 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54681e7c-9cee-45cd-8ca1-4704db8ed141 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:02.423602 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 501/1014] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Mar 29 20:03:02 2022] POST /identity/v3/projects => generated 311 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:03:02.473217 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54681e7c-9cee-45cd-8ca1-4704db8ed141 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:02.511439 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa2e67-d2d3-4d19-b208-01c76b4af884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:02.512481 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa2e67-d2d3-4d19-b208-01c76b4af884 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:02.512972 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa2e67-d2d3-4d19-b208-01c76b4af884 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:02.513484 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa2e67-d2d3-4d19-b208-01c76b4af884 None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:02.514385 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa2e67-d2d3-4d19-b208-01c76b4af884 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:02.514914 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa2e67-d2d3-4d19-b208-01c76b4af884 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:02.516501 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa2e67-d2d3-4d19-b208-01c76b4af884 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:02.522549 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 514/1015] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Mar 29 20:03:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:03:02.528040 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a52be1-904c-48ce-a341-9775dffe676f None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:02.632871 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a52be1-904c-48ce-a341-9775dffe676f None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:02.681479 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec095ca2-97bd-4b8e-a1fe-1c442241567c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:02.682090 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec095ca2-97bd-4b8e-a1fe-1c442241567c None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:02.682378 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec095ca2-97bd-4b8e-a1fe-1c442241567c None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:02.682659 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec095ca2-97bd-4b8e-a1fe-1c442241567c None admin] PATH_INFO: `/v3/services` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:02.683387 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec095ca2-97bd-4b8e-a1fe-1c442241567c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:02.683702 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec095ca2-97bd-4b8e-a1fe-1c442241567c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:02.685072 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec095ca2-97bd-4b8e-a1fe-1c442241567c None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:02.690631 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 502/1016] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Mar 29 20:03:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:02.697234 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa2e67-d2d3-4d19-b208-01c76b4af884 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:02.797894 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa2e67-d2d3-4d19-b208-01c76b4af884 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:02.830807 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5447d14-073e-452c-9336-701ef58e93d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:02.831464 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5447d14-073e-452c-9336-701ef58e93d0 None admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:02.831749 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5447d14-073e-452c-9336-701ef58e93d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:02.832028 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5447d14-073e-452c-9336-701ef58e93d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:02.832773 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5447d14-073e-452c-9336-701ef58e93d0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:02.834210 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5447d14-073e-452c-9336-701ef58e93d0 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:02.910430 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 515/1017] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Mar 29 20:03:02 2022] POST /identity/v3/endpoints => generated 334 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:03:03.113003 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a084c3-00c9-4e7d-a6fc-6652c28c5819 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:03.113534 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a084c3-00c9-4e7d-a6fc-6652c28c5819 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:03.113611 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a084c3-00c9-4e7d-a6fc-6652c28c5819 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:03.116249 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 503/1018] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:03:03.121329 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c7b5c-8729-4ee1-9289-60acfcb846e1 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:03.121634 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c7b5c-8729-4ee1-9289-60acfcb846e1 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:03.121918 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c7b5c-8729-4ee1-9289-60acfcb846e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:03.139833 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-fa0c7b5c-8729-4ee1-9289-60acfcb846e1 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:03.141389 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-fa0c7b5c-8729-4ee1-9289-60acfcb846e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:03.216062 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 516/1019] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:03 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:03:03.239074 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a084c3-00c9-4e7d-a6fc-6652c28c5819 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:03.339059 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a084c3-00c9-4e7d-a6fc-6652c28c5819 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:03.372195 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b9808-ad9c-4c87-af5d-9a939899e051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:03.372860 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b9808-ad9c-4c87-af5d-9a939899e051 None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:03.373147 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b9808-ad9c-4c87-af5d-9a939899e051 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:03.373468 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b9808-ad9c-4c87-af5d-9a939899e051 None admin] PATH_INFO: `/v3/services` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:03.374204 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b9808-ad9c-4c87-af5d-9a939899e051 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:03.375575 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b9808-ad9c-4c87-af5d-9a939899e051 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:03.487684 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 504/1020] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Mar 29 20:03:03 2022] POST /identity/v3/services => generated 242 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:03:04.784925 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc37c0-cf49-4b5e-83cb-fc493b0e3650 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:04.785527 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc37c0-cf49-4b5e-83cb-fc493b0e3650 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:04.785527 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc37c0-cf49-4b5e-83cb-fc493b0e3650 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:04.788362 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 517/1021] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:03:04.793312 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebeb35-f27f-4621-bf76-64872d974e4b None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:04.793711 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebeb35-f27f-4621-bf76-64872d974e4b None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:04.793892 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebeb35-f27f-4621-bf76-64872d974e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:04.810812 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-53ebeb35-f27f-4621-bf76-64872d974e4b None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:04.811982 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-53ebeb35-f27f-4621-bf76-64872d974e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:04.885673 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 505/1022] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:04 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:03:04.910096 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc37c0-cf49-4b5e-83cb-fc493b0e3650 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:05.017700 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc37c0-cf49-4b5e-83cb-fc493b0e3650 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:05.051680 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42401c2-e1b8-44ee-9af3-9ae1fd00ec56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:05.052509 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42401c2-e1b8-44ee-9af3-9ae1fd00ec56 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:05.052770 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42401c2-e1b8-44ee-9af3-9ae1fd00ec56 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:05.053047 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42401c2-e1b8-44ee-9af3-9ae1fd00ec56 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:05.054253 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42401c2-e1b8-44ee-9af3-9ae1fd00ec56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:05.055693 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42401c2-e1b8-44ee-9af3-9ae1fd00ec56 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:05.058416 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 518/1023] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:03:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:05.062926 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebeb35-f27f-4621-bf76-64872d974e4b None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:05.159306 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebeb35-f27f-4621-bf76-64872d974e4b None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:05.192895 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64e44f-d2e0-447f-8cc4-b9c803a9f2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:05.193916 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64e44f-d2e0-447f-8cc4-b9c803a9f2e6 None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:05.194384 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64e44f-d2e0-447f-8cc4-b9c803a9f2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:05.194840 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64e44f-d2e0-447f-8cc4-b9c803a9f2e6 None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:05.195745 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64e44f-d2e0-447f-8cc4-b9c803a9f2e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:05.197627 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64e44f-d2e0-447f-8cc4-b9c803a9f2e6 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:05.289049 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c2e74-913b-4417-a32c-04d8c475a587 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:05.289364 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c2e74-913b-4417-a32c-04d8c475a587 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:05.289651 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c2e74-913b-4417-a32c-04d8c475a587 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:05.291455 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 519/1024] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:03:05.296290 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c692c3-231c-4a92-b65f-8f9d9bcb29e1 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:05.296581 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c692c3-231c-4a92-b65f-8f9d9bcb29e1 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:05.296856 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c692c3-231c-4a92-b65f-8f9d9bcb29e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:05.315581 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 506/1025] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Mar 29 20:03:05 2022] POST /identity/v3/users => generated 285 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:03:05.315794 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-e7c692c3-231c-4a92-b65f-8f9d9bcb29e1 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:05.315794 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e7c692c3-231c-4a92-b65f-8f9d9bcb29e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:05.393051 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 520/1026] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 20:03:05.418991 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64e44f-d2e0-447f-8cc4-b9c803a9f2e6 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:05.528059 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64e44f-d2e0-447f-8cc4-b9c803a9f2e6 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:05.562706 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eae46e-0679-4fd3-80d6-982af8b3eb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:05.563529 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eae46e-0679-4fd3-80d6-982af8b3eb39 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:05.563816 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eae46e-0679-4fd3-80d6-982af8b3eb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:05.564094 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eae46e-0679-4fd3-80d6-982af8b3eb39 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:05.574598 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eae46e-0679-4fd3-80d6-982af8b3eb39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:03:05.581983 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-98eae46e-0679-4fd3-80d6-982af8b3eb39 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 29 20:03:05.584061 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 507/1027] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Mar 29 20:03:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:03:05.590001 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c692c3-231c-4a92-b65f-8f9d9bcb29e1 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:05.685305 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c692c3-231c-4a92-b65f-8f9d9bcb29e1 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:05.720535 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd6cb4-8167-4428-ac18-3766dd7d291c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:05.721215 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd6cb4-8167-4428-ac18-3766dd7d291c None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:05.721537 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd6cb4-8167-4428-ac18-3766dd7d291c None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:05.721819 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd6cb4-8167-4428-ac18-3766dd7d291c None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:05.722563 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd6cb4-8167-4428-ac18-3766dd7d291c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:05.722870 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd6cb4-8167-4428-ac18-3766dd7d291c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:05.724960 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd6cb4-8167-4428-ac18-3766dd7d291c None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:05.733329 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 521/1028] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Mar 29 20:03:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:05.738697 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eae46e-0679-4fd3-80d6-982af8b3eb39 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:05.844555 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eae46e-0679-4fd3-80d6-982af8b3eb39 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:05.872715 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622402f7-c4ae-495d-a0ff-8f2c7a8361a4 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:05.873242 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622402f7-c4ae-495d-a0ff-8f2c7a8361a4 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:05.873360 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622402f7-c4ae-495d-a0ff-8f2c7a8361a4 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:05.875261 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 522/1029] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:03:05.877648 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2fb4e-bcb6-4c3f-88ce-8ee969cb0e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:05.878438 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2fb4e-bcb6-4c3f-88ce-8ee969cb0e99 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:05.878731 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2fb4e-bcb6-4c3f-88ce-8ee969cb0e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:05.879011 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2fb4e-bcb6-4c3f-88ce-8ee969cb0e99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:05.880820 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3b62c-1bb3-4cda-8a12-1b97951557b9 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:05.881388 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3b62c-1bb3-4cda-8a12-1b97951557b9 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:05.881927 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3b62c-1bb3-4cda-8a12-1b97951557b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:05.890103 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2fb4e-bcb6-4c3f-88ce-8ee969cb0e99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:05.891550 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2fb4e-bcb6-4c3f-88ce-8ee969cb0e99 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:05.900176 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-6cd3b62c-1bb3-4cda-8a12-1b97951557b9 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:05.902252 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-6cd3b62c-1bb3-4cda-8a12-1b97951557b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:05.908693 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-e1e2fb4e-bcb6-4c3f-88ce-8ee969cb0e99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:03:05.910047 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 508/1030] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:03:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:03:05.915870 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2fb4e-bcb6-4c3f-88ce-8ee969cb0e99 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:05.972965 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 523/1031] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:03:05.997737 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3b62c-1bb3-4cda-8a12-1b97951557b9 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:06.015030 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2fb4e-bcb6-4c3f-88ce-8ee969cb0e99 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:06.047672 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e56c26-8238-4e48-b9b7-a034cb40c132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:06.048335 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e56c26-8238-4e48-b9b7-a034cb40c132 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:06.048616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e56c26-8238-4e48-b9b7-a034cb40c132 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:06.048893 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e56c26-8238-4e48-b9b7-a034cb40c132 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:06.049639 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e56c26-8238-4e48-b9b7-a034cb40c132 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:06.049958 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e56c26-8238-4e48-b9b7-a034cb40c132 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:06.051293 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e56c26-8238-4e48-b9b7-a034cb40c132 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:06.064246 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 509/1032] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:03:06.070051 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e56c26-8238-4e48-b9b7-a034cb40c132 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:06.099826 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3b62c-1bb3-4cda-8a12-1b97951557b9 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:06.135983 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ee502-d8ba-4156-a8b3-e34b28a563bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:06.136777 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ee502-d8ba-4156-a8b3-e34b28a563bc None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:06.137064 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ee502-d8ba-4156-a8b3-e34b28a563bc None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:06.137368 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ee502-d8ba-4156-a8b3-e34b28a563bc None admin] PATH_INFO: `/v3/services/image` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:06.138017 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ee502-d8ba-4156-a8b3-e34b28a563bc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:06.139404 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ee502-d8ba-4156-a8b3-e34b28a563bc None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:06.150680 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-7f7ee502-d8ba-4156-a8b3-e34b28a563bc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 29 20:03:06.152033 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 524/1033] 10.222.0.43 () {56 vars in 1105 bytes} [Tue Mar 29 20:03:05 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:03:06.157553 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ee502-d8ba-4156-a8b3-e34b28a563bc None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:06.181999 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e56c26-8238-4e48-b9b7-a034cb40c132 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:06.217771 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86362f3-7b5d-4f60-a2be-d855e93a98c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:06.218570 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86362f3-7b5d-4f60-a2be-d855e93a98c8 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:06.218859 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86362f3-7b5d-4f60-a2be-d855e93a98c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:06.219138 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86362f3-7b5d-4f60-a2be-d855e93a98c8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:06.226891 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86362f3-7b5d-4f60-a2be-d855e93a98c8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:06.228340 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86362f3-7b5d-4f60-a2be-d855e93a98c8 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:06.242473 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-d86362f3-7b5d-4f60-a2be-d855e93a98c8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 29 20:03:06.243877 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 510/1034] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Mar 29 20:03:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:03:06.249152 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86362f3-7b5d-4f60-a2be-d855e93a98c8 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:06.258401 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ee502-d8ba-4156-a8b3-e34b28a563bc None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:06.298457 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9bdce-24b4-4d64-84e1-bdee2433fac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:06.299483 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9bdce-24b4-4d64-84e1-bdee2433fac0 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:06.299978 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9bdce-24b4-4d64-84e1-bdee2433fac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:06.300900 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9bdce-24b4-4d64-84e1-bdee2433fac0 None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:06.302289 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9bdce-24b4-4d64-84e1-bdee2433fac0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:06.302825 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9bdce-24b4-4d64-84e1-bdee2433fac0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:06.305102 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9bdce-24b4-4d64-84e1-bdee2433fac0 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:06.311846 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 525/1035] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:03:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:03:06.317842 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9bdce-24b4-4d64-84e1-bdee2433fac0 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:06.346120 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86362f3-7b5d-4f60-a2be-d855e93a98c8 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:06.384476 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfaedb2-c397-4aa5-a4f7-3ab72011d250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:06.385400 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfaedb2-c397-4aa5-a4f7-3ab72011d250 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:06.385947 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfaedb2-c397-4aa5-a4f7-3ab72011d250 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:06.386228 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfaedb2-c397-4aa5-a4f7-3ab72011d250 None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:06.387072 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfaedb2-c397-4aa5-a4f7-3ab72011d250 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:06.387383 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfaedb2-c397-4aa5-a4f7-3ab72011d250 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:06.389459 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfaedb2-c397-4aa5-a4f7-3ab72011d250 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:06.407669 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 511/1036] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Mar 29 20:03:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:03:06.413637 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfaedb2-c397-4aa5-a4f7-3ab72011d250 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:06.423999 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9bdce-24b4-4d64-84e1-bdee2433fac0 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:06.457806 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f149f-66c7-4553-81de-58c8198dbd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:06.459033 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f149f-66c7-4553-81de-58c8198dbd68 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:06.459317 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f149f-66c7-4553-81de-58c8198dbd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:06.459595 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f149f-66c7-4553-81de-58c8198dbd68 None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:06.460295 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f149f-66c7-4553-81de-58c8198dbd68 None admin] RBAC: Adding query filter params (type=image) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:06.460602 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f149f-66c7-4553-81de-58c8198dbd68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:06.461995 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f149f-66c7-4553-81de-58c8198dbd68 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:06.466966 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 526/1037] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:03:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:06.472426 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f149f-66c7-4553-81de-58c8198dbd68 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:06.512104 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfaedb2-c397-4aa5-a4f7-3ab72011d250 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:06.546867 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270d02d-ebaf-464a-838e-c307a268b4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:06.547528 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270d02d-ebaf-464a-838e-c307a268b4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:06.547817 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270d02d-ebaf-464a-838e-c307a268b4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:06.548101 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270d02d-ebaf-464a-838e-c307a268b4d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:06.575154 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f149f-66c7-4553-81de-58c8198dbd68 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:06.608044 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8bc63-b6d4-4ac9-a763-3fbea3e0d1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:06.608706 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8bc63-b6d4-4ac9-a763-3fbea3e0d1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:06.609001 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8bc63-b6d4-4ac9-a763-3fbea3e0d1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:06.609285 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8bc63-b6d4-4ac9-a763-3fbea3e0d1a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:06.610089 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8bc63-b6d4-4ac9-a763-3fbea3e0d1a0 None admin] RBAC: Adding query filter params (interface=public, service_id=e4a787d02eef4f2e8f704a01669bc8da, region_id=RegionOne) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:06.610409 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8bc63-b6d4-4ac9-a763-3fbea3e0d1a0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:06.611782 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8bc63-b6d4-4ac9-a763-3fbea3e0d1a0 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:06.615231 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270d02d-ebaf-464a-838e-c307a268b4d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:06.616660 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270d02d-ebaf-464a-838e-c307a268b4d9 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:06.621425 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 527/1038] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Mar 29 20:03:06 2022] GET /identity/v3/endpoints?service_id=e4a787d02eef4f2e8f704a01669bc8da&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:03:06.622414 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8bc63-b6d4-4ac9-a763-3fbea3e0d1a0 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:06.723093 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 512/1039] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:03:06 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 29 20:03:06.723273 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8bc63-b6d4-4ac9-a763-3fbea3e0d1a0 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:06.725446 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270d02d-ebaf-464a-838e-c307a268b4d9 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:06.753161 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f13220-f900-4ed8-997a-4895c79592e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:06.753871 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f13220-f900-4ed8-997a-4895c79592e1 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:06.754158 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f13220-f900-4ed8-997a-4895c79592e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:06.754701 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f13220-f900-4ed8-997a-4895c79592e1 None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:06.755138 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f13220-f900-4ed8-997a-4895c79592e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:06.756550 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f13220-f900-4ed8-997a-4895c79592e1 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:06.766126 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 528/1040] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Mar 29 20:03:06 2022] GET /identity/v3/services => generated 1957 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:03:06.838788 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270d02d-ebaf-464a-838e-c307a268b4d9 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:06.874599 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9c4a4-1567-474b-9961-510ff4d9be6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:06.875289 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9c4a4-1567-474b-9961-510ff4d9be6b None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:06.875542 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9c4a4-1567-474b-9961-510ff4d9be6b None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:06.875803 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9c4a4-1567-474b-9961-510ff4d9be6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:06.887356 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9c4a4-1567-474b-9961-510ff4d9be6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:06.888837 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9c4a4-1567-474b-9961-510ff4d9be6b None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:06.907829 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-27d9c4a4-1567-474b-9961-510ff4d9be6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:03:06.909335 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 513/1041] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:03:06.914906 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f13220-f900-4ed8-997a-4895c79592e1 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:07.019054 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f13220-f900-4ed8-997a-4895c79592e1 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:07.052264 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1610bf-40be-4d76-8b59-e06e57f23731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:07.052935 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1610bf-40be-4d76-8b59-e06e57f23731 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:07.053222 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1610bf-40be-4d76-8b59-e06e57f23731 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:07.053576 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1610bf-40be-4d76-8b59-e06e57f23731 None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:07.054339 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1610bf-40be-4d76-8b59-e06e57f23731 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:07.054652 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1610bf-40be-4d76-8b59-e06e57f23731 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:07.056022 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1610bf-40be-4d76-8b59-e06e57f23731 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:07.068048 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 529/1042] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:07.073873 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9c4a4-1567-474b-9961-510ff4d9be6b None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:07.172496 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9c4a4-1567-474b-9961-510ff4d9be6b None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:07.207019 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bd339-0944-4542-9bbe-d069cb0c1e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:07.207815 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bd339-0944-4542-9bbe-d069cb0c1e91 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:07.208095 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bd339-0944-4542-9bbe-d069cb0c1e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:07.208974 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bd339-0944-4542-9bbe-d069cb0c1e91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:07.215682 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bd339-0944-4542-9bbe-d069cb0c1e91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:07.217106 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bd339-0944-4542-9bbe-d069cb0c1e91 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:07.229904 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-9a7bd339-0944-4542-9bbe-d069cb0c1e91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:03:07.231236 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 514/1043] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:03:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:03:07.236900 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1610bf-40be-4d76-8b59-e06e57f23731 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:07.331639 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1610bf-40be-4d76-8b59-e06e57f23731 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:07.366326 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93260aa5-c879-494d-b34a-f523c5d8ca7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:07.367011 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93260aa5-c879-494d-b34a-f523c5d8ca7d None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:07.367292 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93260aa5-c879-494d-b34a-f523c5d8ca7d None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:07.367565 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93260aa5-c879-494d-b34a-f523c5d8ca7d None admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:07.368358 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93260aa5-c879-494d-b34a-f523c5d8ca7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:07.368669 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93260aa5-c879-494d-b34a-f523c5d8ca7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:07.370164 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93260aa5-c879-494d-b34a-f523c5d8ca7d None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:07.388283 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 530/1044] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:03:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:07.389619 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bd339-0944-4542-9bbe-d069cb0c1e91 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:07.487000 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bd339-0944-4542-9bbe-d069cb0c1e91 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:07.519961 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07890617-a14f-4c9a-8fa7-7d02e3e1175f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:07.520617 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07890617-a14f-4c9a-8fa7-7d02e3e1175f None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:07.520978 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07890617-a14f-4c9a-8fa7-7d02e3e1175f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:07.521311 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07890617-a14f-4c9a-8fa7-7d02e3e1175f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:07.522142 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07890617-a14f-4c9a-8fa7-7d02e3e1175f None admin] RBAC: Adding query filter params (role.id=cb894452030c4656aaa8ad80b903bef6, scope.project.id=ec1f2c5cb900473da1083830387e3ff4, user.id=b797e15939694c9abf1f2b8e9aee4d67) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:07.522521 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07890617-a14f-4c9a-8fa7-7d02e3e1175f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:07.523949 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07890617-a14f-4c9a-8fa7-7d02e3e1175f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:07.530358 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 515/1045] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:03:07 2022] GET /identity/v3/role_assignments?user.id=b797e15939694c9abf1f2b8e9aee4d67&scope.project.id=ec1f2c5cb900473da1083830387e3ff4&role.id=cb894452030c4656aaa8ad80b903bef6 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:07.731849 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272008dd-96f9-4334-bbeb-ab0f89745e3a None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:07.732145 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272008dd-96f9-4334-bbeb-ab0f89745e3a None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:07.732335 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272008dd-96f9-4334-bbeb-ab0f89745e3a None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:07.734381 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 531/1046] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:03:07.739352 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456cb95-6c19-4b82-91bf-81b01558b2c4 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:07.739809 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456cb95-6c19-4b82-91bf-81b01558b2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:07.740861 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456cb95-6c19-4b82-91bf-81b01558b2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:07.757703 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-8456cb95-6c19-4b82-91bf-81b01558b2c4 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:07.758899 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-8456cb95-6c19-4b82-91bf-81b01558b2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:07.826753 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 516/1047] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 20:03:07.850611 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272008dd-96f9-4334-bbeb-ab0f89745e3a None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:07.954617 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272008dd-96f9-4334-bbeb-ab0f89745e3a None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:07.988177 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b777452-6594-43b4-9ba1-2b2cc10e37d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:07.988961 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b777452-6594-43b4-9ba1-2b2cc10e37d3 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:07.989246 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b777452-6594-43b4-9ba1-2b2cc10e37d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:07.990229 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b777452-6594-43b4-9ba1-2b2cc10e37d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:08.000686 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b777452-6594-43b4-9ba1-2b2cc10e37d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:03:08.007788 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-4b777452-6594-43b4-9ba1-2b2cc10e37d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:03:08.009129 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 532/1048] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:03:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:03:08.014881 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456cb95-6c19-4b82-91bf-81b01558b2c4 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:08.109308 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456cb95-6c19-4b82-91bf-81b01558b2c4 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:08.141089 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daae398-263f-4847-b01b-58e8fbeca78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:08.141777 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daae398-263f-4847-b01b-58e8fbeca78a None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:08.142063 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daae398-263f-4847-b01b-58e8fbeca78a None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:08.142342 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daae398-263f-4847-b01b-58e8fbeca78a None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:08.143082 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daae398-263f-4847-b01b-58e8fbeca78a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:08.143392 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daae398-263f-4847-b01b-58e8fbeca78a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:08.144743 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daae398-263f-4847-b01b-58e8fbeca78a None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:08.153318 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 517/1049] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:03:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:08.158785 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b777452-6594-43b4-9ba1-2b2cc10e37d3 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:08.253862 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b777452-6594-43b4-9ba1-2b2cc10e37d3 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:08.287444 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1e270-2dd0-4100-a598-b541df8302e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:08.288311 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1e270-2dd0-4100-a598-b541df8302e1 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:08.288595 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1e270-2dd0-4100-a598-b541df8302e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:08.288870 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1e270-2dd0-4100-a598-b541df8302e1 None admin] PATH_INFO: `/v3/users/437e53164a9143ff8d2c5d4380aa346d` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:08.301729 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd1e270-2dd0-4100-a598-b541df8302e1 None admin] RBAC: Authorizing `identity:get_user(user_id=437e53164a9143ff8d2c5d4380aa346d)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:08.303324 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd1e270-2dd0-4100-a598-b541df8302e1 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:08.305168 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 533/1050] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:03:08 2022] GET /identity/v3/users/437e53164a9143ff8d2c5d4380aa346d => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:08.310623 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daae398-263f-4847-b01b-58e8fbeca78a None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:08.407764 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daae398-263f-4847-b01b-58e8fbeca78a None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:08.440369 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f42b9d-b897-4d0d-bb51-14d4c4818771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:08.441023 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f42b9d-b897-4d0d-bb51-14d4c4818771 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:08.441334 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f42b9d-b897-4d0d-bb51-14d4c4818771 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:08.441615 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f42b9d-b897-4d0d-bb51-14d4c4818771 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:08.506311 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f42b9d-b897-4d0d-bb51-14d4c4818771 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:08.507696 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f42b9d-b897-4d0d-bb51-14d4c4818771 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:08.603673 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 518/1051] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:03:08 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 20:03:08.609185 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1e270-2dd0-4100-a598-b541df8302e1 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:08.708560 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1e270-2dd0-4100-a598-b541df8302e1 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:08.741736 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a74fab-1aae-4389-8dba-f7e00a7229b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:08.742596 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a74fab-1aae-4389-8dba-f7e00a7229b3 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:08.742878 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a74fab-1aae-4389-8dba-f7e00a7229b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:08.743155 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a74fab-1aae-4389-8dba-f7e00a7229b3 None admin] PATH_INFO: `/v3/projects/9357af5231ee4117816f632758044983` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:08.744326 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a74fab-1aae-4389-8dba-f7e00a7229b3 None admin] RBAC: Authorizing `identity:get_project(project_id=9357af5231ee4117816f632758044983)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:08.745806 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a74fab-1aae-4389-8dba-f7e00a7229b3 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:08.747638 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 534/1052] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:03:08 2022] GET /identity/v3/projects/9357af5231ee4117816f632758044983 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:08.753598 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f42b9d-b897-4d0d-bb51-14d4c4818771 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:08.850351 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f42b9d-b897-4d0d-bb51-14d4c4818771 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:08.882410 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd4741-5682-44f2-8671-f1e57d62e5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:08.883060 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd4741-5682-44f2-8671-f1e57d62e5ab None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:08.883340 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd4741-5682-44f2-8671-f1e57d62e5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:08.883636 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd4741-5682-44f2-8671-f1e57d62e5ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:08.884426 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd4741-5682-44f2-8671-f1e57d62e5ab None admin] RBAC: Adding query filter params (role.id=8cfa924df1a1400986d9ecc9686a7f52, scope.project.id=9357af5231ee4117816f632758044983, user.id=437e53164a9143ff8d2c5d4380aa346d) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:08.884790 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd4741-5682-44f2-8671-f1e57d62e5ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:08.886232 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd4741-5682-44f2-8671-f1e57d62e5ab None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:08.897197 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 519/1053] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:03:08 2022] GET /identity/v3/role_assignments?user.id=437e53164a9143ff8d2c5d4380aa346d&scope.project.id=9357af5231ee4117816f632758044983&role.id=8cfa924df1a1400986d9ecc9686a7f52 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:09.141219 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e13e44-78c3-4545-a588-9f89b44711ef None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:09.141744 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e13e44-78c3-4545-a588-9f89b44711ef None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:09.141744 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e13e44-78c3-4545-a588-9f89b44711ef None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:09.143640 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 535/1054] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:03:09.150272 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15371cda-4112-4b9a-8c63-0a2b61e8939c None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:09.150709 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15371cda-4112-4b9a-8c63-0a2b61e8939c None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:09.150894 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15371cda-4112-4b9a-8c63-0a2b61e8939c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:09.167446 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-15371cda-4112-4b9a-8c63-0a2b61e8939c None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:09.168625 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-15371cda-4112-4b9a-8c63-0a2b61e8939c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:09.235497 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 520/1055] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:03:09.259626 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e13e44-78c3-4545-a588-9f89b44711ef None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:09.366546 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e13e44-78c3-4545-a588-9f89b44711ef None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:09.401008 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b2e75-00e2-4938-81ec-7e86ad71a98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:09.401768 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b2e75-00e2-4938-81ec-7e86ad71a98f None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:09.402053 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b2e75-00e2-4938-81ec-7e86ad71a98f None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:09.402327 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b2e75-00e2-4938-81ec-7e86ad71a98f None admin] PATH_INFO: `/v3/services/image` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:09.402975 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b2e75-00e2-4938-81ec-7e86ad71a98f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:09.404331 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b2e75-00e2-4938-81ec-7e86ad71a98f None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:09.414883 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-479b2e75-00e2-4938-81ec-7e86ad71a98f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 29 20:03:09.416232 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 536/1056] 10.222.0.43 () {56 vars in 1105 bytes} [Tue Mar 29 20:03:09 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:03:09.421942 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15371cda-4112-4b9a-8c63-0a2b61e8939c None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:09.522533 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15371cda-4112-4b9a-8c63-0a2b61e8939c None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:09.555636 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43920f0b-f1bd-47f6-a61c-a711f925aee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:09.556300 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43920f0b-f1bd-47f6-a61c-a711f925aee9 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:09.556584 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43920f0b-f1bd-47f6-a61c-a711f925aee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:09.556859 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43920f0b-f1bd-47f6-a61c-a711f925aee9 None admin] PATH_INFO: `/v3/services` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:09.557597 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43920f0b-f1bd-47f6-a61c-a711f925aee9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:09.557908 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43920f0b-f1bd-47f6-a61c-a711f925aee9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:09.559259 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43920f0b-f1bd-47f6-a61c-a711f925aee9 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:09.569236 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 521/1057] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:03:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:09.570437 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b2e75-00e2-4938-81ec-7e86ad71a98f None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:09.666794 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b2e75-00e2-4938-81ec-7e86ad71a98f None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:09.699683 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9ab1c-2eda-479c-8139-024293d10d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:09.700355 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9ab1c-2eda-479c-8139-024293d10d62 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:09.700640 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9ab1c-2eda-479c-8139-024293d10d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:09.700917 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9ab1c-2eda-479c-8139-024293d10d62 None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:09.701645 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9ab1c-2eda-479c-8139-024293d10d62 None admin] RBAC: Adding query filter params (type=image) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:09.701954 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9ab1c-2eda-479c-8139-024293d10d62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:09.703311 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9ab1c-2eda-479c-8139-024293d10d62 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:09.708246 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 537/1058] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:03:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:03:09.713705 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43920f0b-f1bd-47f6-a61c-a711f925aee9 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:09.809641 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43920f0b-f1bd-47f6-a61c-a711f925aee9 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:09.838018 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889b5ba-bfe7-4fbe-9481-1edebef7e602 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:09.838325 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889b5ba-bfe7-4fbe-9481-1edebef7e602 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:09.838592 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889b5ba-bfe7-4fbe-9481-1edebef7e602 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:09.840510 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 538/1059] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:03:09.843197 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41962e-1480-404b-a537-fc7bcd1b2683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:09.843853 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41962e-1480-404b-a537-fc7bcd1b2683 None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:09.844147 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41962e-1480-404b-a537-fc7bcd1b2683 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:09.844426 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41962e-1480-404b-a537-fc7bcd1b2683 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:09.845184 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41962e-1480-404b-a537-fc7bcd1b2683 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:09.845939 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04eb4e-6b09-42ab-b56e-a4d592ca3d6f None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:09.846431 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04eb4e-6b09-42ab-b56e-a4d592ca3d6f None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:09.846546 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41962e-1480-404b-a537-fc7bcd1b2683 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:09.847005 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04eb4e-6b09-42ab-b56e-a4d592ca3d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:09.863729 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-0d04eb4e-6b09-42ab-b56e-a4d592ca3d6f None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:09.866124 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-0d04eb4e-6b09-42ab-b56e-a4d592ca3d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:09.936318 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 539/1060] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:03:09.949543 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 522/1061] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Mar 29 20:03:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:03:09.959389 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04eb4e-6b09-42ab-b56e-a4d592ca3d6f None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:10.066970 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04eb4e-6b09-42ab-b56e-a4d592ca3d6f None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:10.110566 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec8f34-1a5b-4232-8f66-393869bf842e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:10.111392 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec8f34-1a5b-4232-8f66-393869bf842e None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:10.111671 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec8f34-1a5b-4232-8f66-393869bf842e None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:10.111944 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec8f34-1a5b-4232-8f66-393869bf842e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:10.123514 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec8f34-1a5b-4232-8f66-393869bf842e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:03:10.131759 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-a2ec8f34-1a5b-4232-8f66-393869bf842e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 29 20:03:10.133170 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 540/1062] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Mar 29 20:03:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:03:10.138852 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41962e-1480-404b-a537-fc7bcd1b2683 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:10.240371 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41962e-1480-404b-a537-fc7bcd1b2683 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:10.272589 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f50ac7-7b7f-4bda-b1b6-64847a7caad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:10.273260 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f50ac7-7b7f-4bda-b1b6-64847a7caad7 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:10.273577 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f50ac7-7b7f-4bda-b1b6-64847a7caad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:10.273859 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f50ac7-7b7f-4bda-b1b6-64847a7caad7 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:10.274608 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f50ac7-7b7f-4bda-b1b6-64847a7caad7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:10.274920 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f50ac7-7b7f-4bda-b1b6-64847a7caad7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:10.276299 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f50ac7-7b7f-4bda-b1b6-64847a7caad7 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:10.285588 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 523/1063] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Mar 29 20:03:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:10.291851 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec8f34-1a5b-4232-8f66-393869bf842e None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:10.389866 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec8f34-1a5b-4232-8f66-393869bf842e None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:10.422222 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d9a73-bb0c-4582-9e6e-9c3bcb12e64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:10.423021 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d9a73-bb0c-4582-9e6e-9c3bcb12e64f None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:10.423306 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d9a73-bb0c-4582-9e6e-9c3bcb12e64f None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:10.423586 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d9a73-bb0c-4582-9e6e-9c3bcb12e64f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:10.434946 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d9a73-bb0c-4582-9e6e-9c3bcb12e64f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:10.436679 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d9a73-bb0c-4582-9e6e-9c3bcb12e64f None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:10.454182 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-192d9a73-bb0c-4582-9e6e-9c3bcb12e64f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:03:10.455955 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 541/1064] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:03:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:03:10.462466 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f50ac7-7b7f-4bda-b1b6-64847a7caad7 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:10.558514 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f50ac7-7b7f-4bda-b1b6-64847a7caad7 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:10.591656 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fc45a-c483-410a-a689-7f3c69b309cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:10.592322 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fc45a-c483-410a-a689-7f3c69b309cc None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:10.592607 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fc45a-c483-410a-a689-7f3c69b309cc None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:10.592885 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fc45a-c483-410a-a689-7f3c69b309cc None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:10.593641 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fc45a-c483-410a-a689-7f3c69b309cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:10.593955 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fc45a-c483-410a-a689-7f3c69b309cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:10.595326 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fc45a-c483-410a-a689-7f3c69b309cc None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:10.610835 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 524/1065] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:03:10.612111 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d9a73-bb0c-4582-9e6e-9c3bcb12e64f None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:10.709698 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d9a73-bb0c-4582-9e6e-9c3bcb12e64f None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:10.742060 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c900433-76fe-4011-a0e6-514bbc1a6e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:10.742850 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c900433-76fe-4011-a0e6-514bbc1a6e34 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:10.743130 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c900433-76fe-4011-a0e6-514bbc1a6e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:10.743403 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c900433-76fe-4011-a0e6-514bbc1a6e34 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:10.750871 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c900433-76fe-4011-a0e6-514bbc1a6e34 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:10.752315 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c900433-76fe-4011-a0e6-514bbc1a6e34 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:10.765573 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-7c900433-76fe-4011-a0e6-514bbc1a6e34 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 29 20:03:10.766926 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 542/1066] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Mar 29 20:03:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:03:10.773109 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fc45a-c483-410a-a689-7f3c69b309cc None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:10.874952 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fc45a-c483-410a-a689-7f3c69b309cc None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:10.908510 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4a40e-ae33-4f84-ae61-3aa7b8b4d76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:10.909616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4a40e-ae33-4f84-ae61-3aa7b8b4d76b None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:10.910123 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4a40e-ae33-4f84-ae61-3aa7b8b4d76b None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:10.910626 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4a40e-ae33-4f84-ae61-3aa7b8b4d76b None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:10.912210 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4a40e-ae33-4f84-ae61-3aa7b8b4d76b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:10.912729 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4a40e-ae33-4f84-ae61-3aa7b8b4d76b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:10.914374 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4a40e-ae33-4f84-ae61-3aa7b8b4d76b None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:10.932227 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 525/1067] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Mar 29 20:03:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:10.937459 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c900433-76fe-4011-a0e6-514bbc1a6e34 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:11.038890 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c900433-76fe-4011-a0e6-514bbc1a6e34 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:11.072710 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12be7ba-1ba9-4039-a56b-8245b77c5d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:11.073819 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12be7ba-1ba9-4039-a56b-8245b77c5d6a None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:11.074255 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12be7ba-1ba9-4039-a56b-8245b77c5d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:11.074705 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12be7ba-1ba9-4039-a56b-8245b77c5d6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:11.085658 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12be7ba-1ba9-4039-a56b-8245b77c5d6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:11.087359 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12be7ba-1ba9-4039-a56b-8245b77c5d6a None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:11.105426 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-f12be7ba-1ba9-4039-a56b-8245b77c5d6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:03:11.106955 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 543/1068] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:03:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:03:11.112623 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4a40e-ae33-4f84-ae61-3aa7b8b4d76b None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:11.210165 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4a40e-ae33-4f84-ae61-3aa7b8b4d76b None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:11.225929 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0deaa8-9c63-4377-b801-a1b84e776a4f None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:11.226215 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0deaa8-9c63-4377-b801-a1b84e776a4f None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:11.226505 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0deaa8-9c63-4377-b801-a1b84e776a4f None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:11.228436 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 544/1069] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:03:11.233342 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c7702-3987-40e5-99e7-fac5470f894a None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:11.233639 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c7702-3987-40e5-99e7-fac5470f894a None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:11.233922 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c7702-3987-40e5-99e7-fac5470f894a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:11.244818 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f6dbb-520f-466a-89ae-0f2db7bfbbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:11.245507 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f6dbb-520f-466a-89ae-0f2db7bfbbae None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:11.245791 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f6dbb-520f-466a-89ae-0f2db7bfbbae None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:11.246072 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f6dbb-520f-466a-89ae-0f2db7bfbbae None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:11.246785 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f6dbb-520f-466a-89ae-0f2db7bfbbae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:11.247090 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f6dbb-520f-466a-89ae-0f2db7bfbbae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:11.248436 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f6dbb-520f-466a-89ae-0f2db7bfbbae None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:11.251552 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-5e9c7702-3987-40e5-99e7-fac5470f894a None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:11.252751 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-5e9c7702-3987-40e5-99e7-fac5470f894a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:11.260067 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 526/1070] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:11.265615 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f6dbb-520f-466a-89ae-0f2db7bfbbae None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:11.320537 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 545/1071] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 20:03:11.343425 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c7702-3987-40e5-99e7-fac5470f894a None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:11.369949 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f6dbb-520f-466a-89ae-0f2db7bfbbae None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:11.405441 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a25520-e34f-41ce-9d40-ea3c3133fc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:11.406232 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a25520-e34f-41ce-9d40-ea3c3133fc2e None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:11.406506 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a25520-e34f-41ce-9d40-ea3c3133fc2e None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:11.406785 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a25520-e34f-41ce-9d40-ea3c3133fc2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:11.413432 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a25520-e34f-41ce-9d40-ea3c3133fc2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:11.414863 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a25520-e34f-41ce-9d40-ea3c3133fc2e None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:11.429628 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-24a25520-e34f-41ce-9d40-ea3c3133fc2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:03:11.435796 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 527/1072] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:03:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:03:11.436568 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a25520-e34f-41ce-9d40-ea3c3133fc2e None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:11.451201 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c7702-3987-40e5-99e7-fac5470f894a None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:11.484489 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346e7c2-908c-45b7-bfb0-a125503482cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:11.485250 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346e7c2-908c-45b7-bfb0-a125503482cb None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:11.485533 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346e7c2-908c-45b7-bfb0-a125503482cb None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:11.485815 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346e7c2-908c-45b7-bfb0-a125503482cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:11.497728 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346e7c2-908c-45b7-bfb0-a125503482cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:03:11.508709 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-1346e7c2-908c-45b7-bfb0-a125503482cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:03:11.510247 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 546/1073] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:03:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:03:11.518147 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346e7c2-908c-45b7-bfb0-a125503482cb None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:11.535955 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a25520-e34f-41ce-9d40-ea3c3133fc2e None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:11.571532 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04107e8a-eaea-4689-8a74-d0eeed74a016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:11.572196 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04107e8a-eaea-4689-8a74-d0eeed74a016 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:11.572480 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04107e8a-eaea-4689-8a74-d0eeed74a016 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:11.572759 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04107e8a-eaea-4689-8a74-d0eeed74a016 None admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:11.573566 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04107e8a-eaea-4689-8a74-d0eeed74a016 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:11.573882 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04107e8a-eaea-4689-8a74-d0eeed74a016 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:11.575303 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04107e8a-eaea-4689-8a74-d0eeed74a016 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:11.592018 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 528/1074] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:03:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:03:11.592916 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04107e8a-eaea-4689-8a74-d0eeed74a016 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:11.621443 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346e7c2-908c-45b7-bfb0-a125503482cb None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:11.654049 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd586f-9d52-4a8b-999f-d4efe9cfdc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:11.654758 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd586f-9d52-4a8b-999f-d4efe9cfdc8f None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:11.655047 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd586f-9d52-4a8b-999f-d4efe9cfdc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:11.655326 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd586f-9d52-4a8b-999f-d4efe9cfdc8f None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:11.656063 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd586f-9d52-4a8b-999f-d4efe9cfdc8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:11.656373 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd586f-9d52-4a8b-999f-d4efe9cfdc8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:11.657785 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd586f-9d52-4a8b-999f-d4efe9cfdc8f None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:11.666252 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 547/1075] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:03:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:11.671739 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd586f-9d52-4a8b-999f-d4efe9cfdc8f None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:11.695311 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04107e8a-eaea-4689-8a74-d0eeed74a016 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:11.729123 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6806b-a876-4f64-b08f-2785922392f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:11.730154 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6806b-a876-4f64-b08f-2785922392f2 None admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:11.730333 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6806b-a876-4f64-b08f-2785922392f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:11.730604 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6806b-a876-4f64-b08f-2785922392f2 None admin] PATH_INFO: `/v3/projects/ec1f2c5cb900473da1083830387e3ff4/users/b797e15939694c9abf1f2b8e9aee4d67/roles/cb894452030c4656aaa8ad80b903bef6` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:11.732923 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6806b-a876-4f64-b08f-2785922392f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec1f2c5cb900473da1083830387e3ff4, user_id=b797e15939694c9abf1f2b8e9aee4d67, role_id=cb894452030c4656aaa8ad80b903bef6)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:11.734361 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6806b-a876-4f64-b08f-2785922392f2 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:11.771406 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd586f-9d52-4a8b-999f-d4efe9cfdc8f None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:11.801150 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 529/1076] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Mar 29 20:03:11 2022] PUT /identity/v3/projects/ec1f2c5cb900473da1083830387e3ff4/users/b797e15939694c9abf1f2b8e9aee4d67/roles/cb894452030c4656aaa8ad80b903bef6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:03:11.809027 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4cfac-82b2-4327-abd7-d533dc89200a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:11.810233 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4cfac-82b2-4327-abd7-d533dc89200a None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:11.810665 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4cfac-82b2-4327-abd7-d533dc89200a None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:11.811088 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4cfac-82b2-4327-abd7-d533dc89200a None admin] PATH_INFO: `/v3/users/437e53164a9143ff8d2c5d4380aa346d` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:11.812649 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4cfac-82b2-4327-abd7-d533dc89200a None admin] RBAC: Authorizing `identity:get_user(user_id=437e53164a9143ff8d2c5d4380aa346d)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:11.814350 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4cfac-82b2-4327-abd7-d533dc89200a None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:11.816688 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 548/1077] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:03:11 2022] GET /identity/v3/users/437e53164a9143ff8d2c5d4380aa346d => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:03:11.823414 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6806b-a876-4f64-b08f-2785922392f2 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:11.936189 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6806b-a876-4f64-b08f-2785922392f2 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:11.975932 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c0b4e-95b2-4b21-ba1f-d70159bc5ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:11.976815 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c0b4e-95b2-4b21-ba1f-d70159bc5ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:11.977100 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c0b4e-95b2-4b21-ba1f-d70159bc5ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:11.977404 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c0b4e-95b2-4b21-ba1f-d70159bc5ba5 None admin] PATH_INFO: `/v3/projects/9357af5231ee4117816f632758044983` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:11.978634 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c0b4e-95b2-4b21-ba1f-d70159bc5ba5 None admin] RBAC: Authorizing `identity:get_project(project_id=9357af5231ee4117816f632758044983)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:11.980068 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c0b4e-95b2-4b21-ba1f-d70159bc5ba5 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:11.985332 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 530/1078] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:03:11 2022] GET /identity/v3/projects/9357af5231ee4117816f632758044983 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:11.987638 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4cfac-82b2-4327-abd7-d533dc89200a None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:12.092736 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4cfac-82b2-4327-abd7-d533dc89200a None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:12.125903 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30de191-a4da-4106-9028-41f155cf3b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:12.126786 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30de191-a4da-4106-9028-41f155cf3b76 None admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:12.127062 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30de191-a4da-4106-9028-41f155cf3b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:12.127338 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30de191-a4da-4106-9028-41f155cf3b76 None admin] PATH_INFO: `/v3/projects/9357af5231ee4117816f632758044983/users/437e53164a9143ff8d2c5d4380aa346d/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:12.129318 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30de191-a4da-4106-9028-41f155cf3b76 None admin] RBAC: Authorizing `identity:create_grant(project_id=9357af5231ee4117816f632758044983, user_id=437e53164a9143ff8d2c5d4380aa346d, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:12.131855 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30de191-a4da-4106-9028-41f155cf3b76 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:12.200193 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 549/1079] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Mar 29 20:03:11 2022] PUT /identity/v3/projects/9357af5231ee4117816f632758044983/users/437e53164a9143ff8d2c5d4380aa346d/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:03:12.302923 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59677f-df86-4c80-8350-82822bd1a499 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:12.303451 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59677f-df86-4c80-8350-82822bd1a499 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:12.303676 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59677f-df86-4c80-8350-82822bd1a499 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:12.305613 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 531/1080] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:03:12.311131 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b332ae0-3c96-4902-bf7f-66a47792f9a7 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:12.311422 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b332ae0-3c96-4902-bf7f-66a47792f9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:12.311711 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b332ae0-3c96-4902-bf7f-66a47792f9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:12.329629 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-9b332ae0-3c96-4902-bf7f-66a47792f9a7 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:12.330861 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-9b332ae0-3c96-4902-bf7f-66a47792f9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:12.401512 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 550/1081] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 20:03:12.425014 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59677f-df86-4c80-8350-82822bd1a499 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:12.523551 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59677f-df86-4c80-8350-82822bd1a499 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:12.555883 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474ada5-69ab-42c0-91ed-e557dc5061b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:12.556534 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474ada5-69ab-42c0-91ed-e557dc5061b0 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:12.556817 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474ada5-69ab-42c0-91ed-e557dc5061b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:12.557149 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474ada5-69ab-42c0-91ed-e557dc5061b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:12.622843 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474ada5-69ab-42c0-91ed-e557dc5061b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:12.624280 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474ada5-69ab-42c0-91ed-e557dc5061b0 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:12.718850 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 532/1082] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:03:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 20:03:12.725229 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b332ae0-3c96-4902-bf7f-66a47792f9a7 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:12.821413 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b332ae0-3c96-4902-bf7f-66a47792f9a7 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:12.854414 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe0d01-0ad8-4055-b9ce-a13be922c542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:12.855221 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe0d01-0ad8-4055-b9ce-a13be922c542 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:12.855506 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe0d01-0ad8-4055-b9ce-a13be922c542 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:12.855786 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe0d01-0ad8-4055-b9ce-a13be922c542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:12.866434 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe0d01-0ad8-4055-b9ce-a13be922c542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:12.867872 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe0d01-0ad8-4055-b9ce-a13be922c542 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:12.884577 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-fabe0d01-0ad8-4055-b9ce-a13be922c542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:03:12.885974 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 551/1083] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:03:12.891657 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474ada5-69ab-42c0-91ed-e557dc5061b0 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:12.991072 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474ada5-69ab-42c0-91ed-e557dc5061b0 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:13.024416 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a9bd3-033a-4e93-884f-7b4081ab4328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:13.025085 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a9bd3-033a-4e93-884f-7b4081ab4328 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:13.025398 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a9bd3-033a-4e93-884f-7b4081ab4328 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:13.025679 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a9bd3-033a-4e93-884f-7b4081ab4328 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:13.026401 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a9bd3-033a-4e93-884f-7b4081ab4328 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:13.026714 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a9bd3-033a-4e93-884f-7b4081ab4328 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:13.028082 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a9bd3-033a-4e93-884f-7b4081ab4328 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:13.039716 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 533/1084] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:14.115668 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dacee-1f26-4456-805f-fe1803859979 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:14.116200 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dacee-1f26-4456-805f-fe1803859979 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:14.116200 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dacee-1f26-4456-805f-fe1803859979 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:14.118058 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 552/1085] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:03:14.123462 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda9832-8fdd-4332-86ad-d651cacef467 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:14.123989 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda9832-8fdd-4332-86ad-d651cacef467 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:14.123989 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda9832-8fdd-4332-86ad-d651cacef467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:14.143797 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-0fda9832-8fdd-4332-86ad-d651cacef467 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:14.145034 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-0fda9832-8fdd-4332-86ad-d651cacef467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:14.212601 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 534/1086] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:03:14.235740 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427dacee-1f26-4456-805f-fe1803859979 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:14.335229 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427dacee-1f26-4456-805f-fe1803859979 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:14.368219 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cabf00-43f8-4c93-bd85-c21cc1ee7178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:14.369031 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cabf00-43f8-4c93-bd85-c21cc1ee7178 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:14.369337 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cabf00-43f8-4c93-bd85-c21cc1ee7178 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:14.369617 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cabf00-43f8-4c93-bd85-c21cc1ee7178 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:14.379221 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cabf00-43f8-4c93-bd85-c21cc1ee7178 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:03:14.387048 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-86cabf00-43f8-4c93-bd85-c21cc1ee7178 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 29 20:03:14.388391 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 553/1087] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Mar 29 20:03:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:03:14.394121 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda9832-8fdd-4332-86ad-d651cacef467 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:14.491307 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda9832-8fdd-4332-86ad-d651cacef467 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:14.491512 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2aa854-5f02-4cbd-b1e9-79f21397c269 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:14.491809 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2aa854-5f02-4cbd-b1e9-79f21397c269 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:14.492099 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2aa854-5f02-4cbd-b1e9-79f21397c269 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:14.493930 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 554/1088] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:03:14.498880 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c740410-aaa2-485c-938e-9331f38013fa None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:14.499173 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c740410-aaa2-485c-938e-9331f38013fa None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:14.499459 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c740410-aaa2-485c-938e-9331f38013fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:14.516635 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-2c740410-aaa2-485c-938e-9331f38013fa None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:14.517869 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-2c740410-aaa2-485c-938e-9331f38013fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:14.525219 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58f9c0-06cc-41b9-b2c1-a9932039c35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:14.525918 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58f9c0-06cc-41b9-b2c1-a9932039c35b None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:14.526206 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58f9c0-06cc-41b9-b2c1-a9932039c35b None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:14.526487 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58f9c0-06cc-41b9-b2c1-a9932039c35b None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:14.527232 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58f9c0-06cc-41b9-b2c1-a9932039c35b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:14.527545 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58f9c0-06cc-41b9-b2c1-a9932039c35b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:14.528904 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58f9c0-06cc-41b9-b2c1-a9932039c35b None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:14.537313 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 535/1089] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Mar 29 20:03:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:14.542883 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58f9c0-06cc-41b9-b2c1-a9932039c35b None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:14.581891 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 555/1090] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 20:03:14.606119 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c740410-aaa2-485c-938e-9331f38013fa None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:14.636642 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58f9c0-06cc-41b9-b2c1-a9932039c35b None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:14.668776 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb7ab6-7d6e-4dc6-9e01-5a7a64d636e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:14.669585 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb7ab6-7d6e-4dc6-9e01-5a7a64d636e9 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:14.669871 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb7ab6-7d6e-4dc6-9e01-5a7a64d636e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:14.670149 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb7ab6-7d6e-4dc6-9e01-5a7a64d636e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:14.680923 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb7ab6-7d6e-4dc6-9e01-5a7a64d636e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:14.682397 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb7ab6-7d6e-4dc6-9e01-5a7a64d636e9 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:14.699063 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-7aeb7ab6-7d6e-4dc6-9e01-5a7a64d636e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:03:14.699207 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c740410-aaa2-485c-938e-9331f38013fa None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:14.700238 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 536/1091] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:03:14.705820 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb7ab6-7d6e-4dc6-9e01-5a7a64d636e9 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:14.733063 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59846f9-c750-49e7-b2a3-20f9ef2393d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:14.733888 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59846f9-c750-49e7-b2a3-20f9ef2393d6 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:14.734174 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59846f9-c750-49e7-b2a3-20f9ef2393d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:14.734458 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59846f9-c750-49e7-b2a3-20f9ef2393d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:14.744574 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59846f9-c750-49e7-b2a3-20f9ef2393d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:03:14.751532 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-f59846f9-c750-49e7-b2a3-20f9ef2393d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:03:14.752706 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 556/1092] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:03:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:03:14.759029 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59846f9-c750-49e7-b2a3-20f9ef2393d6 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:14.800842 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb7ab6-7d6e-4dc6-9e01-5a7a64d636e9 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:14.833832 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3fd60-eada-49fe-8c4e-cad5789846f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:14.834481 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3fd60-eada-49fe-8c4e-cad5789846f0 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:14.834770 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3fd60-eada-49fe-8c4e-cad5789846f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:14.835049 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3fd60-eada-49fe-8c4e-cad5789846f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:14.835764 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3fd60-eada-49fe-8c4e-cad5789846f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:14.836072 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3fd60-eada-49fe-8c4e-cad5789846f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:14.837449 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3fd60-eada-49fe-8c4e-cad5789846f0 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:14.848822 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 537/1093] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:03:14.854285 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3fd60-eada-49fe-8c4e-cad5789846f0 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:14.854393 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59846f9-c750-49e7-b2a3-20f9ef2393d6 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:14.887092 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5810c5-bd1c-4c2e-b6ef-949bd4c36e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:14.887749 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5810c5-bd1c-4c2e-b6ef-949bd4c36e56 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:14.888032 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5810c5-bd1c-4c2e-b6ef-949bd4c36e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:14.888307 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5810c5-bd1c-4c2e-b6ef-949bd4c36e56 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:14.889040 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5810c5-bd1c-4c2e-b6ef-949bd4c36e56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:14.889376 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5810c5-bd1c-4c2e-b6ef-949bd4c36e56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:14.890736 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5810c5-bd1c-4c2e-b6ef-949bd4c36e56 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:14.898932 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 557/1094] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:03:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:03:14.904480 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5810c5-bd1c-4c2e-b6ef-949bd4c36e56 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:14.950236 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3fd60-eada-49fe-8c4e-cad5789846f0 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:14.984557 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae192d-f9f5-4294-b39b-42f65fb20037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:14.985480 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae192d-f9f5-4294-b39b-42f65fb20037 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:14.985772 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae192d-f9f5-4294-b39b-42f65fb20037 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:14.986050 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae192d-f9f5-4294-b39b-42f65fb20037 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:14.993009 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae192d-f9f5-4294-b39b-42f65fb20037 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:14.994492 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae192d-f9f5-4294-b39b-42f65fb20037 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:15.003638 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5810c5-bd1c-4c2e-b6ef-949bd4c36e56 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:15.009365 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-82ae192d-f9f5-4294-b39b-42f65fb20037 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 29 20:03:15.012163 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 538/1095] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Mar 29 20:03:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:03:15.016957 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae192d-f9f5-4294-b39b-42f65fb20037 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:15.045849 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c294e4-8f44-4427-80ea-050408e739aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:15.046726 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c294e4-8f44-4427-80ea-050408e739aa None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:15.047013 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c294e4-8f44-4427-80ea-050408e739aa None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:15.047293 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c294e4-8f44-4427-80ea-050408e739aa None admin] PATH_INFO: `/v3/users/437e53164a9143ff8d2c5d4380aa346d` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:15.048502 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c294e4-8f44-4427-80ea-050408e739aa None admin] RBAC: Authorizing `identity:get_user(user_id=437e53164a9143ff8d2c5d4380aa346d)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:15.049975 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c294e4-8f44-4427-80ea-050408e739aa None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:15.051601 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 558/1096] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:03:14 2022] GET /identity/v3/users/437e53164a9143ff8d2c5d4380aa346d => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:03:15.057359 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c294e4-8f44-4427-80ea-050408e739aa None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:15.116871 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae192d-f9f5-4294-b39b-42f65fb20037 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:15.149201 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aefe4d-5dd6-4178-8091-f7cb18f33d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:15.149891 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aefe4d-5dd6-4178-8091-f7cb18f33d32 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:15.150176 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aefe4d-5dd6-4178-8091-f7cb18f33d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:15.150454 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aefe4d-5dd6-4178-8091-f7cb18f33d32 None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:15.151289 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aefe4d-5dd6-4178-8091-f7cb18f33d32 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:15.151404 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c294e4-8f44-4427-80ea-050408e739aa None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:15.151780 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aefe4d-5dd6-4178-8091-f7cb18f33d32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:15.153032 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aefe4d-5dd6-4178-8091-f7cb18f33d32 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:15.169529 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 539/1097] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Mar 29 20:03:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:15.175146 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aefe4d-5dd6-4178-8091-f7cb18f33d32 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:15.183563 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7d5fe-b586-4df2-8a79-519a12834763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:15.184219 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7d5fe-b586-4df2-8a79-519a12834763 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:15.184504 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7d5fe-b586-4df2-8a79-519a12834763 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:15.184783 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7d5fe-b586-4df2-8a79-519a12834763 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:15.249251 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7d5fe-b586-4df2-8a79-519a12834763 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:15.250725 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7d5fe-b586-4df2-8a79-519a12834763 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:15.268518 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aefe4d-5dd6-4178-8091-f7cb18f33d32 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:15.301538 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c21de5-4c2e-4a86-8bbf-991212d2142a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:15.302167 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c21de5-4c2e-4a86-8bbf-991212d2142a None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:15.302467 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c21de5-4c2e-4a86-8bbf-991212d2142a None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:15.302723 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c21de5-4c2e-4a86-8bbf-991212d2142a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:15.345281 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 559/1098] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:03:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 29 20:03:15.351151 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7d5fe-b586-4df2-8a79-519a12834763 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:15.368107 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c21de5-4c2e-4a86-8bbf-991212d2142a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:15.369679 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c21de5-4c2e-4a86-8bbf-991212d2142a None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:15.446857 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7d5fe-b586-4df2-8a79-519a12834763 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:15.475398 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 540/1099] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:03:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 29 20:03:15.479565 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b754eb5-dff2-4ed3-a0fa-9c97f9b78fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:15.480451 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b754eb5-dff2-4ed3-a0fa-9c97f9b78fbb None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:15.480736 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b754eb5-dff2-4ed3-a0fa-9c97f9b78fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:15.481010 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b754eb5-dff2-4ed3-a0fa-9c97f9b78fbb None admin] PATH_INFO: `/v3/projects/9357af5231ee4117816f632758044983` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:15.481132 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c21de5-4c2e-4a86-8bbf-991212d2142a None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:15.482213 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b754eb5-dff2-4ed3-a0fa-9c97f9b78fbb None admin] RBAC: Authorizing `identity:get_project(project_id=9357af5231ee4117816f632758044983)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:15.483655 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b754eb5-dff2-4ed3-a0fa-9c97f9b78fbb None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:15.485375 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 560/1100] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:03:15 2022] GET /identity/v3/projects/9357af5231ee4117816f632758044983 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:03:15.491239 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b754eb5-dff2-4ed3-a0fa-9c97f9b78fbb None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:15.578742 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c21de5-4c2e-4a86-8bbf-991212d2142a None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:15.594049 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b754eb5-dff2-4ed3-a0fa-9c97f9b78fbb None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:15.610920 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23fdee-bcfd-47a9-b0c2-e598a89f429c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:15.611709 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23fdee-bcfd-47a9-b0c2-e598a89f429c None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:15.611995 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23fdee-bcfd-47a9-b0c2-e598a89f429c None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:15.612273 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23fdee-bcfd-47a9-b0c2-e598a89f429c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:15.622631 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23fdee-bcfd-47a9-b0c2-e598a89f429c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:15.624066 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23fdee-bcfd-47a9-b0c2-e598a89f429c None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:15.626966 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f72228-4bdb-44b7-9777-1ea1d09f7f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:15.627618 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f72228-4bdb-44b7-9777-1ea1d09f7f3e None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:15.627907 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f72228-4bdb-44b7-9777-1ea1d09f7f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:15.628185 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f72228-4bdb-44b7-9777-1ea1d09f7f3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:15.629003 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f72228-4bdb-44b7-9777-1ea1d09f7f3e None admin] RBAC: Adding query filter params (role.id=8cfa924df1a1400986d9ecc9686a7f52, scope.project.id=9357af5231ee4117816f632758044983, user.id=437e53164a9143ff8d2c5d4380aa346d) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:15.629343 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f72228-4bdb-44b7-9777-1ea1d09f7f3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:15.630970 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f72228-4bdb-44b7-9777-1ea1d09f7f3e None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:15.636792 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 561/1101] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:03:15 2022] GET /identity/v3/role_assignments?user.id=437e53164a9143ff8d2c5d4380aa346d&scope.project.id=9357af5231ee4117816f632758044983&role.id=8cfa924df1a1400986d9ecc9686a7f52 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:03:15.640454 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-cd23fdee-bcfd-47a9-b0c2-e598a89f429c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:03:15.641814 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 541/1102] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:03:15.647979 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f72228-4bdb-44b7-9777-1ea1d09f7f3e None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:15.751482 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f72228-4bdb-44b7-9777-1ea1d09f7f3e None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:15.787948 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54642a38-4af2-43fd-8af0-88424322bb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:15.788630 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54642a38-4af2-43fd-8af0-88424322bb4d None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:15.788917 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54642a38-4af2-43fd-8af0-88424322bb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:15.789196 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54642a38-4af2-43fd-8af0-88424322bb4d None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:15.789957 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54642a38-4af2-43fd-8af0-88424322bb4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:15.790272 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54642a38-4af2-43fd-8af0-88424322bb4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:15.791663 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54642a38-4af2-43fd-8af0-88424322bb4d None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:15.804455 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 562/1103] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:15.810358 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23fdee-bcfd-47a9-b0c2-e598a89f429c None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:15.912290 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23fdee-bcfd-47a9-b0c2-e598a89f429c None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:15.946448 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa5600-cafb-45a7-aa8a-de72caed6ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:15.947245 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa5600-cafb-45a7-aa8a-de72caed6ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:15.947527 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa5600-cafb-45a7-aa8a-de72caed6ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:15.947803 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa5600-cafb-45a7-aa8a-de72caed6ae0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:15.954532 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa5600-cafb-45a7-aa8a-de72caed6ae0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:15.955968 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa5600-cafb-45a7-aa8a-de72caed6ae0 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:15.969417 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-d0aa5600-cafb-45a7-aa8a-de72caed6ae0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:03:15.970585 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 542/1104] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:03:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:03:15.976701 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54642a38-4af2-43fd-8af0-88424322bb4d None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:16.073707 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54642a38-4af2-43fd-8af0-88424322bb4d None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:16.105734 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17699afb-d705-4a67-a0f7-acbe20896c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:16.106390 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17699afb-d705-4a67-a0f7-acbe20896c08 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:16.106676 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17699afb-d705-4a67-a0f7-acbe20896c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:16.106956 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17699afb-d705-4a67-a0f7-acbe20896c08 None admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:16.107736 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17699afb-d705-4a67-a0f7-acbe20896c08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:16.108052 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17699afb-d705-4a67-a0f7-acbe20896c08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:16.109505 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17699afb-d705-4a67-a0f7-acbe20896c08 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:16.121773 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 563/1105] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:03:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:16.127681 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa5600-cafb-45a7-aa8a-de72caed6ae0 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:16.226296 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa5600-cafb-45a7-aa8a-de72caed6ae0 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:16.257814 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359f1ae-87e5-49dd-8610-f60f51457d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:16.258453 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359f1ae-87e5-49dd-8610-f60f51457d63 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:16.258733 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359f1ae-87e5-49dd-8610-f60f51457d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:16.259008 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359f1ae-87e5-49dd-8610-f60f51457d63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:16.259822 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359f1ae-87e5-49dd-8610-f60f51457d63 None admin] RBAC: Adding query filter params (role.id=cb894452030c4656aaa8ad80b903bef6, scope.project.id=ec1f2c5cb900473da1083830387e3ff4, user.id=b797e15939694c9abf1f2b8e9aee4d67) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:16.260129 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359f1ae-87e5-49dd-8610-f60f51457d63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:16.261558 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359f1ae-87e5-49dd-8610-f60f51457d63 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:16.267061 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 543/1106] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:03:16 2022] GET /identity/v3/role_assignments?user.id=b797e15939694c9abf1f2b8e9aee4d67&scope.project.id=ec1f2c5cb900473da1083830387e3ff4&role.id=cb894452030c4656aaa8ad80b903bef6 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:17.947141 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866092e-cb17-4297-8e2a-cdcdc39f0085 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:17.947624 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866092e-cb17-4297-8e2a-cdcdc39f0085 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:17.947732 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866092e-cb17-4297-8e2a-cdcdc39f0085 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:17.949503 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 564/1107] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:03:17.954559 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a14a2-ecd2-4d99-b782-24152ef11106 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:17.954947 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a14a2-ecd2-4d99-b782-24152ef11106 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:17.955114 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a14a2-ecd2-4d99-b782-24152ef11106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:17.972275 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-f87a14a2-ecd2-4d99-b782-24152ef11106 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:17.973665 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-f87a14a2-ecd2-4d99-b782-24152ef11106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:18.036911 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 544/1108] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 20:03:18.061692 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866092e-cb17-4297-8e2a-cdcdc39f0085 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:18.156685 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866092e-cb17-4297-8e2a-cdcdc39f0085 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:18.188136 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278082a4-e1fe-4fad-922d-0af7b332b958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:18.188852 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278082a4-e1fe-4fad-922d-0af7b332b958 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:18.189132 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278082a4-e1fe-4fad-922d-0af7b332b958 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:18.189434 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278082a4-e1fe-4fad-922d-0af7b332b958 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:18.190574 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278082a4-e1fe-4fad-922d-0af7b332b958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:18.192197 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278082a4-e1fe-4fad-922d-0af7b332b958 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:18.194083 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 565/1109] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:03:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:03:18.199873 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a14a2-ecd2-4d99-b782-24152ef11106 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:18.296069 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a14a2-ecd2-4d99-b782-24152ef11106 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:18.328099 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a664a-852e-49c4-a949-75399d97bcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:18.328763 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a664a-852e-49c4-a949-75399d97bcb4 None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:18.329054 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a664a-852e-49c4-a949-75399d97bcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:18.329360 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a664a-852e-49c4-a949-75399d97bcb4 None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:18.330079 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a664a-852e-49c4-a949-75399d97bcb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:18.331497 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a664a-852e-49c4-a949-75399d97bcb4 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:18.451577 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 545/1110] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Mar 29 20:03:18 2022] POST /identity/v3/users => generated 286 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:03:20.809244 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7208df-71a0-4c55-bfa9-e50df6a303b8 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:20.809810 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7208df-71a0-4c55-bfa9-e50df6a303b8 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:20.809810 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7208df-71a0-4c55-bfa9-e50df6a303b8 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:20.811614 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 566/1111] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:03:20.816690 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050eff1-1f47-4a67-b889-0ac86fcdcc60 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:20.817767 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050eff1-1f47-4a67-b889-0ac86fcdcc60 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:20.817898 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050eff1-1f47-4a67-b889-0ac86fcdcc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:20.835265 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-6050eff1-1f47-4a67-b889-0ac86fcdcc60 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:20.836445 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-6050eff1-1f47-4a67-b889-0ac86fcdcc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:20.899146 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 546/1112] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:03:20.922657 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7208df-71a0-4c55-bfa9-e50df6a303b8 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:21.021256 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7208df-71a0-4c55-bfa9-e50df6a303b8 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:21.052614 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee674d-ba99-484f-9147-e90845ee9ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:21.053485 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee674d-ba99-484f-9147-e90845ee9ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:21.053772 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee674d-ba99-484f-9147-e90845ee9ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:21.054054 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee674d-ba99-484f-9147-e90845ee9ae5 None admin] PATH_INFO: `/v3/roles/82747af757b549cbaa39504334f32f9f` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:21.055517 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee674d-ba99-484f-9147-e90845ee9ae5 None admin] RBAC: Authorizing `identity:get_role(role_id=82747af757b549cbaa39504334f32f9f)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:21.056898 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee674d-ba99-484f-9147-e90845ee9ae5 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:21.058312 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 567/1113] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:03:20 2022] GET /identity/v3/roles/82747af757b549cbaa39504334f32f9f => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:21.064113 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050eff1-1f47-4a67-b889-0ac86fcdcc60 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:21.158862 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050eff1-1f47-4a67-b889-0ac86fcdcc60 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:21.191039 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e882e8b-9f33-44f3-8e2c-5c9e940ecf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:21.192756 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e882e8b-9f33-44f3-8e2c-5c9e940ecf1c None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:21.192756 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e882e8b-9f33-44f3-8e2c-5c9e940ecf1c None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:21.193051 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e882e8b-9f33-44f3-8e2c-5c9e940ecf1c None admin] PATH_INFO: `/v3/users/9af821672ed14b6393b5afb1b6504d28` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:21.206391 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e882e8b-9f33-44f3-8e2c-5c9e940ecf1c None admin] RBAC: Authorizing `identity:get_user(user_id=9af821672ed14b6393b5afb1b6504d28)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:21.207846 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e882e8b-9f33-44f3-8e2c-5c9e940ecf1c None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:21.209494 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 547/1114] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:03:21 2022] GET /identity/v3/users/9af821672ed14b6393b5afb1b6504d28 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:21.215290 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee674d-ba99-484f-9147-e90845ee9ae5 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:21.308306 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee674d-ba99-484f-9147-e90845ee9ae5 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:21.340290 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1b558-cfa7-4352-a1f0-7fff3a8800f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:21.340863 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1b558-cfa7-4352-a1f0-7fff3a8800f9 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:21.341145 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1b558-cfa7-4352-a1f0-7fff3a8800f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:21.341449 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1b558-cfa7-4352-a1f0-7fff3a8800f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:21.413427 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1b558-cfa7-4352-a1f0-7fff3a8800f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:21.414865 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1b558-cfa7-4352-a1f0-7fff3a8800f9 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:21.516937 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 568/1115] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:03:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 20:03:21.523466 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e882e8b-9f33-44f3-8e2c-5c9e940ecf1c None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:21.738504 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e882e8b-9f33-44f3-8e2c-5c9e940ecf1c None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:21.770717 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b337381-17e9-4c83-a72c-cd3f2e370728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:21.771559 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b337381-17e9-4c83-a72c-cd3f2e370728 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:21.771843 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b337381-17e9-4c83-a72c-cd3f2e370728 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:21.772114 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b337381-17e9-4c83-a72c-cd3f2e370728 None admin] PATH_INFO: `/v3/projects/9357af5231ee4117816f632758044983` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:21.773279 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b337381-17e9-4c83-a72c-cd3f2e370728 None admin] RBAC: Authorizing `identity:get_project(project_id=9357af5231ee4117816f632758044983)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:21.774711 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b337381-17e9-4c83-a72c-cd3f2e370728 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:21.776375 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 548/1116] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:03:21 2022] GET /identity/v3/projects/9357af5231ee4117816f632758044983 => generated 311 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:21.782466 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1b558-cfa7-4352-a1f0-7fff3a8800f9 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:21.876336 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1b558-cfa7-4352-a1f0-7fff3a8800f9 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:21.908900 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0193b-ef71-447e-9da7-c2e1320ba806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:21.909590 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0193b-ef71-447e-9da7-c2e1320ba806 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:21.909880 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0193b-ef71-447e-9da7-c2e1320ba806 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:21.910182 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0193b-ef71-447e-9da7-c2e1320ba806 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:21.912034 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0193b-ef71-447e-9da7-c2e1320ba806 None admin] RBAC: Adding query filter params (role.id=82747af757b549cbaa39504334f32f9f, scope.project.id=9357af5231ee4117816f632758044983, user.id=9af821672ed14b6393b5afb1b6504d28) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:21.912356 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0193b-ef71-447e-9da7-c2e1320ba806 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:21.913815 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0193b-ef71-447e-9da7-c2e1320ba806 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:21.918983 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 569/1117] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:03:21 2022] GET /identity/v3/role_assignments?user.id=9af821672ed14b6393b5afb1b6504d28&scope.project.id=9357af5231ee4117816f632758044983&role.id=82747af757b549cbaa39504334f32f9f => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:24.180375 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631e359-562e-4d46-afc3-2cf445274162 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:24.180928 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631e359-562e-4d46-afc3-2cf445274162 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:24.180928 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631e359-562e-4d46-afc3-2cf445274162 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:24.182798 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 549/1118] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:03:24.187891 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951a1e1-01b5-46d8-8222-c2761a72e243 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:24.188340 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951a1e1-01b5-46d8-8222-c2761a72e243 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:24.188444 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951a1e1-01b5-46d8-8222-c2761a72e243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:24.205795 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-6951a1e1-01b5-46d8-8222-c2761a72e243 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:24.206971 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-6951a1e1-01b5-46d8-8222-c2761a72e243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:24.269662 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 570/1119] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:03:24.292546 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631e359-562e-4d46-afc3-2cf445274162 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:24.388384 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631e359-562e-4d46-afc3-2cf445274162 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:24.419247 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efca44-c004-4a5a-8e41-d639900fd72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:24.420071 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efca44-c004-4a5a-8e41-d639900fd72f None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:24.420348 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efca44-c004-4a5a-8e41-d639900fd72f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:24.420618 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efca44-c004-4a5a-8e41-d639900fd72f None admin] PATH_INFO: `/v3/roles/82747af757b549cbaa39504334f32f9f` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:24.422081 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0efca44-c004-4a5a-8e41-d639900fd72f None admin] RBAC: Authorizing `identity:get_role(role_id=82747af757b549cbaa39504334f32f9f)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:24.423417 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0efca44-c004-4a5a-8e41-d639900fd72f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:24.424720 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 550/1120] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:03:24 2022] GET /identity/v3/roles/82747af757b549cbaa39504334f32f9f => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:24.431210 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951a1e1-01b5-46d8-8222-c2761a72e243 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:24.524573 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951a1e1-01b5-46d8-8222-c2761a72e243 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:24.557576 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af822e-c80f-4d6d-8658-d5e9fb0dce75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:24.558422 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af822e-c80f-4d6d-8658-d5e9fb0dce75 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:24.558700 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af822e-c80f-4d6d-8658-d5e9fb0dce75 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:24.558973 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af822e-c80f-4d6d-8658-d5e9fb0dce75 None admin] PATH_INFO: `/v3/users/9af821672ed14b6393b5afb1b6504d28` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:24.560124 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af822e-c80f-4d6d-8658-d5e9fb0dce75 None admin] RBAC: Authorizing `identity:get_user(user_id=9af821672ed14b6393b5afb1b6504d28)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:24.561581 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af822e-c80f-4d6d-8658-d5e9fb0dce75 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:24.563143 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 571/1121] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:03:24 2022] GET /identity/v3/users/9af821672ed14b6393b5afb1b6504d28 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:24.568819 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efca44-c004-4a5a-8e41-d639900fd72f None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:24.662994 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efca44-c004-4a5a-8e41-d639900fd72f None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:24.695363 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751c814-b01b-4a49-a44d-9a6a86e3cafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:24.696450 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751c814-b01b-4a49-a44d-9a6a86e3cafa None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:24.696728 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751c814-b01b-4a49-a44d-9a6a86e3cafa None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:24.697000 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751c814-b01b-4a49-a44d-9a6a86e3cafa None admin] PATH_INFO: `/v3/projects/9357af5231ee4117816f632758044983` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:24.698173 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751c814-b01b-4a49-a44d-9a6a86e3cafa None admin] RBAC: Authorizing `identity:get_project(project_id=9357af5231ee4117816f632758044983)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:24.699566 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751c814-b01b-4a49-a44d-9a6a86e3cafa None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:24.701182 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 551/1122] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:03:24 2022] GET /identity/v3/projects/9357af5231ee4117816f632758044983 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:24.706993 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af822e-c80f-4d6d-8658-d5e9fb0dce75 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:24.799501 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af822e-c80f-4d6d-8658-d5e9fb0dce75 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:24.831997 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9f96a-280d-4b99-923e-c33f40d96b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:24.833454 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9f96a-280d-4b99-923e-c33f40d96b98 None admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:24.833740 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9f96a-280d-4b99-923e-c33f40d96b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:24.834017 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9f96a-280d-4b99-923e-c33f40d96b98 None admin] PATH_INFO: `/v3/projects/9357af5231ee4117816f632758044983/users/9af821672ed14b6393b5afb1b6504d28/roles/82747af757b549cbaa39504334f32f9f` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:24.836179 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9f96a-280d-4b99-923e-c33f40d96b98 None admin] RBAC: Authorizing `identity:create_grant(project_id=9357af5231ee4117816f632758044983, user_id=9af821672ed14b6393b5afb1b6504d28, role_id=82747af757b549cbaa39504334f32f9f)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:24.837619 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9f96a-280d-4b99-923e-c33f40d96b98 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:24.899917 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 572/1123] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Mar 29 20:03:24 2022] PUT /identity/v3/projects/9357af5231ee4117816f632758044983/users/9af821672ed14b6393b5afb1b6504d28/roles/82747af757b549cbaa39504334f32f9f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:03:27.154301 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa18f08-921d-4598-95bc-e9e68637c0a6 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:27.154831 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa18f08-921d-4598-95bc-e9e68637c0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:27.154923 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa18f08-921d-4598-95bc-e9e68637c0a6 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:27.156630 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 552/1124] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:03:27.162305 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde26d85-ed3f-4044-bf3a-a3027bbc9bdf None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:27.162751 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde26d85-ed3f-4044-bf3a-a3027bbc9bdf None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:27.162861 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde26d85-ed3f-4044-bf3a-a3027bbc9bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:27.179314 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-cde26d85-ed3f-4044-bf3a-a3027bbc9bdf None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:27.180481 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-cde26d85-ed3f-4044-bf3a-a3027bbc9bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:27.242935 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 573/1125] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 20:03:27.266457 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa18f08-921d-4598-95bc-e9e68637c0a6 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:27.361206 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa18f08-921d-4598-95bc-e9e68637c0a6 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:27.392890 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb9a36-ae14-4034-ac78-1c95bc9fd02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:27.393749 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb9a36-ae14-4034-ac78-1c95bc9fd02e None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:27.394036 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb9a36-ae14-4034-ac78-1c95bc9fd02e None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:27.394315 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb9a36-ae14-4034-ac78-1c95bc9fd02e None admin] PATH_INFO: `/v3/roles/82747af757b549cbaa39504334f32f9f` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:27.396507 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb9a36-ae14-4034-ac78-1c95bc9fd02e None admin] RBAC: Authorizing `identity:get_role(role_id=82747af757b549cbaa39504334f32f9f)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:27.397916 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb9a36-ae14-4034-ac78-1c95bc9fd02e None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:27.399230 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 553/1126] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:03:27 2022] GET /identity/v3/roles/82747af757b549cbaa39504334f32f9f => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:27.404961 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde26d85-ed3f-4044-bf3a-a3027bbc9bdf None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:27.497852 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde26d85-ed3f-4044-bf3a-a3027bbc9bdf None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:27.530090 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45861b97-739c-492b-8c58-8ecf5bdd12d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:27.530945 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45861b97-739c-492b-8c58-8ecf5bdd12d6 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:27.531230 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45861b97-739c-492b-8c58-8ecf5bdd12d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:27.531505 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45861b97-739c-492b-8c58-8ecf5bdd12d6 None admin] PATH_INFO: `/v3/users/9af821672ed14b6393b5afb1b6504d28` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:27.532667 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45861b97-739c-492b-8c58-8ecf5bdd12d6 None admin] RBAC: Authorizing `identity:get_user(user_id=9af821672ed14b6393b5afb1b6504d28)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:27.534114 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45861b97-739c-492b-8c58-8ecf5bdd12d6 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:27.535767 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 574/1127] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:03:27 2022] GET /identity/v3/users/9af821672ed14b6393b5afb1b6504d28 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:27.541683 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb9a36-ae14-4034-ac78-1c95bc9fd02e None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:27.634462 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb9a36-ae14-4034-ac78-1c95bc9fd02e None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:27.666265 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9176998-ca41-4fe1-a6e1-1f60749b047f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:27.666896 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9176998-ca41-4fe1-a6e1-1f60749b047f None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:27.667183 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9176998-ca41-4fe1-a6e1-1f60749b047f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:27.667460 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9176998-ca41-4fe1-a6e1-1f60749b047f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:27.731359 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9176998-ca41-4fe1-a6e1-1f60749b047f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:27.732784 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9176998-ca41-4fe1-a6e1-1f60749b047f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:27.824702 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 554/1128] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:03:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 20:03:27.830507 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45861b97-739c-492b-8c58-8ecf5bdd12d6 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:27.923744 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45861b97-739c-492b-8c58-8ecf5bdd12d6 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:27.956700 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b940506-c5a1-48d2-9e53-5c00a37ec09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:27.958565 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b940506-c5a1-48d2-9e53-5c00a37ec09e None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:27.958846 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b940506-c5a1-48d2-9e53-5c00a37ec09e None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:27.959124 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b940506-c5a1-48d2-9e53-5c00a37ec09e None admin] PATH_INFO: `/v3/projects/9357af5231ee4117816f632758044983` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:27.960281 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b940506-c5a1-48d2-9e53-5c00a37ec09e None admin] RBAC: Authorizing `identity:get_project(project_id=9357af5231ee4117816f632758044983)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:27.961740 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b940506-c5a1-48d2-9e53-5c00a37ec09e None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:27.963398 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 575/1129] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:03:27 2022] GET /identity/v3/projects/9357af5231ee4117816f632758044983 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:27.969524 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9176998-ca41-4fe1-a6e1-1f60749b047f None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:28.063721 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9176998-ca41-4fe1-a6e1-1f60749b047f None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:28.096185 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33508e11-f3a0-409a-a5f4-fc2a54faaac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:28.096771 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33508e11-f3a0-409a-a5f4-fc2a54faaac6 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:28.097056 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33508e11-f3a0-409a-a5f4-fc2a54faaac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:28.097359 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33508e11-f3a0-409a-a5f4-fc2a54faaac6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:28.098310 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33508e11-f3a0-409a-a5f4-fc2a54faaac6 None admin] RBAC: Adding query filter params (role.id=82747af757b549cbaa39504334f32f9f, scope.project.id=9357af5231ee4117816f632758044983, user.id=9af821672ed14b6393b5afb1b6504d28) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:28.098615 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33508e11-f3a0-409a-a5f4-fc2a54faaac6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:28.100021 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33508e11-f3a0-409a-a5f4-fc2a54faaac6 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:28.105609 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 555/1130] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:03:27 2022] GET /identity/v3/role_assignments?user.id=9af821672ed14b6393b5afb1b6504d28&scope.project.id=9357af5231ee4117816f632758044983&role.id=82747af757b549cbaa39504334f32f9f => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:30.399410 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1132e11-d3e5-425e-8a29-9663ce68b9c6 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:30.400025 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1132e11-d3e5-425e-8a29-9663ce68b9c6 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:30.400025 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1132e11-d3e5-425e-8a29-9663ce68b9c6 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:30.401809 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 576/1131] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:03:30.406981 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a97b12-2466-40a0-9389-80ed32796ca5 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:30.407415 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a97b12-2466-40a0-9389-80ed32796ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:30.407556 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a97b12-2466-40a0-9389-80ed32796ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:30.424374 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-28a97b12-2466-40a0-9389-80ed32796ca5 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:30.426114 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-28a97b12-2466-40a0-9389-80ed32796ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:30.490439 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 556/1132] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:03:30.513474 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1132e11-d3e5-425e-8a29-9663ce68b9c6 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:30.609538 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1132e11-d3e5-425e-8a29-9663ce68b9c6 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:30.641807 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c04f3a-6c9c-49af-a471-3aca25af075c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:30.642584 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c04f3a-6c9c-49af-a471-3aca25af075c None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:30.642868 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c04f3a-6c9c-49af-a471-3aca25af075c None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:30.643146 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c04f3a-6c9c-49af-a471-3aca25af075c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:30.644355 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c04f3a-6c9c-49af-a471-3aca25af075c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:30.645827 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c04f3a-6c9c-49af-a471-3aca25af075c None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:30.647402 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 577/1133] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:03:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:30.653077 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a97b12-2466-40a0-9389-80ed32796ca5 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:30.750955 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a97b12-2466-40a0-9389-80ed32796ca5 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:30.782612 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32b858-7691-4d1e-9943-57ed35e53712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:30.783261 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32b858-7691-4d1e-9943-57ed35e53712 None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:30.783545 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32b858-7691-4d1e-9943-57ed35e53712 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:30.783819 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32b858-7691-4d1e-9943-57ed35e53712 None admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:30.784528 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32b858-7691-4d1e-9943-57ed35e53712 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:30.786500 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32b858-7691-4d1e-9943-57ed35e53712 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:30.885071 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 557/1134] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Mar 29 20:03:30 2022] POST /identity/v3/projects => generated 311 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:03:33.255740 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5a524-f2d4-4f4a-a7a7-2bdcd3b0ecf9 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:33.256278 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5a524-f2d4-4f4a-a7a7-2bdcd3b0ecf9 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:33.256278 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5a524-f2d4-4f4a-a7a7-2bdcd3b0ecf9 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:33.258137 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 578/1135] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:03:33.263264 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f11dc4-57a3-49f3-a117-be2247604a66 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:33.263662 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f11dc4-57a3-49f3-a117-be2247604a66 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:33.263831 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f11dc4-57a3-49f3-a117-be2247604a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:33.280116 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-67f11dc4-57a3-49f3-a117-be2247604a66 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:33.281338 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-67f11dc4-57a3-49f3-a117-be2247604a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:33.344011 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 558/1136] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:03:33.368959 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5a524-f2d4-4f4a-a7a7-2bdcd3b0ecf9 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:33.465975 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5a524-f2d4-4f4a-a7a7-2bdcd3b0ecf9 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:33.500067 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eab802-bb9a-44c8-80b4-f984d03dc8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:33.500845 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eab802-bb9a-44c8-80b4-f984d03dc8fa None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:33.501131 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eab802-bb9a-44c8-80b4-f984d03dc8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:33.501442 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eab802-bb9a-44c8-80b4-f984d03dc8fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:33.502605 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eab802-bb9a-44c8-80b4-f984d03dc8fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:33.504296 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eab802-bb9a-44c8-80b4-f984d03dc8fa None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:33.505985 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 579/1137] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:03:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:33.511653 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f11dc4-57a3-49f3-a117-be2247604a66 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:33.605125 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f11dc4-57a3-49f3-a117-be2247604a66 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:33.636797 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726fd90-c292-44a3-98c2-64e3a0dd3525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:33.637473 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726fd90-c292-44a3-98c2-64e3a0dd3525 None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:33.637758 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726fd90-c292-44a3-98c2-64e3a0dd3525 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:33.638034 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726fd90-c292-44a3-98c2-64e3a0dd3525 None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:33.638728 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726fd90-c292-44a3-98c2-64e3a0dd3525 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:33.640130 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726fd90-c292-44a3-98c2-64e3a0dd3525 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:33.754098 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 559/1138] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Mar 29 20:03:33 2022] POST /identity/v3/users => generated 286 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:03:36.072040 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522061e-0140-4832-b435-bf282005467c None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:36.072607 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522061e-0140-4832-b435-bf282005467c None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:36.072607 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522061e-0140-4832-b435-bf282005467c None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:36.074396 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 580/1139] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:03:36.079479 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb653c-2b5d-4296-8595-51b070574ea8 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:36.079864 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb653c-2b5d-4296-8595-51b070574ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:36.080049 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb653c-2b5d-4296-8595-51b070574ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:36.097834 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-68fb653c-2b5d-4296-8595-51b070574ea8 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:36.099010 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-68fb653c-2b5d-4296-8595-51b070574ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:36.162038 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 560/1140] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:03:36.185986 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522061e-0140-4832-b435-bf282005467c None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:36.282728 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522061e-0140-4832-b435-bf282005467c None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:36.314630 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dd311-63c7-43e2-a1f0-a7505dc25040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:36.315398 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dd311-63c7-43e2-a1f0-a7505dc25040 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:36.315683 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dd311-63c7-43e2-a1f0-a7505dc25040 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:36.316013 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dd311-63c7-43e2-a1f0-a7505dc25040 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:36.325833 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75dd311-63c7-43e2-a1f0-a7505dc25040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:03:36.333217 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-d75dd311-63c7-43e2-a1f0-a7505dc25040 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:03:36.334394 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 581/1141] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:03:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:03:36.340262 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb653c-2b5d-4296-8595-51b070574ea8 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:36.433411 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb653c-2b5d-4296-8595-51b070574ea8 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:36.465816 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af30f1f-e9a2-46d5-a97c-22bedeaee82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:36.466415 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af30f1f-e9a2-46d5-a97c-22bedeaee82a None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:36.466699 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af30f1f-e9a2-46d5-a97c-22bedeaee82a None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:36.466973 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af30f1f-e9a2-46d5-a97c-22bedeaee82a None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:36.467712 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af30f1f-e9a2-46d5-a97c-22bedeaee82a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:36.468020 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af30f1f-e9a2-46d5-a97c-22bedeaee82a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:36.469401 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af30f1f-e9a2-46d5-a97c-22bedeaee82a None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:36.477621 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 561/1142] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:03:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:36.483347 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dd311-63c7-43e2-a1f0-a7505dc25040 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:36.577461 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dd311-63c7-43e2-a1f0-a7505dc25040 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:36.608914 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ab92e-bf50-4024-b81a-8caddc766c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:36.609785 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ab92e-bf50-4024-b81a-8caddc766c20 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:36.610070 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ab92e-bf50-4024-b81a-8caddc766c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:36.610347 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ab92e-bf50-4024-b81a-8caddc766c20 None admin] PATH_INFO: `/v3/users/b75c93262e504f619e3e1e9902d74781` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:36.623381 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ab92e-bf50-4024-b81a-8caddc766c20 None admin] RBAC: Authorizing `identity:get_user(user_id=b75c93262e504f619e3e1e9902d74781)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:36.624805 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ab92e-bf50-4024-b81a-8caddc766c20 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:36.626431 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 582/1143] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:03:36 2022] GET /identity/v3/users/b75c93262e504f619e3e1e9902d74781 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:36.632007 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af30f1f-e9a2-46d5-a97c-22bedeaee82a None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:36.726796 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af30f1f-e9a2-46d5-a97c-22bedeaee82a None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:36.759663 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740f5b5-6884-468e-9a16-fcb9c175212f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:36.760312 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740f5b5-6884-468e-9a16-fcb9c175212f None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:36.760595 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740f5b5-6884-468e-9a16-fcb9c175212f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:36.760870 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740f5b5-6884-468e-9a16-fcb9c175212f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:36.824553 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740f5b5-6884-468e-9a16-fcb9c175212f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:36.826010 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740f5b5-6884-468e-9a16-fcb9c175212f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:36.917671 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 562/1144] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:03:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 20:03:36.923496 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ab92e-bf50-4024-b81a-8caddc766c20 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:37.020273 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ab92e-bf50-4024-b81a-8caddc766c20 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:37.053161 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecd339-d4fa-4213-841f-f13bc7117331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:37.054029 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecd339-d4fa-4213-841f-f13bc7117331 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:37.054311 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecd339-d4fa-4213-841f-f13bc7117331 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:37.054612 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecd339-d4fa-4213-841f-f13bc7117331 None admin] PATH_INFO: `/v3/projects/bd7de9b7ce4d4c04abd9465b8b983768` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:37.055762 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ecd339-d4fa-4213-841f-f13bc7117331 None admin] RBAC: Authorizing `identity:get_project(project_id=bd7de9b7ce4d4c04abd9465b8b983768)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:37.057172 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ecd339-d4fa-4213-841f-f13bc7117331 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:37.058855 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 583/1145] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:03:36 2022] GET /identity/v3/projects/bd7de9b7ce4d4c04abd9465b8b983768 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:37.064953 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740f5b5-6884-468e-9a16-fcb9c175212f None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:37.158832 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740f5b5-6884-468e-9a16-fcb9c175212f None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:37.192351 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e7da8-9e55-4e22-9ade-617a523c38da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:37.192989 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e7da8-9e55-4e22-9ade-617a523c38da None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:37.193275 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e7da8-9e55-4e22-9ade-617a523c38da None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:37.193589 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e7da8-9e55-4e22-9ade-617a523c38da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:37.194416 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e7da8-9e55-4e22-9ade-617a523c38da None admin] RBAC: Adding query filter params (role.id=8cfa924df1a1400986d9ecc9686a7f52, scope.project.id=bd7de9b7ce4d4c04abd9465b8b983768, user.id=b75c93262e504f619e3e1e9902d74781) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:37.194735 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e7da8-9e55-4e22-9ade-617a523c38da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:37.196405 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e7da8-9e55-4e22-9ade-617a523c38da None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:37.201579 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 563/1146] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:03:37 2022] GET /identity/v3/role_assignments?user.id=b75c93262e504f619e3e1e9902d74781&scope.project.id=bd7de9b7ce4d4c04abd9465b8b983768&role.id=8cfa924df1a1400986d9ecc9686a7f52 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:39.479711 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d7435-7f3f-47d0-80e8-ee33c74e9eb4 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:39.480252 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d7435-7f3f-47d0-80e8-ee33c74e9eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:39.480252 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d7435-7f3f-47d0-80e8-ee33c74e9eb4 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:39.482110 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 584/1147] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:03:39.487428 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e220ccb-9814-4ff3-bcbf-e21afe542d56 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:39.488895 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e220ccb-9814-4ff3-bcbf-e21afe542d56 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:39.488895 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e220ccb-9814-4ff3-bcbf-e21afe542d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:39.505418 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-1e220ccb-9814-4ff3-bcbf-e21afe542d56 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:39.506597 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-1e220ccb-9814-4ff3-bcbf-e21afe542d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:39.570558 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 564/1148] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:03:39.593535 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d7435-7f3f-47d0-80e8-ee33c74e9eb4 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:39.690269 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d7435-7f3f-47d0-80e8-ee33c74e9eb4 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:39.722681 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04cbea-d21f-424d-a587-5b5aef10f7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:39.723453 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04cbea-d21f-424d-a587-5b5aef10f7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:39.723742 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04cbea-d21f-424d-a587-5b5aef10f7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:39.724027 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04cbea-d21f-424d-a587-5b5aef10f7b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:39.733722 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04cbea-d21f-424d-a587-5b5aef10f7b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:03:39.741152 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-7f04cbea-d21f-424d-a587-5b5aef10f7b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:03:39.742328 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 585/1149] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:03:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:03:39.748166 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e220ccb-9814-4ff3-bcbf-e21afe542d56 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:39.840680 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e220ccb-9814-4ff3-bcbf-e21afe542d56 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:39.872861 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219bf4c-3e64-4543-a231-669d694ddb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:39.873648 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219bf4c-3e64-4543-a231-669d694ddb03 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:39.873930 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219bf4c-3e64-4543-a231-669d694ddb03 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:39.874205 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219bf4c-3e64-4543-a231-669d694ddb03 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:39.874938 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219bf4c-3e64-4543-a231-669d694ddb03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:39.875241 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219bf4c-3e64-4543-a231-669d694ddb03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:39.876675 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219bf4c-3e64-4543-a231-669d694ddb03 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:39.885303 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 565/1150] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:03:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:39.891057 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04cbea-d21f-424d-a587-5b5aef10f7b4 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:39.988734 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04cbea-d21f-424d-a587-5b5aef10f7b4 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:40.021178 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686be283-8528-4a44-a021-80ded26c9b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:40.023277 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686be283-8528-4a44-a021-80ded26c9b69 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:40.023277 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686be283-8528-4a44-a021-80ded26c9b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:40.023277 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686be283-8528-4a44-a021-80ded26c9b69 None admin] PATH_INFO: `/v3/users/b75c93262e504f619e3e1e9902d74781` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:40.025200 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686be283-8528-4a44-a021-80ded26c9b69 None admin] RBAC: Authorizing `identity:get_user(user_id=b75c93262e504f619e3e1e9902d74781)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:40.026669 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686be283-8528-4a44-a021-80ded26c9b69 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:40.028295 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 586/1151] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:03:39 2022] GET /identity/v3/users/b75c93262e504f619e3e1e9902d74781 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:40.034436 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219bf4c-3e64-4543-a231-669d694ddb03 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:40.132573 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219bf4c-3e64-4543-a231-669d694ddb03 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:40.163524 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107990f-aec2-49bd-ad19-8c32e3805431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:40.164357 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107990f-aec2-49bd-ad19-8c32e3805431 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:40.164637 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107990f-aec2-49bd-ad19-8c32e3805431 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:40.164910 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107990f-aec2-49bd-ad19-8c32e3805431 None admin] PATH_INFO: `/v3/projects/bd7de9b7ce4d4c04abd9465b8b983768` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:40.166081 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107990f-aec2-49bd-ad19-8c32e3805431 None admin] RBAC: Authorizing `identity:get_project(project_id=bd7de9b7ce4d4c04abd9465b8b983768)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:40.167481 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107990f-aec2-49bd-ad19-8c32e3805431 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:40.169121 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 566/1152] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:03:40 2022] GET /identity/v3/projects/bd7de9b7ce4d4c04abd9465b8b983768 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:40.175689 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686be283-8528-4a44-a021-80ded26c9b69 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:40.271003 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686be283-8528-4a44-a021-80ded26c9b69 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:40.302846 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4cb24-1150-4673-98fa-4bcf0d4807c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:40.303719 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4cb24-1150-4673-98fa-4bcf0d4807c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:40.304001 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4cb24-1150-4673-98fa-4bcf0d4807c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:40.304280 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4cb24-1150-4673-98fa-4bcf0d4807c1 None admin] PATH_INFO: `/v3/projects/bd7de9b7ce4d4c04abd9465b8b983768/users/b75c93262e504f619e3e1e9902d74781/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:40.306227 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4cb24-1150-4673-98fa-4bcf0d4807c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd7de9b7ce4d4c04abd9465b8b983768, user_id=b75c93262e504f619e3e1e9902d74781, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:40.307642 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4cb24-1150-4673-98fa-4bcf0d4807c1 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:40.396294 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 587/1153] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Mar 29 20:03:40 2022] PUT /identity/v3/projects/bd7de9b7ce4d4c04abd9465b8b983768/users/b75c93262e504f619e3e1e9902d74781/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:03:42.651049 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fe9de-8ebb-450f-8b50-cebb9feee03c None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:42.651612 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fe9de-8ebb-450f-8b50-cebb9feee03c None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:42.651612 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fe9de-8ebb-450f-8b50-cebb9feee03c None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:42.653473 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 567/1154] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:03:42.658611 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d86d3-be4f-49b1-9469-6851383e4476 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:42.659034 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d86d3-be4f-49b1-9469-6851383e4476 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:42.659705 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d86d3-be4f-49b1-9469-6851383e4476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:42.676702 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-5e4d86d3-be4f-49b1-9469-6851383e4476 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:42.677919 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-5e4d86d3-be4f-49b1-9469-6851383e4476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:42.741870 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 588/1155] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:03:42.764941 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fe9de-8ebb-450f-8b50-cebb9feee03c None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:42.867004 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fe9de-8ebb-450f-8b50-cebb9feee03c None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:42.898713 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599fbe5-39ba-4a3c-8007-18d11e698a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:42.899498 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599fbe5-39ba-4a3c-8007-18d11e698a7a None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:42.899784 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599fbe5-39ba-4a3c-8007-18d11e698a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:42.900063 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599fbe5-39ba-4a3c-8007-18d11e698a7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:42.910334 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599fbe5-39ba-4a3c-8007-18d11e698a7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:03:42.917063 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-1599fbe5-39ba-4a3c-8007-18d11e698a7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:03:42.918248 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 568/1156] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:03:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:03:42.924418 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d86d3-be4f-49b1-9469-6851383e4476 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:43.021832 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d86d3-be4f-49b1-9469-6851383e4476 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:43.054873 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b9900-8f56-4527-8f2e-033f250098d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:43.055543 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b9900-8f56-4527-8f2e-033f250098d3 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:43.055829 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b9900-8f56-4527-8f2e-033f250098d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:43.056109 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b9900-8f56-4527-8f2e-033f250098d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:43.056841 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b9900-8f56-4527-8f2e-033f250098d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:43.057152 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b9900-8f56-4527-8f2e-033f250098d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:43.058551 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b9900-8f56-4527-8f2e-033f250098d3 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:43.066936 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 589/1157] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:03:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:43.073353 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599fbe5-39ba-4a3c-8007-18d11e698a7a None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:43.167914 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599fbe5-39ba-4a3c-8007-18d11e698a7a None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:43.200831 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1977ca7-b202-4855-b4d3-1de9cdb37ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:43.201723 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1977ca7-b202-4855-b4d3-1de9cdb37ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:43.202010 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1977ca7-b202-4855-b4d3-1de9cdb37ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:43.202288 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1977ca7-b202-4855-b4d3-1de9cdb37ab8 None admin] PATH_INFO: `/v3/users/b75c93262e504f619e3e1e9902d74781` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:43.203466 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1977ca7-b202-4855-b4d3-1de9cdb37ab8 None admin] RBAC: Authorizing `identity:get_user(user_id=b75c93262e504f619e3e1e9902d74781)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:43.204887 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1977ca7-b202-4855-b4d3-1de9cdb37ab8 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:43.206891 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 569/1158] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:03:43 2022] GET /identity/v3/users/b75c93262e504f619e3e1e9902d74781 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:43.212568 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b9900-8f56-4527-8f2e-033f250098d3 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:43.307895 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b9900-8f56-4527-8f2e-033f250098d3 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:43.339154 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8badd6-9b99-49eb-9cd4-2f4699ff8ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:43.339795 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8badd6-9b99-49eb-9cd4-2f4699ff8ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:43.340079 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8badd6-9b99-49eb-9cd4-2f4699ff8ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:43.340356 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8badd6-9b99-49eb-9cd4-2f4699ff8ff3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:43.403650 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8badd6-9b99-49eb-9cd4-2f4699ff8ff3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:43.405085 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8badd6-9b99-49eb-9cd4-2f4699ff8ff3 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:43.498256 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 590/1159] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:03:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 20:03:43.504341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1977ca7-b202-4855-b4d3-1de9cdb37ab8 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:43.604880 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1977ca7-b202-4855-b4d3-1de9cdb37ab8 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:43.636245 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f6b57-0361-49a8-999d-d6cd5ad9930c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:43.637082 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f6b57-0361-49a8-999d-d6cd5ad9930c None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:43.637388 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f6b57-0361-49a8-999d-d6cd5ad9930c None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:43.637663 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f6b57-0361-49a8-999d-d6cd5ad9930c None admin] PATH_INFO: `/v3/projects/bd7de9b7ce4d4c04abd9465b8b983768` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:43.638816 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f6b57-0361-49a8-999d-d6cd5ad9930c None admin] RBAC: Authorizing `identity:get_project(project_id=bd7de9b7ce4d4c04abd9465b8b983768)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:43.640227 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f6b57-0361-49a8-999d-d6cd5ad9930c None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:43.641895 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 570/1160] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:03:43 2022] GET /identity/v3/projects/bd7de9b7ce4d4c04abd9465b8b983768 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:03:43.648890 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8badd6-9b99-49eb-9cd4-2f4699ff8ff3 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:43.744890 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8badd6-9b99-49eb-9cd4-2f4699ff8ff3 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:43.777848 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605575b2-4fbd-4c2d-818d-98fa177bbb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:43.778435 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605575b2-4fbd-4c2d-818d-98fa177bbb1a None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:43.778721 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605575b2-4fbd-4c2d-818d-98fa177bbb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:43.779001 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605575b2-4fbd-4c2d-818d-98fa177bbb1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:43.779815 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605575b2-4fbd-4c2d-818d-98fa177bbb1a None admin] RBAC: Adding query filter params (role.id=8cfa924df1a1400986d9ecc9686a7f52, scope.project.id=bd7de9b7ce4d4c04abd9465b8b983768, user.id=b75c93262e504f619e3e1e9902d74781) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:43.780130 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605575b2-4fbd-4c2d-818d-98fa177bbb1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:43.781589 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605575b2-4fbd-4c2d-818d-98fa177bbb1a None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:43.787720 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 591/1161] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:03:43 2022] GET /identity/v3/role_assignments?user.id=b75c93262e504f619e3e1e9902d74781&scope.project.id=bd7de9b7ce4d4c04abd9465b8b983768&role.id=8cfa924df1a1400986d9ecc9686a7f52 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:46.068600 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d19c1-7562-4d21-91a7-e4a02369ceb1 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:46.069129 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d19c1-7562-4d21-91a7-e4a02369ceb1 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:46.069129 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d19c1-7562-4d21-91a7-e4a02369ceb1 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:46.071233 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 571/1162] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:03:46.076455 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c03663-56bb-419a-af67-7bac97c4e394 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:46.076878 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c03663-56bb-419a-af67-7bac97c4e394 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:46.077007 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c03663-56bb-419a-af67-7bac97c4e394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:46.093547 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-d0c03663-56bb-419a-af67-7bac97c4e394 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:46.094723 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-d0c03663-56bb-419a-af67-7bac97c4e394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:46.162537 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 592/1163] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:03:46.185206 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d19c1-7562-4d21-91a7-e4a02369ceb1 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:46.282538 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d19c1-7562-4d21-91a7-e4a02369ceb1 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:46.314763 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ec3cb-4726-4df7-ba8e-5bad229a9737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:46.315494 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ec3cb-4726-4df7-ba8e-5bad229a9737 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:46.315864 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ec3cb-4726-4df7-ba8e-5bad229a9737 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:46.316162 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ec3cb-4726-4df7-ba8e-5bad229a9737 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:46.378830 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ec3cb-4726-4df7-ba8e-5bad229a9737 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:46.380241 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ec3cb-4726-4df7-ba8e-5bad229a9737 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:46.477236 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 572/1164] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:03:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 20:03:46.483398 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c03663-56bb-419a-af67-7bac97c4e394 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:46.576258 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c03663-56bb-419a-af67-7bac97c4e394 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:46.608109 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ada06-96c4-4a01-9408-022306641a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:46.608895 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ada06-96c4-4a01-9408-022306641a63 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:46.609177 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ada06-96c4-4a01-9408-022306641a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:46.609477 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ada06-96c4-4a01-9408-022306641a63 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:46.615913 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ada06-96c4-4a01-9408-022306641a63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:46.617383 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ada06-96c4-4a01-9408-022306641a63 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:46.631675 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-f76ada06-96c4-4a01-9408-022306641a63 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Mar 29 20:03:46.632811 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 593/1165] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Mar 29 20:03:46 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:03:46.638751 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ec3cb-4726-4df7-ba8e-5bad229a9737 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:46.731317 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ec3cb-4726-4df7-ba8e-5bad229a9737 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:46.763238 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52abf6-4926-4b2a-a6c4-3630b01a404f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:46.763879 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52abf6-4926-4b2a-a6c4-3630b01a404f None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:46.764158 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52abf6-4926-4b2a-a6c4-3630b01a404f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:46.764432 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52abf6-4926-4b2a-a6c4-3630b01a404f None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:46.765135 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52abf6-4926-4b2a-a6c4-3630b01a404f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:46.765470 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52abf6-4926-4b2a-a6c4-3630b01a404f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:46.766815 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52abf6-4926-4b2a-a6c4-3630b01a404f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:46.773793 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 573/1166] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Mar 29 20:03:46 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:49.022636 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd220b6-6a1a-450d-9667-9c84f42608e1 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:49.023169 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd220b6-6a1a-450d-9667-9c84f42608e1 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:49.023169 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd220b6-6a1a-450d-9667-9c84f42608e1 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:49.024973 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 594/1167] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:03:49.030016 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22f168-2177-4c24-9cbf-0b12ac883849 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:49.030462 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22f168-2177-4c24-9cbf-0b12ac883849 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:49.030588 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22f168-2177-4c24-9cbf-0b12ac883849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:49.047260 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-9e22f168-2177-4c24-9cbf-0b12ac883849 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:49.048438 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9e22f168-2177-4c24-9cbf-0b12ac883849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:49.111426 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 574/1168] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:03:49.135223 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd220b6-6a1a-450d-9667-9c84f42608e1 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:49.233210 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd220b6-6a1a-450d-9667-9c84f42608e1 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:49.265451 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797080ba-701f-4212-8cf3-b4538c2bb13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:49.266090 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797080ba-701f-4212-8cf3-b4538c2bb13a None admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:49.266369 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797080ba-701f-4212-8cf3-b4538c2bb13a None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:49.266643 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797080ba-701f-4212-8cf3-b4538c2bb13a None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:49.267371 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797080ba-701f-4212-8cf3-b4538c2bb13a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:49.269321 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797080ba-701f-4212-8cf3-b4538c2bb13a None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:49.377041 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 595/1169] 10.222.0.43 () {60 vars in 1138 bytes} [Tue Mar 29 20:03:49 2022] POST /identity/v3/domains => generated 267 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:03:51.664780 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818987c-464a-4286-a252-07e71b4b9686 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:51.665382 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818987c-464a-4286-a252-07e71b4b9686 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:51.665382 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818987c-464a-4286-a252-07e71b4b9686 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:51.667157 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 575/1170] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:03:51.672343 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833f185-9786-43bb-b996-e76fc57e015e None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:51.672721 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833f185-9786-43bb-b996-e76fc57e015e None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:51.672905 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833f185-9786-43bb-b996-e76fc57e015e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:51.689890 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-e833f185-9786-43bb-b996-e76fc57e015e None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:51.691076 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e833f185-9786-43bb-b996-e76fc57e015e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:51.755368 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 596/1171] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:03:51.778334 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818987c-464a-4286-a252-07e71b4b9686 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:51.874466 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818987c-464a-4286-a252-07e71b4b9686 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:51.906511 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c41e6-e538-48ae-ba62-b3a02ef66e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:51.907348 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c41e6-e538-48ae-ba62-b3a02ef66e11 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:51.907633 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c41e6-e538-48ae-ba62-b3a02ef66e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:51.907910 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c41e6-e538-48ae-ba62-b3a02ef66e11 None admin] PATH_INFO: `/v3/domains/4b5d5c7cb0c848c5a88c30529e9329e7` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:51.918383 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c41e6-e538-48ae-ba62-b3a02ef66e11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4b5d5c7cb0c848c5a88c30529e9329e7)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:51.919745 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c41e6-e538-48ae-ba62-b3a02ef66e11 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:51.921344 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 576/1172] 10.222.0.43 () {56 vars in 1183 bytes} [Tue Mar 29 20:03:51 2022] GET /identity/v3/domains/4b5d5c7cb0c848c5a88c30529e9329e7 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:03:51.927228 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833f185-9786-43bb-b996-e76fc57e015e None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:52.022378 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833f185-9786-43bb-b996-e76fc57e015e None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:52.054877 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a790a1f-f258-40eb-ab59-0b9658b3549f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:52.055530 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a790a1f-f258-40eb-ab59-0b9658b3549f None admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:52.055811 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a790a1f-f258-40eb-ab59-0b9658b3549f None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:52.056087 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a790a1f-f258-40eb-ab59-0b9658b3549f None admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:52.056792 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a790a1f-f258-40eb-ab59-0b9658b3549f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:52.058272 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a790a1f-f258-40eb-ab59-0b9658b3549f None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:52.180160 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 597/1173] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Mar 29 20:03:51 2022] POST /identity/v3/projects => generated 361 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:03:54.474151 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49effa3c-8740-48a6-82a4-22b258000331 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:54.474727 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49effa3c-8740-48a6-82a4-22b258000331 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:54.474727 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49effa3c-8740-48a6-82a4-22b258000331 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:54.476504 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 577/1174] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:03:54.481755 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21df93-0a44-47ba-9cf7-5a2cae7ef08b None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:54.482154 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21df93-0a44-47ba-9cf7-5a2cae7ef08b None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:54.482329 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21df93-0a44-47ba-9cf7-5a2cae7ef08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:54.499506 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-5c21df93-0a44-47ba-9cf7-5a2cae7ef08b None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:54.500692 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-5c21df93-0a44-47ba-9cf7-5a2cae7ef08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:54.564356 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 598/1175] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:03:54.589373 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49effa3c-8740-48a6-82a4-22b258000331 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:54.687149 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49effa3c-8740-48a6-82a4-22b258000331 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:54.719125 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfdbfc-aba4-4a75-8c0e-db62949741e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:54.719958 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfdbfc-aba4-4a75-8c0e-db62949741e8 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:54.720236 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfdbfc-aba4-4a75-8c0e-db62949741e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:54.720507 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfdbfc-aba4-4a75-8c0e-db62949741e8 None admin] PATH_INFO: `/v3/domains/4b5d5c7cb0c848c5a88c30529e9329e7` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:54.722638 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfdbfc-aba4-4a75-8c0e-db62949741e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4b5d5c7cb0c848c5a88c30529e9329e7)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:54.724025 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfdbfc-aba4-4a75-8c0e-db62949741e8 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:54.725662 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 578/1176] 10.222.0.43 () {56 vars in 1183 bytes} [Tue Mar 29 20:03:54 2022] GET /identity/v3/domains/4b5d5c7cb0c848c5a88c30529e9329e7 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:54.731266 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21df93-0a44-47ba-9cf7-5a2cae7ef08b None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:54.825616 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21df93-0a44-47ba-9cf7-5a2cae7ef08b None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:54.858583 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e455e-0612-4f50-8ee8-d4f9fb152444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:54.859234 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e455e-0612-4f50-8ee8-d4f9fb152444 None admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:54.859515 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e455e-0612-4f50-8ee8-d4f9fb152444 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:54.859788 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e455e-0612-4f50-8ee8-d4f9fb152444 None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:54.860471 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e455e-0612-4f50-8ee8-d4f9fb152444 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:54.862400 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e455e-0612-4f50-8ee8-d4f9fb152444 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:54.935747 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 599/1177] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Mar 29 20:03:54 2022] POST /identity/v3/users => generated 311 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:03:57.268792 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e1be4-3f1c-4e03-9e93-8de823af6a00 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:57.269344 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e1be4-3f1c-4e03-9e93-8de823af6a00 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:57.269457 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e1be4-3f1c-4e03-9e93-8de823af6a00 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:57.271171 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 579/1178] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:03:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:03:57.276459 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb73d79-c416-48e5-8da3-beb3d5eb52b5 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:57.276834 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb73d79-c416-48e5-8da3-beb3d5eb52b5 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:57.277020 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb73d79-c416-48e5-8da3-beb3d5eb52b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:57.293845 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-ebb73d79-c416-48e5-8da3-beb3d5eb52b5 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:03:57.295007 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-ebb73d79-c416-48e5-8da3-beb3d5eb52b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:03:57.358451 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 600/1179] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:03:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:03:57.381610 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e1be4-3f1c-4e03-9e93-8de823af6a00 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:57.477023 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e1be4-3f1c-4e03-9e93-8de823af6a00 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:57.508312 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b16abf-9676-47c3-b05c-8eaeb5d039bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:57.509084 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b16abf-9676-47c3-b05c-8eaeb5d039bc None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:57.509398 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b16abf-9676-47c3-b05c-8eaeb5d039bc None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:57.509678 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b16abf-9676-47c3-b05c-8eaeb5d039bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:57.519801 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b16abf-9676-47c3-b05c-8eaeb5d039bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:03:57.526598 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-c9b16abf-9676-47c3-b05c-8eaeb5d039bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:03:57.527750 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 580/1180] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:03:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:03:57.534607 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb73d79-c416-48e5-8da3-beb3d5eb52b5 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:57.630761 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb73d79-c416-48e5-8da3-beb3d5eb52b5 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:57.663177 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6167c9-bf92-4f29-b28e-873320644861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:57.663830 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6167c9-bf92-4f29-b28e-873320644861 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:57.664109 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6167c9-bf92-4f29-b28e-873320644861 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:57.664385 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6167c9-bf92-4f29-b28e-873320644861 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:57.665116 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6167c9-bf92-4f29-b28e-873320644861 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:57.665448 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6167c9-bf92-4f29-b28e-873320644861 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:57.666801 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6167c9-bf92-4f29-b28e-873320644861 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:57.675121 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 601/1181] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:03:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:57.680910 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b16abf-9676-47c3-b05c-8eaeb5d039bc None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:57.775098 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b16abf-9676-47c3-b05c-8eaeb5d039bc None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:57.807445 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3357552-b201-4c4c-88f0-78de28502f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:57.808290 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3357552-b201-4c4c-88f0-78de28502f60 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:57.808574 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3357552-b201-4c4c-88f0-78de28502f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:57.808851 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3357552-b201-4c4c-88f0-78de28502f60 None admin] PATH_INFO: `/v3/users/0492a5a3f10243248ea0d6ea74f056eb` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:57.822574 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3357552-b201-4c4c-88f0-78de28502f60 None admin] RBAC: Authorizing `identity:get_user(user_id=0492a5a3f10243248ea0d6ea74f056eb)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:57.824002 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3357552-b201-4c4c-88f0-78de28502f60 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:57.825657 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 581/1182] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:03:57 2022] GET /identity/v3/users/0492a5a3f10243248ea0d6ea74f056eb => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:57.831821 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6167c9-bf92-4f29-b28e-873320644861 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:57.928022 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6167c9-bf92-4f29-b28e-873320644861 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:57.960286 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc1225-452f-4d0c-b085-b340585d9edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:57.960931 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc1225-452f-4d0c-b085-b340585d9edd None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:57.961213 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc1225-452f-4d0c-b085-b340585d9edd None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:57.961526 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc1225-452f-4d0c-b085-b340585d9edd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:58.040534 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc1225-452f-4d0c-b085-b340585d9edd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:58.042850 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc1225-452f-4d0c-b085-b340585d9edd None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:58.140622 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 602/1183] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:03:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 20:03:58.147001 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3357552-b201-4c4c-88f0-78de28502f60 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:58.240606 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3357552-b201-4c4c-88f0-78de28502f60 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:58.272855 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfce99-4e1a-4b14-a79a-6946682a5cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:58.273728 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfce99-4e1a-4b14-a79a-6946682a5cbe None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:58.274009 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfce99-4e1a-4b14-a79a-6946682a5cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:58.274286 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfce99-4e1a-4b14-a79a-6946682a5cbe None admin] PATH_INFO: `/v3/projects/a5f3ecfb19b445d590ae0a664bf717fd` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:58.275441 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dfce99-4e1a-4b14-a79a-6946682a5cbe None admin] RBAC: Authorizing `identity:get_project(project_id=a5f3ecfb19b445d590ae0a664bf717fd)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:58.276855 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dfce99-4e1a-4b14-a79a-6946682a5cbe None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:58.278530 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 582/1184] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:03:58 2022] GET /identity/v3/projects/a5f3ecfb19b445d590ae0a664bf717fd => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:03:58.284485 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc1225-452f-4d0c-b085-b340585d9edd None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:03:58.390994 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc1225-452f-4d0c-b085-b340585d9edd None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:03:58.423664 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b00bf4-30db-4017-83c2-df024a8ca47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:03:58.424401 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b00bf4-30db-4017-83c2-df024a8ca47f None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:03:58.424683 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b00bf4-30db-4017-83c2-df024a8ca47f None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:03:58.424960 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b00bf4-30db-4017-83c2-df024a8ca47f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:03:58.425800 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b00bf4-30db-4017-83c2-df024a8ca47f None admin] RBAC: Adding query filter params (role.id=8cfa924df1a1400986d9ecc9686a7f52, scope.project.id=a5f3ecfb19b445d590ae0a664bf717fd, user.id=0492a5a3f10243248ea0d6ea74f056eb) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:03:58.426121 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b00bf4-30db-4017-83c2-df024a8ca47f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:03:58.427559 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b00bf4-30db-4017-83c2-df024a8ca47f None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:03:58.432728 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 603/1185] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:03:58 2022] GET /identity/v3/role_assignments?user.id=0492a5a3f10243248ea0d6ea74f056eb&scope.project.id=a5f3ecfb19b445d590ae0a664bf717fd&role.id=8cfa924df1a1400986d9ecc9686a7f52 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:04:00.665727 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e6ce6-e272-421b-b937-82bcc1e0fcce None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:04:00.666427 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e6ce6-e272-421b-b937-82bcc1e0fcce None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:04:00.666427 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e6ce6-e272-421b-b937-82bcc1e0fcce None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:04:00.668075 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 583/1186] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:04:00.673189 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e33d45-de82-48cf-91b8-6e23627c97ce None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:04:00.673652 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e33d45-de82-48cf-91b8-6e23627c97ce None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:04:00.674348 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e33d45-de82-48cf-91b8-6e23627c97ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:04:00.690738 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-83e33d45-de82-48cf-91b8-6e23627c97ce None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:04:00.691916 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-83e33d45-de82-48cf-91b8-6e23627c97ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:04:00.754475 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 604/1187] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:04:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:04:00.776741 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e6ce6-e272-421b-b937-82bcc1e0fcce None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:04:00.873597 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e6ce6-e272-421b-b937-82bcc1e0fcce None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:04:00.905376 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a5972-55cd-4917-8e92-4f0bdb9d5816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:04:00.906149 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a5972-55cd-4917-8e92-4f0bdb9d5816 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:04:00.906436 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a5972-55cd-4917-8e92-4f0bdb9d5816 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:04:00.906715 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a5972-55cd-4917-8e92-4f0bdb9d5816 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:04:00.916902 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a5972-55cd-4917-8e92-4f0bdb9d5816 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:04:00.923782 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-290a5972-55cd-4917-8e92-4f0bdb9d5816 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:04:00.924915 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 584/1188] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:04:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:04:00.930888 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e33d45-de82-48cf-91b8-6e23627c97ce None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:04:01.024137 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e33d45-de82-48cf-91b8-6e23627c97ce None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:04:01.055603 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9b98f-0ecd-4480-82de-4916861bb9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:04:01.056261 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9b98f-0ecd-4480-82de-4916861bb9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:04:01.056539 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9b98f-0ecd-4480-82de-4916861bb9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:04:01.056813 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9b98f-0ecd-4480-82de-4916861bb9f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:04:01.057564 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d9b98f-0ecd-4480-82de-4916861bb9f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:04:01.057866 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d9b98f-0ecd-4480-82de-4916861bb9f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:04:01.059215 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d9b98f-0ecd-4480-82de-4916861bb9f1 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:04:01.066853 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 605/1189] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:04:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:04:01.072933 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a5972-55cd-4917-8e92-4f0bdb9d5816 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:04:01.168446 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a5972-55cd-4917-8e92-4f0bdb9d5816 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:04:01.200043 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d22f8-ac2d-4e9c-83aa-2df3f62dc10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:04:01.200882 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d22f8-ac2d-4e9c-83aa-2df3f62dc10f None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:04:01.201163 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d22f8-ac2d-4e9c-83aa-2df3f62dc10f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:04:01.201466 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d22f8-ac2d-4e9c-83aa-2df3f62dc10f None admin] PATH_INFO: `/v3/users/0492a5a3f10243248ea0d6ea74f056eb` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:04:01.202625 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d22f8-ac2d-4e9c-83aa-2df3f62dc10f None admin] RBAC: Authorizing `identity:get_user(user_id=0492a5a3f10243248ea0d6ea74f056eb)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:04:01.204029 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d22f8-ac2d-4e9c-83aa-2df3f62dc10f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:04:01.205708 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 585/1190] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:04:01 2022] GET /identity/v3/users/0492a5a3f10243248ea0d6ea74f056eb => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:04:01.211174 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9b98f-0ecd-4480-82de-4916861bb9f1 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:04:01.305852 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9b98f-0ecd-4480-82de-4916861bb9f1 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:04:01.337169 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77428e1a-ea70-4314-ba96-0456bf461e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:04:01.338030 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77428e1a-ea70-4314-ba96-0456bf461e45 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:04:01.338308 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77428e1a-ea70-4314-ba96-0456bf461e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:04:01.338579 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77428e1a-ea70-4314-ba96-0456bf461e45 None admin] PATH_INFO: `/v3/projects/a5f3ecfb19b445d590ae0a664bf717fd` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:04:01.339731 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77428e1a-ea70-4314-ba96-0456bf461e45 None admin] RBAC: Authorizing `identity:get_project(project_id=a5f3ecfb19b445d590ae0a664bf717fd)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:04:01.341142 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77428e1a-ea70-4314-ba96-0456bf461e45 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:04:01.342801 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 606/1191] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:04:01 2022] GET /identity/v3/projects/a5f3ecfb19b445d590ae0a664bf717fd => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:04:01.349194 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d22f8-ac2d-4e9c-83aa-2df3f62dc10f None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:04:01.445865 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d22f8-ac2d-4e9c-83aa-2df3f62dc10f None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:04:01.478042 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703e781-c997-4630-89e3-d0a88bea201f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:04:01.478911 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703e781-c997-4630-89e3-d0a88bea201f None admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:04:01.479191 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703e781-c997-4630-89e3-d0a88bea201f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:04:01.479468 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703e781-c997-4630-89e3-d0a88bea201f None admin] PATH_INFO: `/v3/projects/a5f3ecfb19b445d590ae0a664bf717fd/users/0492a5a3f10243248ea0d6ea74f056eb/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:04:01.481382 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703e781-c997-4630-89e3-d0a88bea201f None admin] RBAC: Authorizing `identity:create_grant(project_id=a5f3ecfb19b445d590ae0a664bf717fd, user_id=0492a5a3f10243248ea0d6ea74f056eb, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:04:01.482794 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703e781-c997-4630-89e3-d0a88bea201f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:04:01.557692 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 586/1192] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Mar 29 20:04:01 2022] PUT /identity/v3/projects/a5f3ecfb19b445d590ae0a664bf717fd/users/0492a5a3f10243248ea0d6ea74f056eb/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:04:03.851627 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d28c89-8da4-4d0b-934a-69feba29a51e None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:04:03.852167 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d28c89-8da4-4d0b-934a-69feba29a51e None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:04:03.852167 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d28c89-8da4-4d0b-934a-69feba29a51e None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:04:03.853976 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 607/1193] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:04:03.859223 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c96e-b95a-4e95-bd22-854db5dd6487 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:04:03.859602 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c96e-b95a-4e95-bd22-854db5dd6487 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:04:03.859793 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c96e-b95a-4e95-bd22-854db5dd6487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:04:03.877847 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-b7d7c96e-b95a-4e95-bd22-854db5dd6487 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:04:03.879017 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-b7d7c96e-b95a-4e95-bd22-854db5dd6487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:04:03.942632 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 587/1194] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:04:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:04:03.966540 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d28c89-8da4-4d0b-934a-69feba29a51e None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:04:04.065916 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d28c89-8da4-4d0b-934a-69feba29a51e None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:04:04.098440 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbb860-59e9-4fc4-a7be-cab52ed0ca32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:04:04.099215 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbb860-59e9-4fc4-a7be-cab52ed0ca32 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:04:04.099494 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbb860-59e9-4fc4-a7be-cab52ed0ca32 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:04:04.099766 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbb860-59e9-4fc4-a7be-cab52ed0ca32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:04:04.109659 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbb860-59e9-4fc4-a7be-cab52ed0ca32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:04:04.116677 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-b8cbb860-59e9-4fc4-a7be-cab52ed0ca32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:04:04.117932 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 608/1195] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:04:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:04:04.123964 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7c96e-b95a-4e95-bd22-854db5dd6487 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:04:04.218449 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7c96e-b95a-4e95-bd22-854db5dd6487 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:04:04.250388 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d29602-897a-48a7-bc08-5b5e2de4886f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:04:04.251045 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d29602-897a-48a7-bc08-5b5e2de4886f None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:04:04.251328 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d29602-897a-48a7-bc08-5b5e2de4886f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:04:04.252333 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d29602-897a-48a7-bc08-5b5e2de4886f None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:04:04.253070 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d29602-897a-48a7-bc08-5b5e2de4886f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:04:04.253394 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d29602-897a-48a7-bc08-5b5e2de4886f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:04:04.254744 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d29602-897a-48a7-bc08-5b5e2de4886f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:04:04.262394 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 588/1196] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:04:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:04:04.268741 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbb860-59e9-4fc4-a7be-cab52ed0ca32 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:04:04.362004 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbb860-59e9-4fc4-a7be-cab52ed0ca32 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:04:04.395452 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a70d5d-181e-4b2f-8d19-19651fba9b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:04:04.396317 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a70d5d-181e-4b2f-8d19-19651fba9b7b None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:04:04.396596 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a70d5d-181e-4b2f-8d19-19651fba9b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:04:04.396876 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a70d5d-181e-4b2f-8d19-19651fba9b7b None admin] PATH_INFO: `/v3/users/0492a5a3f10243248ea0d6ea74f056eb` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:04:04.398089 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a70d5d-181e-4b2f-8d19-19651fba9b7b None admin] RBAC: Authorizing `identity:get_user(user_id=0492a5a3f10243248ea0d6ea74f056eb)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:04:04.399506 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a70d5d-181e-4b2f-8d19-19651fba9b7b None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:04:04.401066 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 609/1197] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Mar 29 20:04:04 2022] GET /identity/v3/users/0492a5a3f10243248ea0d6ea74f056eb => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:04:04.406697 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d29602-897a-48a7-bc08-5b5e2de4886f None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:04:04.499212 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d29602-897a-48a7-bc08-5b5e2de4886f None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:04:04.530922 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc019b0-c0d9-4d04-a2c1-addc68aad4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:04:04.531552 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc019b0-c0d9-4d04-a2c1-addc68aad4e3 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:04:04.531844 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc019b0-c0d9-4d04-a2c1-addc68aad4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:04:04.532118 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc019b0-c0d9-4d04-a2c1-addc68aad4e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:04:04.594291 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc019b0-c0d9-4d04-a2c1-addc68aad4e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:04:04.595950 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc019b0-c0d9-4d04-a2c1-addc68aad4e3 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:04:04.687537 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 589/1198] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:04:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 20:04:04.694354 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a70d5d-181e-4b2f-8d19-19651fba9b7b None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:04:04.788942 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a70d5d-181e-4b2f-8d19-19651fba9b7b None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:04:04.822211 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505ccbe-9757-4a47-a770-949b844c8d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:04:04.823050 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505ccbe-9757-4a47-a770-949b844c8d02 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:04:04.823332 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505ccbe-9757-4a47-a770-949b844c8d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:04:04.823605 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505ccbe-9757-4a47-a770-949b844c8d02 None admin] PATH_INFO: `/v3/projects/a5f3ecfb19b445d590ae0a664bf717fd` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:04:04.824752 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505ccbe-9757-4a47-a770-949b844c8d02 None admin] RBAC: Authorizing `identity:get_project(project_id=a5f3ecfb19b445d590ae0a664bf717fd)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:04:04.826190 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505ccbe-9757-4a47-a770-949b844c8d02 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:04:04.827829 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 610/1199] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Mar 29 20:04:04 2022] GET /identity/v3/projects/a5f3ecfb19b445d590ae0a664bf717fd => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:04:04.833917 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc019b0-c0d9-4d04-a2c1-addc68aad4e3 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:04:04.927963 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc019b0-c0d9-4d04-a2c1-addc68aad4e3 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:04:04.961457 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a7103-08d0-4854-b703-f9e9a31bf7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:04:04.962039 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a7103-08d0-4854-b703-f9e9a31bf7df None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:04:04.962323 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a7103-08d0-4854-b703-f9e9a31bf7df None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:04:04.962597 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a7103-08d0-4854-b703-f9e9a31bf7df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:04:04.963411 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a7103-08d0-4854-b703-f9e9a31bf7df None admin] RBAC: Adding query filter params (role.id=8cfa924df1a1400986d9ecc9686a7f52, scope.project.id=a5f3ecfb19b445d590ae0a664bf717fd, user.id=0492a5a3f10243248ea0d6ea74f056eb) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:04:04.963722 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a7103-08d0-4854-b703-f9e9a31bf7df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:04:04.965153 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a7103-08d0-4854-b703-f9e9a31bf7df None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:04:04.971237 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 590/1200] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:04:04 2022] GET /identity/v3/role_assignments?user.id=0492a5a3f10243248ea0d6ea74f056eb&scope.project.id=a5f3ecfb19b445d590ae0a664bf717fd&role.id=8cfa924df1a1400986d9ecc9686a7f52 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:23.157921 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb672aaf-0d88-42aa-9d61-9f29d0b169db None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:23.158577 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb672aaf-0d88-42aa-9d61-9f29d0b169db None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:23.158577 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb672aaf-0d88-42aa-9d61-9f29d0b169db None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:23.160807 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 611/1201] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:05:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:05:23.166071 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82378195-3923-4211-a908-3da38d761f19 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:23.166510 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82378195-3923-4211-a908-3da38d761f19 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:23.166612 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82378195-3923-4211-a908-3da38d761f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:23.183707 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-82378195-3923-4211-a908-3da38d761f19 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:05:23.184826 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-82378195-3923-4211-a908-3da38d761f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:05:23.250222 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 591/1202] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:05:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:05:23.275427 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb672aaf-0d88-42aa-9d61-9f29d0b169db None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:23.375157 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb672aaf-0d88-42aa-9d61-9f29d0b169db None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:23.407461 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a92498-591c-4498-bda1-070f8928bf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:23.408245 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a92498-591c-4498-bda1-070f8928bf04 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:23.408531 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a92498-591c-4498-bda1-070f8928bf04 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:23.408811 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a92498-591c-4498-bda1-070f8928bf04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:23.419058 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a92498-591c-4498-bda1-070f8928bf04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:23.420509 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a92498-591c-4498-bda1-070f8928bf04 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:23.436817 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-f8a92498-591c-4498-bda1-070f8928bf04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:05:23.437954 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 612/1203] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:05:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:23.444889 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82378195-3923-4211-a908-3da38d761f19 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:23.538475 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82378195-3923-4211-a908-3da38d761f19 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:23.571040 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63586b-c674-4b18-81b5-d355d1b230e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:23.571693 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63586b-c674-4b18-81b5-d355d1b230e3 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:23.571973 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63586b-c674-4b18-81b5-d355d1b230e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:23.572249 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63586b-c674-4b18-81b5-d355d1b230e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:23.572978 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63586b-c674-4b18-81b5-d355d1b230e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:23.573267 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63586b-c674-4b18-81b5-d355d1b230e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:23.574649 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63586b-c674-4b18-81b5-d355d1b230e3 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:23.586026 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 592/1204] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:23.591762 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a92498-591c-4498-bda1-070f8928bf04 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:23.684928 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a92498-591c-4498-bda1-070f8928bf04 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:23.717797 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f0b8c-2d79-4e4a-9252-b5010928a063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:23.718394 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f0b8c-2d79-4e4a-9252-b5010928a063 None admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:23.718675 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f0b8c-2d79-4e4a-9252-b5010928a063 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:23.718951 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f0b8c-2d79-4e4a-9252-b5010928a063 None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:23.719644 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f0b8c-2d79-4e4a-9252-b5010928a063 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:23.721056 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f0b8c-2d79-4e4a-9252-b5010928a063 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:23.784430 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 613/1205] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Mar 29 20:05:23 2022] POST /identity/v3/users => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:05:26.085483 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7ec3d-1194-45fb-af06-e4075762ceb6 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:26.086082 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7ec3d-1194-45fb-af06-e4075762ceb6 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:26.086082 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7ec3d-1194-45fb-af06-e4075762ceb6 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:26.087834 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 593/1206] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:05:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:05:26.092972 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a70f22-7fb5-4579-8730-1cc2f9292410 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:26.093452 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a70f22-7fb5-4579-8730-1cc2f9292410 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:26.093558 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a70f22-7fb5-4579-8730-1cc2f9292410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:26.110603 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-60a70f22-7fb5-4579-8730-1cc2f9292410 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:05:26.111785 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-60a70f22-7fb5-4579-8730-1cc2f9292410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:05:26.182036 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 614/1207] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:05:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:05:26.206386 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7ec3d-1194-45fb-af06-e4075762ceb6 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:26.307159 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7ec3d-1194-45fb-af06-e4075762ceb6 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:26.339493 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235411e-8355-40ff-9f49-c8028876eb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:26.340291 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235411e-8355-40ff-9f49-c8028876eb4e None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:26.340570 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235411e-8355-40ff-9f49-c8028876eb4e None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:26.340842 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235411e-8355-40ff-9f49-c8028876eb4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:26.351775 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235411e-8355-40ff-9f49-c8028876eb4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:05:26.358819 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-3235411e-8355-40ff-9f49-c8028876eb4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 20:05:26.359986 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 594/1208] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Mar 29 20:05:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:26.366273 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a70f22-7fb5-4579-8730-1cc2f9292410 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:26.461762 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a70f22-7fb5-4579-8730-1cc2f9292410 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:26.494244 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13545439-7528-48bb-934b-5d82602d5b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:26.494910 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13545439-7528-48bb-934b-5d82602d5b17 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:26.495199 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13545439-7528-48bb-934b-5d82602d5b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:26.495484 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13545439-7528-48bb-934b-5d82602d5b17 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:26.496225 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13545439-7528-48bb-934b-5d82602d5b17 None admin] RBAC: Adding query filter params (name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:26.496535 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13545439-7528-48bb-934b-5d82602d5b17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:26.498006 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13545439-7528-48bb-934b-5d82602d5b17 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:26.507090 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 615/1209] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Mar 29 20:05:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:26.511473 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235411e-8355-40ff-9f49-c8028876eb4e None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:26.608542 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235411e-8355-40ff-9f49-c8028876eb4e None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:26.641344 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1281f7-40ef-4df0-9a52-762768b8af12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:26.642131 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1281f7-40ef-4df0-9a52-762768b8af12 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:26.642422 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1281f7-40ef-4df0-9a52-762768b8af12 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:26.642699 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1281f7-40ef-4df0-9a52-762768b8af12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:26.653874 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1281f7-40ef-4df0-9a52-762768b8af12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:26.658580 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1281f7-40ef-4df0-9a52-762768b8af12 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:26.672398 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-4e1281f7-40ef-4df0-9a52-762768b8af12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:05:26.673594 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 595/1210] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:05:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:26.679432 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13545439-7528-48bb-934b-5d82602d5b17 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:26.900891 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13545439-7528-48bb-934b-5d82602d5b17 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:26.935083 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2cd9f6-2ee3-4d96-8c86-13d5d663b932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:26.935749 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cd9f6-2ee3-4d96-8c86-13d5d663b932 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:26.936033 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cd9f6-2ee3-4d96-8c86-13d5d663b932 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:26.936308 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cd9f6-2ee3-4d96-8c86-13d5d663b932 None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:26.937014 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2cd9f6-2ee3-4d96-8c86-13d5d663b932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:26.937350 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2cd9f6-2ee3-4d96-8c86-13d5d663b932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:26.938775 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2cd9f6-2ee3-4d96-8c86-13d5d663b932 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:26.951378 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 616/1211] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:26.957246 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1281f7-40ef-4df0-9a52-762768b8af12 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:27.052757 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1281f7-40ef-4df0-9a52-762768b8af12 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:27.085447 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a5350-5bed-432a-be63-85a8cf01d264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:27.086228 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a5350-5bed-432a-be63-85a8cf01d264 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:27.086801 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a5350-5bed-432a-be63-85a8cf01d264 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:27.086801 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a5350-5bed-432a-be63-85a8cf01d264 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:27.093462 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a5350-5bed-432a-be63-85a8cf01d264 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:27.094882 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a5350-5bed-432a-be63-85a8cf01d264 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:27.108401 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-fe1a5350-5bed-432a-be63-85a8cf01d264 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 29 20:05:27.109563 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 596/1212] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:05:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:05:27.115939 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2cd9f6-2ee3-4d96-8c86-13d5d663b932 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:27.211594 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2cd9f6-2ee3-4d96-8c86-13d5d663b932 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:27.243089 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad182c1a-aa87-47fb-940e-402b73065fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:27.243750 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad182c1a-aa87-47fb-940e-402b73065fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:27.244034 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad182c1a-aa87-47fb-940e-402b73065fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:27.244314 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad182c1a-aa87-47fb-940e-402b73065fe6 None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:27.245131 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad182c1a-aa87-47fb-940e-402b73065fe6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:27.245469 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad182c1a-aa87-47fb-940e-402b73065fe6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:27.246884 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad182c1a-aa87-47fb-940e-402b73065fe6 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:27.263015 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 617/1213] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Mar 29 20:05:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:27.268647 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a5350-5bed-432a-be63-85a8cf01d264 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:27.365752 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a5350-5bed-432a-be63-85a8cf01d264 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:27.397417 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5025832-4e1d-49b3-89db-66ca21f33ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:27.398057 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5025832-4e1d-49b3-89db-66ca21f33ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:27.398340 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5025832-4e1d-49b3-89db-66ca21f33ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:27.398629 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5025832-4e1d-49b3-89db-66ca21f33ed6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:27.467358 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5025832-4e1d-49b3-89db-66ca21f33ed6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:27.468719 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5025832-4e1d-49b3-89db-66ca21f33ed6 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:27.562659 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 597/1214] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:05:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 20:05:27.569106 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad182c1a-aa87-47fb-940e-402b73065fe6 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:27.665868 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad182c1a-aa87-47fb-940e-402b73065fe6 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:27.699634 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48560830-17ef-4516-84e6-9c39b2e5a9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:27.700422 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48560830-17ef-4516-84e6-9c39b2e5a9ce None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:27.700713 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48560830-17ef-4516-84e6-9c39b2e5a9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:27.700989 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48560830-17ef-4516-84e6-9c39b2e5a9ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:27.711425 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48560830-17ef-4516-84e6-9c39b2e5a9ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:27.712870 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48560830-17ef-4516-84e6-9c39b2e5a9ce None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:27.729345 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-48560830-17ef-4516-84e6-9c39b2e5a9ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:05:27.730450 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 618/1215] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:27.736150 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5025832-4e1d-49b3-89db-66ca21f33ed6 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:27.833439 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5025832-4e1d-49b3-89db-66ca21f33ed6 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:27.867497 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa918e-df96-4161-a76c-7cfc2cd51d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:27.868218 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa918e-df96-4161-a76c-7cfc2cd51d1d None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:27.868506 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa918e-df96-4161-a76c-7cfc2cd51d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:27.868789 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa918e-df96-4161-a76c-7cfc2cd51d1d None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:27.869539 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa918e-df96-4161-a76c-7cfc2cd51d1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:27.869855 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa918e-df96-4161-a76c-7cfc2cd51d1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:27.871280 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa918e-df96-4161-a76c-7cfc2cd51d1d None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:27.883318 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 598/1216] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:27.888915 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48560830-17ef-4516-84e6-9c39b2e5a9ce None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:27.985546 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48560830-17ef-4516-84e6-9c39b2e5a9ce None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:28.018071 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f0b74-46c6-40c2-802d-613ed7c28f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:28.018857 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f0b74-46c6-40c2-802d-613ed7c28f8b None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:28.019184 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f0b74-46c6-40c2-802d-613ed7c28f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:28.019771 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f0b74-46c6-40c2-802d-613ed7c28f8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:28.025930 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f0b74-46c6-40c2-802d-613ed7c28f8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:28.027365 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f0b74-46c6-40c2-802d-613ed7c28f8b None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:28.040702 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-219f0b74-46c6-40c2-802d-613ed7c28f8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:05:28.041898 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 619/1217] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:05:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:28.047754 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa918e-df96-4161-a76c-7cfc2cd51d1d None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:28.145310 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa918e-df96-4161-a76c-7cfc2cd51d1d None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:28.178149 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88935129-5cdb-4c41-aa74-af18c36d88b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:28.178811 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88935129-5cdb-4c41-aa74-af18c36d88b4 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:28.179101 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88935129-5cdb-4c41-aa74-af18c36d88b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:28.179385 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88935129-5cdb-4c41-aa74-af18c36d88b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:28.180167 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88935129-5cdb-4c41-aa74-af18c36d88b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:28.180544 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88935129-5cdb-4c41-aa74-af18c36d88b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:28.181972 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88935129-5cdb-4c41-aa74-af18c36d88b4 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:28.195180 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 599/1218] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:05:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:28.201159 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f0b74-46c6-40c2-802d-613ed7c28f8b None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:28.296961 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f0b74-46c6-40c2-802d-613ed7c28f8b None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:28.330117 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bd73f-d788-4dc5-9416-5b92c0e6ce24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:28.330768 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bd73f-d788-4dc5-9416-5b92c0e6ce24 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:28.331052 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bd73f-d788-4dc5-9416-5b92c0e6ce24 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:28.331333 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bd73f-d788-4dc5-9416-5b92c0e6ce24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:28.332199 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bd73f-d788-4dc5-9416-5b92c0e6ce24 None admin] RBAC: Adding query filter params (role.id=04bfd9a52ca84b2db7f73121d5e57b41, scope.project.id=ec1f2c5cb900473da1083830387e3ff4, user.id=5ef0001e91524a13a9ca601a601de66b) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:28.332506 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bd73f-d788-4dc5-9416-5b92c0e6ce24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:28.333978 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bd73f-d788-4dc5-9416-5b92c0e6ce24 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:28.339327 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 620/1219] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:05:28 2022] GET /identity/v3/role_assignments?user.id=5ef0001e91524a13a9ca601a601de66b&scope.project.id=ec1f2c5cb900473da1083830387e3ff4&role.id=04bfd9a52ca84b2db7f73121d5e57b41 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:30.639915 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882bc7b-16c4-4d65-b8f9-906cd89d69c2 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:30.640524 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882bc7b-16c4-4d65-b8f9-906cd89d69c2 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:30.640524 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882bc7b-16c4-4d65-b8f9-906cd89d69c2 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:30.642312 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 600/1220] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:05:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:05:30.647964 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d029dca-8ae7-4350-9bc9-819d828363be None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:30.648365 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d029dca-8ae7-4350-9bc9-819d828363be None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:30.648515 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d029dca-8ae7-4350-9bc9-819d828363be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:30.665410 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-8d029dca-8ae7-4350-9bc9-819d828363be None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:05:30.666574 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-8d029dca-8ae7-4350-9bc9-819d828363be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:05:30.733179 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 621/1221] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:05:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:05:30.756931 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882bc7b-16c4-4d65-b8f9-906cd89d69c2 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:30.857853 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882bc7b-16c4-4d65-b8f9-906cd89d69c2 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:30.892703 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4672d-4aa8-4ba9-98e0-244dd9bbcbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:30.893462 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4672d-4aa8-4ba9-98e0-244dd9bbcbb0 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:30.893751 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4672d-4aa8-4ba9-98e0-244dd9bbcbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:30.894097 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4672d-4aa8-4ba9-98e0-244dd9bbcbb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:30.904445 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4672d-4aa8-4ba9-98e0-244dd9bbcbb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:05:30.911589 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-21c4672d-4aa8-4ba9-98e0-244dd9bbcbb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 20:05:30.912780 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 601/1222] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Mar 29 20:05:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:30.918859 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d029dca-8ae7-4350-9bc9-819d828363be None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:31.017746 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d029dca-8ae7-4350-9bc9-819d828363be None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:31.048973 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1322b07-c027-4cda-b17e-765268d254df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:31.049756 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1322b07-c027-4cda-b17e-765268d254df None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:31.050039 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1322b07-c027-4cda-b17e-765268d254df None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:31.050852 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1322b07-c027-4cda-b17e-765268d254df None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:31.051688 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1322b07-c027-4cda-b17e-765268d254df None admin] RBAC: Adding query filter params (name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:31.052009 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1322b07-c027-4cda-b17e-765268d254df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:31.053410 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1322b07-c027-4cda-b17e-765268d254df None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:31.061517 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 622/1223] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Mar 29 20:05:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:31.069277 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4672d-4aa8-4ba9-98e0-244dd9bbcbb0 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:31.167115 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4672d-4aa8-4ba9-98e0-244dd9bbcbb0 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:31.200063 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c7f15-0140-4baa-ae48-badd1ad2a67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:31.200836 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c7f15-0140-4baa-ae48-badd1ad2a67e None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:31.201116 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c7f15-0140-4baa-ae48-badd1ad2a67e None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:31.201423 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c7f15-0140-4baa-ae48-badd1ad2a67e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:31.211903 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c7f15-0140-4baa-ae48-badd1ad2a67e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:31.213345 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c7f15-0140-4baa-ae48-badd1ad2a67e None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:31.230099 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-658c7f15-0140-4baa-ae48-badd1ad2a67e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:05:31.231267 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 602/1224] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:05:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:31.237002 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1322b07-c027-4cda-b17e-765268d254df None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:31.331187 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1322b07-c027-4cda-b17e-765268d254df None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:31.362715 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb09ae-3750-42c7-b090-ba11e938eba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:31.363967 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb09ae-3750-42c7-b090-ba11e938eba1 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:31.364246 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb09ae-3750-42c7-b090-ba11e938eba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:31.364522 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb09ae-3750-42c7-b090-ba11e938eba1 None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:31.365219 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb09ae-3750-42c7-b090-ba11e938eba1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:31.365551 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb09ae-3750-42c7-b090-ba11e938eba1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:31.366906 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb09ae-3750-42c7-b090-ba11e938eba1 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:31.377563 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 623/1225] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:31.383195 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c7f15-0140-4baa-ae48-badd1ad2a67e None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:31.479366 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c7f15-0140-4baa-ae48-badd1ad2a67e None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:31.510649 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bdadb-0f42-4229-adfd-23e8473c5f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:31.511496 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bdadb-0f42-4229-adfd-23e8473c5f47 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:31.513031 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bdadb-0f42-4229-adfd-23e8473c5f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:31.513031 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bdadb-0f42-4229-adfd-23e8473c5f47 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:31.519987 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715bdadb-0f42-4229-adfd-23e8473c5f47 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:31.521444 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715bdadb-0f42-4229-adfd-23e8473c5f47 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:31.534710 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-715bdadb-0f42-4229-adfd-23e8473c5f47 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 29 20:05:31.536322 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 603/1226] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:05:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:31.542165 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb09ae-3750-42c7-b090-ba11e938eba1 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:31.637458 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb09ae-3750-42c7-b090-ba11e938eba1 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:31.669439 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a3595-f731-41c3-b143-e4157e61cd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:31.670116 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a3595-f731-41c3-b143-e4157e61cd75 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:31.670456 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a3595-f731-41c3-b143-e4157e61cd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:31.670703 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a3595-f731-41c3-b143-e4157e61cd75 None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:31.671530 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a3595-f731-41c3-b143-e4157e61cd75 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:31.671837 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a3595-f731-41c3-b143-e4157e61cd75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:31.673273 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a3595-f731-41c3-b143-e4157e61cd75 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:31.692899 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 624/1227] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Mar 29 20:05:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:31.698917 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bdadb-0f42-4229-adfd-23e8473c5f47 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:31.814757 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bdadb-0f42-4229-adfd-23e8473c5f47 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:31.867005 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6394ca-e760-41ad-8aa0-a440475e5e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:31.867895 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6394ca-e760-41ad-8aa0-a440475e5e85 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:31.868458 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6394ca-e760-41ad-8aa0-a440475e5e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:31.868935 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6394ca-e760-41ad-8aa0-a440475e5e85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:31.884136 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6394ca-e760-41ad-8aa0-a440475e5e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:31.887382 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6394ca-e760-41ad-8aa0-a440475e5e85 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:31.906323 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-7c6394ca-e760-41ad-8aa0-a440475e5e85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:05:31.908904 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 604/1228] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:05:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:31.915473 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a3595-f731-41c3-b143-e4157e61cd75 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:32.026739 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a3595-f731-41c3-b143-e4157e61cd75 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:32.062990 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa125c2-889a-4153-ae66-f344512ed026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:32.064140 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa125c2-889a-4153-ae66-f344512ed026 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:32.064431 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa125c2-889a-4153-ae66-f344512ed026 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:32.064711 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa125c2-889a-4153-ae66-f344512ed026 None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:32.066067 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa125c2-889a-4153-ae66-f344512ed026 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:32.066334 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa125c2-889a-4153-ae66-f344512ed026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:32.068431 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa125c2-889a-4153-ae66-f344512ed026 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:32.082156 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 625/1229] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:32.087965 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6394ca-e760-41ad-8aa0-a440475e5e85 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:32.211580 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6394ca-e760-41ad-8aa0-a440475e5e85 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:32.253994 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96693d0f-781a-4155-aabb-649209f0de70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:32.255338 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96693d0f-781a-4155-aabb-649209f0de70 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:32.255818 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96693d0f-781a-4155-aabb-649209f0de70 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:32.256217 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96693d0f-781a-4155-aabb-649209f0de70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:32.264248 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96693d0f-781a-4155-aabb-649209f0de70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:32.265703 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96693d0f-781a-4155-aabb-649209f0de70 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:32.283407 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-96693d0f-781a-4155-aabb-649209f0de70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:05:32.285552 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 605/1230] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:05:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:32.291547 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa125c2-889a-4153-ae66-f344512ed026 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:32.408644 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa125c2-889a-4153-ae66-f344512ed026 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:32.447904 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6dfbf-4109-4fbe-badc-e9bdd4e024c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:32.448763 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6dfbf-4109-4fbe-badc-e9bdd4e024c0 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:32.449044 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6dfbf-4109-4fbe-badc-e9bdd4e024c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:32.449353 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6dfbf-4109-4fbe-badc-e9bdd4e024c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:32.450121 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6dfbf-4109-4fbe-badc-e9bdd4e024c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:32.450806 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6dfbf-4109-4fbe-badc-e9bdd4e024c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:32.452864 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6dfbf-4109-4fbe-badc-e9bdd4e024c0 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:32.468615 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 626/1231] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:05:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:32.475709 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96693d0f-781a-4155-aabb-649209f0de70 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:32.576242 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96693d0f-781a-4155-aabb-649209f0de70 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:32.609218 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d459035-8823-4c01-8381-daa0b103ef19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:32.610126 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d459035-8823-4c01-8381-daa0b103ef19 None admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:32.610419 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d459035-8823-4c01-8381-daa0b103ef19 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:32.610698 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d459035-8823-4c01-8381-daa0b103ef19 None admin] PATH_INFO: `/v3/projects/ec1f2c5cb900473da1083830387e3ff4/users/5ef0001e91524a13a9ca601a601de66b/roles/04bfd9a52ca84b2db7f73121d5e57b41` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:32.624658 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d459035-8823-4c01-8381-daa0b103ef19 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec1f2c5cb900473da1083830387e3ff4, user_id=5ef0001e91524a13a9ca601a601de66b, role_id=04bfd9a52ca84b2db7f73121d5e57b41)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:32.626112 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d459035-8823-4c01-8381-daa0b103ef19 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:32.745665 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 606/1232] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Mar 29 20:05:32 2022] PUT /identity/v3/projects/ec1f2c5cb900473da1083830387e3ff4/users/5ef0001e91524a13a9ca601a601de66b/roles/04bfd9a52ca84b2db7f73121d5e57b41 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:05:35.020148 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdea27b-a7f3-40a5-807f-fce89b08018d None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:35.020148 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdea27b-a7f3-40a5-807f-fce89b08018d None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:35.020776 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdea27b-a7f3-40a5-807f-fce89b08018d None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:35.022199 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 627/1233] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:05:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:05:35.027259 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e20c2d-60fd-4054-8efd-ecf524c7f704 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:35.027682 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e20c2d-60fd-4054-8efd-ecf524c7f704 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:35.027814 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e20c2d-60fd-4054-8efd-ecf524c7f704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:35.044495 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-97e20c2d-60fd-4054-8efd-ecf524c7f704 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:05:35.045717 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-97e20c2d-60fd-4054-8efd-ecf524c7f704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:05:35.111315 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 607/1234] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:05:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:05:35.135400 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdea27b-a7f3-40a5-807f-fce89b08018d None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:35.233409 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdea27b-a7f3-40a5-807f-fce89b08018d None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:35.270369 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab500e-2a4d-4d73-b95d-08447eae5a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:35.271157 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab500e-2a4d-4d73-b95d-08447eae5a32 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:35.271437 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab500e-2a4d-4d73-b95d-08447eae5a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:35.271709 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab500e-2a4d-4d73-b95d-08447eae5a32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:35.281496 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab500e-2a4d-4d73-b95d-08447eae5a32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:05:35.288719 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-2fab500e-2a4d-4d73-b95d-08447eae5a32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 20:05:35.289918 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 628/1235] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Mar 29 20:05:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:35.295875 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e20c2d-60fd-4054-8efd-ecf524c7f704 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:35.392305 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e20c2d-60fd-4054-8efd-ecf524c7f704 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:35.424503 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021da3e6-d12c-4a09-8fe9-ad1b3798a45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:35.425158 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021da3e6-d12c-4a09-8fe9-ad1b3798a45d None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:35.427100 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021da3e6-d12c-4a09-8fe9-ad1b3798a45d None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:35.427100 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021da3e6-d12c-4a09-8fe9-ad1b3798a45d None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:35.427100 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021da3e6-d12c-4a09-8fe9-ad1b3798a45d None admin] RBAC: Adding query filter params (name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:35.427382 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021da3e6-d12c-4a09-8fe9-ad1b3798a45d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:35.428625 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021da3e6-d12c-4a09-8fe9-ad1b3798a45d None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:35.436351 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 608/1236] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Mar 29 20:05:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:35.441993 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab500e-2a4d-4d73-b95d-08447eae5a32 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:35.539246 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab500e-2a4d-4d73-b95d-08447eae5a32 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:35.571541 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6a780-d3ac-462f-a1ba-1e8e1f90c35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:35.572325 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6a780-d3ac-462f-a1ba-1e8e1f90c35e None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:35.572612 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6a780-d3ac-462f-a1ba-1e8e1f90c35e None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:35.572894 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6a780-d3ac-462f-a1ba-1e8e1f90c35e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:35.583113 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6a780-d3ac-462f-a1ba-1e8e1f90c35e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:35.584544 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6a780-d3ac-462f-a1ba-1e8e1f90c35e None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:35.601096 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-38d6a780-d3ac-462f-a1ba-1e8e1f90c35e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:05:35.602276 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 629/1237] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:35.608099 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021da3e6-d12c-4a09-8fe9-ad1b3798a45d None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:35.705341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021da3e6-d12c-4a09-8fe9-ad1b3798a45d None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:35.737338 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47a17a-7820-415e-a37a-def59819ce0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:35.737994 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47a17a-7820-415e-a37a-def59819ce0f None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:35.738280 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47a17a-7820-415e-a37a-def59819ce0f None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:35.738561 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47a17a-7820-415e-a37a-def59819ce0f None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:35.739308 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47a17a-7820-415e-a37a-def59819ce0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:35.739619 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47a17a-7820-415e-a37a-def59819ce0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:35.740976 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47a17a-7820-415e-a37a-def59819ce0f None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:35.753185 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 609/1238] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:35.759505 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6a780-d3ac-462f-a1ba-1e8e1f90c35e None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:35.856774 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6a780-d3ac-462f-a1ba-1e8e1f90c35e None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:35.890764 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d36310-4cd1-4b49-917b-ac2b08a1f55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:35.891595 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d36310-4cd1-4b49-917b-ac2b08a1f55d None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:35.891877 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d36310-4cd1-4b49-917b-ac2b08a1f55d None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:35.892150 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d36310-4cd1-4b49-917b-ac2b08a1f55d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:35.901010 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d36310-4cd1-4b49-917b-ac2b08a1f55d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:35.902553 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d36310-4cd1-4b49-917b-ac2b08a1f55d None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:35.916410 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-66d36310-4cd1-4b49-917b-ac2b08a1f55d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 29 20:05:35.917619 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 630/1239] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:05:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:35.923471 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47a17a-7820-415e-a37a-def59819ce0f None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:36.021136 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47a17a-7820-415e-a37a-def59819ce0f None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:36.053998 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9482a-ee85-4322-9ca4-b50507798e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:36.054661 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9482a-ee85-4322-9ca4-b50507798e32 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:36.054922 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9482a-ee85-4322-9ca4-b50507798e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:36.055193 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9482a-ee85-4322-9ca4-b50507798e32 None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:36.056018 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9482a-ee85-4322-9ca4-b50507798e32 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:36.056326 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9482a-ee85-4322-9ca4-b50507798e32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:36.057771 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9482a-ee85-4322-9ca4-b50507798e32 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:36.074868 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 610/1240] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Mar 29 20:05:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:36.080790 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d36310-4cd1-4b49-917b-ac2b08a1f55d None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:36.180061 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d36310-4cd1-4b49-917b-ac2b08a1f55d None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:36.212275 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffefdc1a-1d66-4949-bac4-af3925d40b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:36.212911 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefdc1a-1d66-4949-bac4-af3925d40b3e None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:36.213196 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefdc1a-1d66-4949-bac4-af3925d40b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:36.213510 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefdc1a-1d66-4949-bac4-af3925d40b3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:36.278090 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffefdc1a-1d66-4949-bac4-af3925d40b3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:36.279628 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffefdc1a-1d66-4949-bac4-af3925d40b3e None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:36.381611 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 631/1241] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:05:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 20:05:36.387378 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9482a-ee85-4322-9ca4-b50507798e32 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:36.483614 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9482a-ee85-4322-9ca4-b50507798e32 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:36.516329 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bd41c-7310-46b2-a612-d88bd8df8165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:36.517112 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bd41c-7310-46b2-a612-d88bd8df8165 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:36.517425 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bd41c-7310-46b2-a612-d88bd8df8165 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:36.517707 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bd41c-7310-46b2-a612-d88bd8df8165 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:36.528124 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bd41c-7310-46b2-a612-d88bd8df8165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:36.529674 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bd41c-7310-46b2-a612-d88bd8df8165 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:36.546106 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-695bd41c-7310-46b2-a612-d88bd8df8165 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:05:36.547260 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 611/1242] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:36.553553 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffefdc1a-1d66-4949-bac4-af3925d40b3e None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:36.650485 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffefdc1a-1d66-4949-bac4-af3925d40b3e None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:36.683685 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c0200-bb4e-4119-9580-c75b8ca5a9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:36.684351 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c0200-bb4e-4119-9580-c75b8ca5a9c5 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:36.684634 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c0200-bb4e-4119-9580-c75b8ca5a9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:36.684910 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c0200-bb4e-4119-9580-c75b8ca5a9c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:36.685692 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c0200-bb4e-4119-9580-c75b8ca5a9c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:36.685999 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c0200-bb4e-4119-9580-c75b8ca5a9c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:36.687408 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c0200-bb4e-4119-9580-c75b8ca5a9c5 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:36.699186 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 632/1243] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:36.704877 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bd41c-7310-46b2-a612-d88bd8df8165 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:36.800573 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bd41c-7310-46b2-a612-d88bd8df8165 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:36.834190 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce71b19-f47d-4abe-a235-3efa5ef0456b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:36.835110 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce71b19-f47d-4abe-a235-3efa5ef0456b None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:36.835577 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce71b19-f47d-4abe-a235-3efa5ef0456b None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:36.836054 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce71b19-f47d-4abe-a235-3efa5ef0456b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:36.844610 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce71b19-f47d-4abe-a235-3efa5ef0456b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:36.846120 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce71b19-f47d-4abe-a235-3efa5ef0456b None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:36.858770 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-4ce71b19-f47d-4abe-a235-3efa5ef0456b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:05:36.859911 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 612/1244] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:05:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:36.866478 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c0200-bb4e-4119-9580-c75b8ca5a9c5 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:36.967825 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c0200-bb4e-4119-9580-c75b8ca5a9c5 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:37.002397 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d7d14-fc28-4123-9c9c-d85c4324ee8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:37.003058 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d7d14-fc28-4123-9c9c-d85c4324ee8b None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:37.003343 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d7d14-fc28-4123-9c9c-d85c4324ee8b None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:37.003615 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d7d14-fc28-4123-9c9c-d85c4324ee8b None admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:37.004411 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d7d14-fc28-4123-9c9c-d85c4324ee8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:37.005321 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d7d14-fc28-4123-9c9c-d85c4324ee8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:37.007084 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d7d14-fc28-4123-9c9c-d85c4324ee8b None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:37.018553 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 633/1245] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:05:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:05:37.024567 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce71b19-f47d-4abe-a235-3efa5ef0456b None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:37.122655 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce71b19-f47d-4abe-a235-3efa5ef0456b None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:37.155086 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8493699-2922-40f1-a9fc-a7feea67adfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:37.155733 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8493699-2922-40f1-a9fc-a7feea67adfe None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:37.156016 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8493699-2922-40f1-a9fc-a7feea67adfe None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:37.156294 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8493699-2922-40f1-a9fc-a7feea67adfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:37.157167 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8493699-2922-40f1-a9fc-a7feea67adfe None admin] RBAC: Adding query filter params (role.id=04bfd9a52ca84b2db7f73121d5e57b41, scope.project.id=ec1f2c5cb900473da1083830387e3ff4, user.id=5ef0001e91524a13a9ca601a601de66b) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:37.157509 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8493699-2922-40f1-a9fc-a7feea67adfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:37.158932 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8493699-2922-40f1-a9fc-a7feea67adfe None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:37.165182 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 613/1246] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:05:37 2022] GET /identity/v3/role_assignments?user.id=5ef0001e91524a13a9ca601a601de66b&scope.project.id=ec1f2c5cb900473da1083830387e3ff4&role.id=04bfd9a52ca84b2db7f73121d5e57b41 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:39.484786 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6edacd-9ed3-4088-ba5d-887eef6c18d2 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:39.485377 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6edacd-9ed3-4088-ba5d-887eef6c18d2 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:39.485377 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6edacd-9ed3-4088-ba5d-887eef6c18d2 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:39.487141 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 634/1247] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:05:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:05:39.492584 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc77826-c58b-4552-b9d5-c272594479c4 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:39.493014 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc77826-c58b-4552-b9d5-c272594479c4 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:39.493152 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc77826-c58b-4552-b9d5-c272594479c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:39.513086 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-bfc77826-c58b-4552-b9d5-c272594479c4 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:05:39.514823 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-bfc77826-c58b-4552-b9d5-c272594479c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:05:39.584763 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 614/1248] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:05:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:05:39.607873 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6edacd-9ed3-4088-ba5d-887eef6c18d2 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:39.705969 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6edacd-9ed3-4088-ba5d-887eef6c18d2 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:39.737770 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee77663-8275-46c5-906c-0d31bc8212f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:39.738474 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee77663-8275-46c5-906c-0d31bc8212f6 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:39.738758 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee77663-8275-46c5-906c-0d31bc8212f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:39.739655 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee77663-8275-46c5-906c-0d31bc8212f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:39.749748 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee77663-8275-46c5-906c-0d31bc8212f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:05:39.757395 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-8ee77663-8275-46c5-906c-0d31bc8212f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:05:39.758565 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 635/1249] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:05:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:39.764622 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc77826-c58b-4552-b9d5-c272594479c4 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:39.860726 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc77826-c58b-4552-b9d5-c272594479c4 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:39.895628 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9181b-4c79-4264-bc47-b4c9b7eb699e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:39.896317 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9181b-4c79-4264-bc47-b4c9b7eb699e None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:39.896602 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9181b-4c79-4264-bc47-b4c9b7eb699e None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:39.896885 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9181b-4c79-4264-bc47-b4c9b7eb699e None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:39.897665 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9181b-4c79-4264-bc47-b4c9b7eb699e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:39.897974 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9181b-4c79-4264-bc47-b4c9b7eb699e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:39.899329 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9181b-4c79-4264-bc47-b4c9b7eb699e None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:39.907127 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 615/1250] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:05:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:39.912989 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee77663-8275-46c5-906c-0d31bc8212f6 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:40.013711 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee77663-8275-46c5-906c-0d31bc8212f6 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:40.047025 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb7efb-5485-4779-b6dc-426a75e64271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:40.047808 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb7efb-5485-4779-b6dc-426a75e64271 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:40.048134 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb7efb-5485-4779-b6dc-426a75e64271 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:40.048413 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb7efb-5485-4779-b6dc-426a75e64271 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:40.059519 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb7efb-5485-4779-b6dc-426a75e64271 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:40.060948 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb7efb-5485-4779-b6dc-426a75e64271 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:40.077165 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-61fb7efb-5485-4779-b6dc-426a75e64271 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:05:40.078338 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 636/1251] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:05:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:40.084361 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9181b-4c79-4264-bc47-b4c9b7eb699e None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:40.183033 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9181b-4c79-4264-bc47-b4c9b7eb699e None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:40.215042 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7ca85-5b58-489a-805e-47b1efae9e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:40.217417 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7ca85-5b58-489a-805e-47b1efae9e46 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:40.217417 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7ca85-5b58-489a-805e-47b1efae9e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:40.217417 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7ca85-5b58-489a-805e-47b1efae9e46 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:40.217417 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7ca85-5b58-489a-805e-47b1efae9e46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:40.217417 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7ca85-5b58-489a-805e-47b1efae9e46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:40.218799 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7ca85-5b58-489a-805e-47b1efae9e46 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:40.230666 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 616/1252] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:40.236505 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb7efb-5485-4779-b6dc-426a75e64271 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:40.333714 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb7efb-5485-4779-b6dc-426a75e64271 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:40.365924 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca6fe1-ceca-4316-9fc9-cbba7c012e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:40.366712 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca6fe1-ceca-4316-9fc9-cbba7c012e62 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:40.366995 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca6fe1-ceca-4316-9fc9-cbba7c012e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:40.378615 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca6fe1-ceca-4316-9fc9-cbba7c012e62 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:40.378615 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca6fe1-ceca-4316-9fc9-cbba7c012e62 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:40.378615 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca6fe1-ceca-4316-9fc9-cbba7c012e62 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:40.389357 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-11ca6fe1-ceca-4316-9fc9-cbba7c012e62 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 29 20:05:40.390595 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 637/1253] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:05:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:40.397212 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7ca85-5b58-489a-805e-47b1efae9e46 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:40.493306 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7ca85-5b58-489a-805e-47b1efae9e46 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:40.526442 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6bdfc-7ee2-4492-93cd-1060bb7bd516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:40.527118 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6bdfc-7ee2-4492-93cd-1060bb7bd516 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:40.527412 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6bdfc-7ee2-4492-93cd-1060bb7bd516 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:40.527695 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6bdfc-7ee2-4492-93cd-1060bb7bd516 None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:40.528537 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6bdfc-7ee2-4492-93cd-1060bb7bd516 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:40.528855 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6bdfc-7ee2-4492-93cd-1060bb7bd516 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:40.530323 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6bdfc-7ee2-4492-93cd-1060bb7bd516 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:40.547968 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 617/1254] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Mar 29 20:05:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:40.553810 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca6fe1-ceca-4316-9fc9-cbba7c012e62 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:40.650912 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca6fe1-ceca-4316-9fc9-cbba7c012e62 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:40.683605 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f87e0-dd62-4135-990c-5eeeef4ad0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:40.684247 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f87e0-dd62-4135-990c-5eeeef4ad0ab None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:40.684533 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f87e0-dd62-4135-990c-5eeeef4ad0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:40.684814 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f87e0-dd62-4135-990c-5eeeef4ad0ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:40.749650 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f87e0-dd62-4135-990c-5eeeef4ad0ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:40.751085 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f87e0-dd62-4135-990c-5eeeef4ad0ab None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:40.846566 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 638/1255] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:05:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 20:05:40.852503 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6bdfc-7ee2-4492-93cd-1060bb7bd516 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:40.949465 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6bdfc-7ee2-4492-93cd-1060bb7bd516 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:40.982757 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e37e72-be10-4961-9b9c-71e2ff0888c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:40.983548 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e37e72-be10-4961-9b9c-71e2ff0888c9 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:40.983830 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e37e72-be10-4961-9b9c-71e2ff0888c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:40.984107 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e37e72-be10-4961-9b9c-71e2ff0888c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:40.994375 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e37e72-be10-4961-9b9c-71e2ff0888c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:40.995886 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e37e72-be10-4961-9b9c-71e2ff0888c9 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:41.013275 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-56e37e72-be10-4961-9b9c-71e2ff0888c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:05:41.014623 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 618/1256] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:41.022163 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f87e0-dd62-4135-990c-5eeeef4ad0ab None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:41.118925 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f87e0-dd62-4135-990c-5eeeef4ad0ab None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:41.152462 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057c93b-0bfc-47ec-902b-5e6c5c835efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:41.153122 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057c93b-0bfc-47ec-902b-5e6c5c835efb None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:41.153438 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057c93b-0bfc-47ec-902b-5e6c5c835efb None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:41.153719 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057c93b-0bfc-47ec-902b-5e6c5c835efb None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:41.154429 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057c93b-0bfc-47ec-902b-5e6c5c835efb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:41.154739 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057c93b-0bfc-47ec-902b-5e6c5c835efb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:41.156097 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057c93b-0bfc-47ec-902b-5e6c5c835efb None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:41.167169 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 639/1257] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:41.172814 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e37e72-be10-4961-9b9c-71e2ff0888c9 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:41.268440 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e37e72-be10-4961-9b9c-71e2ff0888c9 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:41.299896 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc184f06-6b21-407a-9210-99fdafcc37cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:41.300708 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc184f06-6b21-407a-9210-99fdafcc37cb None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:41.300991 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc184f06-6b21-407a-9210-99fdafcc37cb None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:41.301271 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc184f06-6b21-407a-9210-99fdafcc37cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:41.308152 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc184f06-6b21-407a-9210-99fdafcc37cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:41.309625 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc184f06-6b21-407a-9210-99fdafcc37cb None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:41.323350 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-bc184f06-6b21-407a-9210-99fdafcc37cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:05:41.324508 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 619/1258] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:05:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:41.330376 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057c93b-0bfc-47ec-902b-5e6c5c835efb None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:41.428038 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057c93b-0bfc-47ec-902b-5e6c5c835efb None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:41.462707 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d012bd-9c2c-48e8-8526-b556bd9fcf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:41.463362 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d012bd-9c2c-48e8-8526-b556bd9fcf34 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:41.463642 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d012bd-9c2c-48e8-8526-b556bd9fcf34 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:41.463915 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d012bd-9c2c-48e8-8526-b556bd9fcf34 None admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:41.464708 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d012bd-9c2c-48e8-8526-b556bd9fcf34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:41.465012 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d012bd-9c2c-48e8-8526-b556bd9fcf34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:41.466485 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d012bd-9c2c-48e8-8526-b556bd9fcf34 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:41.478178 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 640/1259] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:05:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:41.484315 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc184f06-6b21-407a-9210-99fdafcc37cb None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:41.581927 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc184f06-6b21-407a-9210-99fdafcc37cb None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:41.615158 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec186c5-66df-4a9b-952d-2d5bdcbcba0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:41.615809 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec186c5-66df-4a9b-952d-2d5bdcbcba0d None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:41.616093 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec186c5-66df-4a9b-952d-2d5bdcbcba0d None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:41.619335 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec186c5-66df-4a9b-952d-2d5bdcbcba0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:41.619335 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec186c5-66df-4a9b-952d-2d5bdcbcba0d None admin] RBAC: Adding query filter params (role.id=8cfa924df1a1400986d9ecc9686a7f52, scope.project.id=ec1f2c5cb900473da1083830387e3ff4, user.id=5ef0001e91524a13a9ca601a601de66b) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:41.619335 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec186c5-66df-4a9b-952d-2d5bdcbcba0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:41.619335 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec186c5-66df-4a9b-952d-2d5bdcbcba0d None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:41.624188 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 620/1260] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:05:41 2022] GET /identity/v3/role_assignments?user.id=5ef0001e91524a13a9ca601a601de66b&scope.project.id=ec1f2c5cb900473da1083830387e3ff4&role.id=8cfa924df1a1400986d9ecc9686a7f52 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:05:43.885872 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b5fe8-e003-44cb-b53c-1653c0927a78 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:43.886504 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b5fe8-e003-44cb-b53c-1653c0927a78 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:43.886504 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b5fe8-e003-44cb-b53c-1653c0927a78 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:43.888285 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 641/1261] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:05:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:05:43.893896 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360fecd-09df-43ae-9a33-18664596250f None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:43.894375 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360fecd-09df-43ae-9a33-18664596250f None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:43.894469 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360fecd-09df-43ae-9a33-18664596250f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:43.911917 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-a360fecd-09df-43ae-9a33-18664596250f None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:05:43.913167 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-a360fecd-09df-43ae-9a33-18664596250f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:05:43.978067 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 621/1262] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:05:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:05:44.000721 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b5fe8-e003-44cb-b53c-1653c0927a78 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:44.100658 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b5fe8-e003-44cb-b53c-1653c0927a78 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:44.133428 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de2388-9730-4454-840f-cd2d323b7131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:44.134210 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de2388-9730-4454-840f-cd2d323b7131 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:44.134493 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de2388-9730-4454-840f-cd2d323b7131 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:44.134768 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de2388-9730-4454-840f-cd2d323b7131 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:44.149073 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de2388-9730-4454-840f-cd2d323b7131 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:05:44.156214 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-f2de2388-9730-4454-840f-cd2d323b7131 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:05:44.157416 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 642/1263] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:05:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:44.164329 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360fecd-09df-43ae-9a33-18664596250f None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:44.259973 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360fecd-09df-43ae-9a33-18664596250f None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:44.293698 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ea024-6ed1-4059-950d-4ddb10381f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:44.294359 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ea024-6ed1-4059-950d-4ddb10381f20 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:44.294639 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ea024-6ed1-4059-950d-4ddb10381f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:44.294912 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ea024-6ed1-4059-950d-4ddb10381f20 None admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:44.295675 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ea024-6ed1-4059-950d-4ddb10381f20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:44.295966 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ea024-6ed1-4059-950d-4ddb10381f20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:44.297354 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ea024-6ed1-4059-950d-4ddb10381f20 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:44.305714 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 622/1264] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:05:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:44.311469 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de2388-9730-4454-840f-cd2d323b7131 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:44.408291 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de2388-9730-4454-840f-cd2d323b7131 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:44.440854 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176ca1e-0663-4b61-b7ed-897467bf0c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:44.441670 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176ca1e-0663-4b61-b7ed-897467bf0c2a None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:44.441959 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176ca1e-0663-4b61-b7ed-897467bf0c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:44.442249 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176ca1e-0663-4b61-b7ed-897467bf0c2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:44.452644 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176ca1e-0663-4b61-b7ed-897467bf0c2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:44.454121 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176ca1e-0663-4b61-b7ed-897467bf0c2a None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:44.471386 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-e176ca1e-0663-4b61-b7ed-897467bf0c2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:05:44.472710 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 643/1265] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:44.479130 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ea024-6ed1-4059-950d-4ddb10381f20 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:44.585215 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ea024-6ed1-4059-950d-4ddb10381f20 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:44.616330 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1efef9-76e2-4761-b68f-bb8965e96a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:44.616978 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1efef9-76e2-4761-b68f-bb8965e96a42 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:44.617269 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1efef9-76e2-4761-b68f-bb8965e96a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:44.617568 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1efef9-76e2-4761-b68f-bb8965e96a42 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:44.618279 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1efef9-76e2-4761-b68f-bb8965e96a42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:44.618585 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1efef9-76e2-4761-b68f-bb8965e96a42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:44.619973 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1efef9-76e2-4761-b68f-bb8965e96a42 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:44.631944 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 623/1266] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:44.637725 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176ca1e-0663-4b61-b7ed-897467bf0c2a None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:44.735184 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176ca1e-0663-4b61-b7ed-897467bf0c2a None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:44.766999 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf0935-1308-4061-961b-fb5ef21e0b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:44.767792 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf0935-1308-4061-961b-fb5ef21e0b66 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:44.768072 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf0935-1308-4061-961b-fb5ef21e0b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:44.768341 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf0935-1308-4061-961b-fb5ef21e0b66 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:44.775819 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf0935-1308-4061-961b-fb5ef21e0b66 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:44.777242 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf0935-1308-4061-961b-fb5ef21e0b66 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:44.790880 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-c1bf0935-1308-4061-961b-fb5ef21e0b66 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 29 20:05:44.792021 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 644/1267] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:05:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:44.797882 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1efef9-76e2-4761-b68f-bb8965e96a42 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:44.894146 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1efef9-76e2-4761-b68f-bb8965e96a42 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:44.928148 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dd228-4a63-408b-836e-a5c76d8f9e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:44.928819 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dd228-4a63-408b-836e-a5c76d8f9e69 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:44.929105 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dd228-4a63-408b-836e-a5c76d8f9e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:44.929410 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dd228-4a63-408b-836e-a5c76d8f9e69 None admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:44.930244 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8dd228-4a63-408b-836e-a5c76d8f9e69 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:44.930554 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8dd228-4a63-408b-836e-a5c76d8f9e69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:44.931970 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8dd228-4a63-408b-836e-a5c76d8f9e69 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:44.949174 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 624/1268] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Mar 29 20:05:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:44.954938 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf0935-1308-4061-961b-fb5ef21e0b66 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:45.056964 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf0935-1308-4061-961b-fb5ef21e0b66 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:45.090109 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a198f8-fc58-4e35-b2a3-07a50c165d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:45.090895 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a198f8-fc58-4e35-b2a3-07a50c165d9d None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:45.091179 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a198f8-fc58-4e35-b2a3-07a50c165d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:45.091457 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a198f8-fc58-4e35-b2a3-07a50c165d9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:45.102196 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a198f8-fc58-4e35-b2a3-07a50c165d9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:45.103637 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a198f8-fc58-4e35-b2a3-07a50c165d9d None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:45.119486 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-42a198f8-fc58-4e35-b2a3-07a50c165d9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:05:45.120645 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 645/1269] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:45.126694 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dd228-4a63-408b-836e-a5c76d8f9e69 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:45.224771 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dd228-4a63-408b-836e-a5c76d8f9e69 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:45.256932 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f972c1c-6567-4a82-a32d-f7c90fd44464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:45.257778 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f972c1c-6567-4a82-a32d-f7c90fd44464 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:45.262521 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f972c1c-6567-4a82-a32d-f7c90fd44464 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:45.262521 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f972c1c-6567-4a82-a32d-f7c90fd44464 None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:45.262521 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f972c1c-6567-4a82-a32d-f7c90fd44464 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:45.262521 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f972c1c-6567-4a82-a32d-f7c90fd44464 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:45.262521 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f972c1c-6567-4a82-a32d-f7c90fd44464 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:45.272352 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 625/1270] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:45.278277 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a198f8-fc58-4e35-b2a3-07a50c165d9d None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:45.376929 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a198f8-fc58-4e35-b2a3-07a50c165d9d None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:45.409982 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24862310-7c47-4c16-8467-5210be23a9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:45.410778 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24862310-7c47-4c16-8467-5210be23a9cf None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:45.411075 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24862310-7c47-4c16-8467-5210be23a9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:45.411352 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24862310-7c47-4c16-8467-5210be23a9cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:45.417898 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24862310-7c47-4c16-8467-5210be23a9cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:45.419337 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24862310-7c47-4c16-8467-5210be23a9cf None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:45.432468 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-24862310-7c47-4c16-8467-5210be23a9cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:05:45.433628 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 646/1271] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:05:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 20:05:45.439537 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f972c1c-6567-4a82-a32d-f7c90fd44464 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:45.539055 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f972c1c-6567-4a82-a32d-f7c90fd44464 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:45.572280 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e281aed-f655-4819-b6c9-c873bfdea93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:45.573208 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e281aed-f655-4819-b6c9-c873bfdea93a None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:45.573523 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e281aed-f655-4819-b6c9-c873bfdea93a None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:45.573804 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e281aed-f655-4819-b6c9-c873bfdea93a None admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:45.574589 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e281aed-f655-4819-b6c9-c873bfdea93a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:45.574903 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e281aed-f655-4819-b6c9-c873bfdea93a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:45.576399 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e281aed-f655-4819-b6c9-c873bfdea93a None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:45.589140 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 626/1272] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:05:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:45.595270 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24862310-7c47-4c16-8467-5210be23a9cf None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:45.691451 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24862310-7c47-4c16-8467-5210be23a9cf None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:45.724137 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bff65d-a5b4-441b-92bc-f3bc75e2e873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:45.725013 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bff65d-a5b4-441b-92bc-f3bc75e2e873 None admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:45.725303 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bff65d-a5b4-441b-92bc-f3bc75e2e873 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:45.725604 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bff65d-a5b4-441b-92bc-f3bc75e2e873 None admin] PATH_INFO: `/v3/projects/ec1f2c5cb900473da1083830387e3ff4/users/5ef0001e91524a13a9ca601a601de66b/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:45.727557 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bff65d-a5b4-441b-92bc-f3bc75e2e873 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec1f2c5cb900473da1083830387e3ff4, user_id=5ef0001e91524a13a9ca601a601de66b, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:45.728982 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bff65d-a5b4-441b-92bc-f3bc75e2e873 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:45.888070 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 647/1273] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Mar 29 20:05:45 2022] PUT /identity/v3/projects/ec1f2c5cb900473da1083830387e3ff4/users/5ef0001e91524a13a9ca601a601de66b/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:05:48.205928 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528700b-1dcb-468b-9aba-35dfae6a213f None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:48.206450 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528700b-1dcb-468b-9aba-35dfae6a213f None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:48.206450 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528700b-1dcb-468b-9aba-35dfae6a213f None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:48.208796 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 627/1274] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:05:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:05:48.214107 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd1d78-871d-4af0-b19b-6b5051efa220 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:48.214503 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd1d78-871d-4af0-b19b-6b5051efa220 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:48.214653 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd1d78-871d-4af0-b19b-6b5051efa220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:48.232127 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-39bd1d78-871d-4af0-b19b-6b5051efa220 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:05:48.233307 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-39bd1d78-871d-4af0-b19b-6b5051efa220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:05:48.298297 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 648/1275] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:05:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:05:48.323199 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528700b-1dcb-468b-9aba-35dfae6a213f None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:48.421396 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528700b-1dcb-468b-9aba-35dfae6a213f None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:48.454424 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e16473-3bf7-4ca9-b7b4-bc721e5eda2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:48.455279 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e16473-3bf7-4ca9-b7b4-bc721e5eda2b None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:48.455563 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e16473-3bf7-4ca9-b7b4-bc721e5eda2b None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:48.455841 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e16473-3bf7-4ca9-b7b4-bc721e5eda2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:48.469209 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e16473-3bf7-4ca9-b7b4-bc721e5eda2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 20:05:48.473733 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-a0e16473-3bf7-4ca9-b7b4-bc721e5eda2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 20:05:48.474957 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 628/1276] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Mar 29 20:05:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:48.481015 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd1d78-871d-4af0-b19b-6b5051efa220 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:48.575926 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd1d78-871d-4af0-b19b-6b5051efa220 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:48.609037 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50eeaa5-baf9-4b6a-9aa4-923509a7ea58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:48.609726 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50eeaa5-baf9-4b6a-9aa4-923509a7ea58 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:48.610015 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50eeaa5-baf9-4b6a-9aa4-923509a7ea58 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:48.610297 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50eeaa5-baf9-4b6a-9aa4-923509a7ea58 None admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:48.611033 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50eeaa5-baf9-4b6a-9aa4-923509a7ea58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:48.611344 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50eeaa5-baf9-4b6a-9aa4-923509a7ea58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:48.612720 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50eeaa5-baf9-4b6a-9aa4-923509a7ea58 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:48.620936 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 649/1277] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Mar 29 20:05:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:48.626601 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e16473-3bf7-4ca9-b7b4-bc721e5eda2b None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:48.725632 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e16473-3bf7-4ca9-b7b4-bc721e5eda2b None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:48.758462 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3dbb4b-8e5b-40cf-87ed-d2f0f880fb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:48.765996 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3dbb4b-8e5b-40cf-87ed-d2f0f880fb3e None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:48.765996 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3dbb4b-8e5b-40cf-87ed-d2f0f880fb3e None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:48.765996 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3dbb4b-8e5b-40cf-87ed-d2f0f880fb3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:48.769973 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3dbb4b-8e5b-40cf-87ed-d2f0f880fb3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:48.771526 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3dbb4b-8e5b-40cf-87ed-d2f0f880fb3e None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:48.787378 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-db3dbb4b-8e5b-40cf-87ed-d2f0f880fb3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:05:48.788524 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 629/1278] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:48.794270 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50eeaa5-baf9-4b6a-9aa4-923509a7ea58 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:48.889696 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50eeaa5-baf9-4b6a-9aa4-923509a7ea58 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:48.922365 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab9cb7-e2af-44d8-8829-c6f53406926b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:48.923099 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab9cb7-e2af-44d8-8829-c6f53406926b None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:48.923342 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab9cb7-e2af-44d8-8829-c6f53406926b None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:48.923618 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab9cb7-e2af-44d8-8829-c6f53406926b None admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:48.924328 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab9cb7-e2af-44d8-8829-c6f53406926b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:48.924632 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab9cb7-e2af-44d8-8829-c6f53406926b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:48.926012 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab9cb7-e2af-44d8-8829-c6f53406926b None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:48.938039 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 650/1279] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:48.944028 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3dbb4b-8e5b-40cf-87ed-d2f0f880fb3e None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:49.045101 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3dbb4b-8e5b-40cf-87ed-d2f0f880fb3e None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:49.082499 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b01d6-11aa-44ff-80fb-d94bb636d376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:49.084588 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b01d6-11aa-44ff-80fb-d94bb636d376 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:49.084871 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b01d6-11aa-44ff-80fb-d94bb636d376 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:49.085147 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b01d6-11aa-44ff-80fb-d94bb636d376 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:49.093903 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b01d6-11aa-44ff-80fb-d94bb636d376 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:49.095450 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b01d6-11aa-44ff-80fb-d94bb636d376 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:49.110755 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-522b01d6-11aa-44ff-80fb-d94bb636d376 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 29 20:05:49.112257 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 630/1280] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:05:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:49.119453 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab9cb7-e2af-44d8-8829-c6f53406926b None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:49.227229 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab9cb7-e2af-44d8-8829-c6f53406926b None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:49.262823 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342b17d-4ec7-4bae-8996-2aeb38e7d8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:49.263515 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342b17d-4ec7-4bae-8996-2aeb38e7d8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:49.263806 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342b17d-4ec7-4bae-8996-2aeb38e7d8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:49.264092 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342b17d-4ec7-4bae-8996-2aeb38e7d8d6 None admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:49.264927 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342b17d-4ec7-4bae-8996-2aeb38e7d8d6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:49.265249 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342b17d-4ec7-4bae-8996-2aeb38e7d8d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:49.266743 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342b17d-4ec7-4bae-8996-2aeb38e7d8d6 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:49.286867 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 651/1281] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Mar 29 20:05:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:49.292776 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b01d6-11aa-44ff-80fb-d94bb636d376 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:49.398451 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b01d6-11aa-44ff-80fb-d94bb636d376 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:49.432751 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88942b90-939b-44ad-9fd1-bba68138882d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:49.433442 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88942b90-939b-44ad-9fd1-bba68138882d None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:49.433726 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88942b90-939b-44ad-9fd1-bba68138882d None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:49.434004 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88942b90-939b-44ad-9fd1-bba68138882d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:49.501687 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88942b90-939b-44ad-9fd1-bba68138882d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:49.503129 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88942b90-939b-44ad-9fd1-bba68138882d None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:49.599868 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 631/1282] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Mar 29 20:05:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 20:05:49.605636 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342b17d-4ec7-4bae-8996-2aeb38e7d8d6 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:49.701515 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342b17d-4ec7-4bae-8996-2aeb38e7d8d6 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:49.733070 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa640a-df2b-4b7c-9d0d-9e208ad11da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:49.733883 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa640a-df2b-4b7c-9d0d-9e208ad11da8 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:49.734167 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa640a-df2b-4b7c-9d0d-9e208ad11da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:49.734443 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa640a-df2b-4b7c-9d0d-9e208ad11da8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:49.744796 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa640a-df2b-4b7c-9d0d-9e208ad11da8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:49.746264 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa640a-df2b-4b7c-9d0d-9e208ad11da8 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:49.762937 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-79fa640a-df2b-4b7c-9d0d-9e208ad11da8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 20:05:49.764193 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 652/1283] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:49.769966 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88942b90-939b-44ad-9fd1-bba68138882d None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:49.868257 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88942b90-939b-44ad-9fd1-bba68138882d None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:49.901837 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a42a1-2d29-47f6-aa9f-045f5257c8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:49.902482 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a42a1-2d29-47f6-aa9f-045f5257c8be None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:49.902763 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a42a1-2d29-47f6-aa9f-045f5257c8be None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:49.903038 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a42a1-2d29-47f6-aa9f-045f5257c8be None admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:49.903743 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a42a1-2d29-47f6-aa9f-045f5257c8be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:49.904046 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a42a1-2d29-47f6-aa9f-045f5257c8be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:49.905415 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a42a1-2d29-47f6-aa9f-045f5257c8be None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:49.917894 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 632/1284] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Mar 29 20:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:49.924161 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa640a-df2b-4b7c-9d0d-9e208ad11da8 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:50.022164 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa640a-df2b-4b7c-9d0d-9e208ad11da8 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:50.056220 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fa299-6155-43b8-8cfb-842198223948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:50.056998 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fa299-6155-43b8-8cfb-842198223948 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:50.057277 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fa299-6155-43b8-8cfb-842198223948 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:50.057651 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fa299-6155-43b8-8cfb-842198223948 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:50.064132 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fa299-6155-43b8-8cfb-842198223948 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:50.065589 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fa299-6155-43b8-8cfb-842198223948 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:50.079415 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING keystone.server.flask.application [None req-819fa299-6155-43b8-8cfb-842198223948 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 20:05:50.080627 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 653/1285] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Mar 29 20:05:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:50.087291 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a42a1-2d29-47f6-aa9f-045f5257c8be None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:50.181945 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a42a1-2d29-47f6-aa9f-045f5257c8be None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:50.213658 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ae1c0-d94a-4432-be22-2235d319b618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:50.214303 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ae1c0-d94a-4432-be22-2235d319b618 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:50.214631 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ae1c0-d94a-4432-be22-2235d319b618 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:50.214906 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ae1c0-d94a-4432-be22-2235d319b618 None admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:50.215678 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ae1c0-d94a-4432-be22-2235d319b618 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:50.215987 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ae1c0-d94a-4432-be22-2235d319b618 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:50.217430 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ae1c0-d94a-4432-be22-2235d319b618 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:50.229842 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 633/1286] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Mar 29 20:05:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:50.235822 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fa299-6155-43b8-8cfb-842198223948 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:50.333963 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fa299-6155-43b8-8cfb-842198223948 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:50.365805 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a0e2d-1a25-4111-9391-10a7d0beb199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:50.366485 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a0e2d-1a25-4111-9391-10a7d0beb199 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:50.366773 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a0e2d-1a25-4111-9391-10a7d0beb199 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:50.367054 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a0e2d-1a25-4111-9391-10a7d0beb199 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:50.367866 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a0e2d-1a25-4111-9391-10a7d0beb199 None admin] RBAC: Adding query filter params (role.id=8cfa924df1a1400986d9ecc9686a7f52, scope.project.id=ec1f2c5cb900473da1083830387e3ff4, user.id=5ef0001e91524a13a9ca601a601de66b) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:50.368189 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a0e2d-1a25-4111-9391-10a7d0beb199 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:50.369641 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a0e2d-1a25-4111-9391-10a7d0beb199 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:50.375174 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 654/1287] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Mar 29 20:05:50 2022] GET /identity/v3/role_assignments?user.id=5ef0001e91524a13a9ca601a601de66b&scope.project.id=ec1f2c5cb900473da1083830387e3ff4&role.id=8cfa924df1a1400986d9ecc9686a7f52 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:52.700685 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f8827-3bc1-4951-91e8-c4f27abf647d None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:52.701226 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f8827-3bc1-4951-91e8-c4f27abf647d None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:52.701343 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f8827-3bc1-4951-91e8-c4f27abf647d None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:52.703090 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 634/1288] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:05:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:05:52.708297 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71de7b-a3bf-49b8-848b-8fa95730a421 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:52.708722 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71de7b-a3bf-49b8-848b-8fa95730a421 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:52.708857 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71de7b-a3bf-49b8-848b-8fa95730a421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:52.726292 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-4a71de7b-a3bf-49b8-848b-8fa95730a421 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:05:52.727443 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-4a71de7b-a3bf-49b8-848b-8fa95730a421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:05:52.792916 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 655/1289] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:05:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 20:05:52.815496 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f8827-3bc1-4951-91e8-c4f27abf647d None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:52.928600 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f8827-3bc1-4951-91e8-c4f27abf647d None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:52.962976 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f389e-888f-438c-8aa3-7ee196d20d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:52.963704 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f389e-888f-438c-8aa3-7ee196d20d03 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:52.963988 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f389e-888f-438c-8aa3-7ee196d20d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:52.964267 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f389e-888f-438c-8aa3-7ee196d20d03 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:52.964918 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f389e-888f-438c-8aa3-7ee196d20d03 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:52.966316 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f389e-888f-438c-8aa3-7ee196d20d03 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:52.977919 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-db0f389e-888f-438c-8aa3-7ee196d20d03 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 29 20:05:52.980253 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 635/1290] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Mar 29 20:05:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:52.985199 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71de7b-a3bf-49b8-848b-8fa95730a421 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:53.078299 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71de7b-a3bf-49b8-848b-8fa95730a421 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:53.110645 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63d2c1-1edb-4a34-8627-84d3148ec422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:53.111289 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63d2c1-1edb-4a34-8627-84d3148ec422 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:53.111571 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63d2c1-1edb-4a34-8627-84d3148ec422 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:53.111848 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63d2c1-1edb-4a34-8627-84d3148ec422 None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:53.112538 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63d2c1-1edb-4a34-8627-84d3148ec422 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:53.112845 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63d2c1-1edb-4a34-8627-84d3148ec422 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:53.114806 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63d2c1-1edb-4a34-8627-84d3148ec422 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:53.119464 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 656/1291] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Mar 29 20:05:52 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:53.125170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f389e-888f-438c-8aa3-7ee196d20d03 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:53.222573 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f389e-888f-438c-8aa3-7ee196d20d03 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:53.256197 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce8966-c2b8-4146-837f-dddae1791965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:53.256844 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce8966-c2b8-4146-837f-dddae1791965 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:53.257126 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce8966-c2b8-4146-837f-dddae1791965 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:53.257429 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce8966-c2b8-4146-837f-dddae1791965 None admin] PATH_INFO: `/v3/services` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:53.258121 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce8966-c2b8-4146-837f-dddae1791965 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:53.258425 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce8966-c2b8-4146-837f-dddae1791965 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:53.259768 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce8966-c2b8-4146-837f-dddae1791965 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:53.263967 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 636/1292] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Mar 29 20:05:53 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:55.525943 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc31c79-6745-459a-a8f9-56b8a099a335 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:55.526478 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc31c79-6745-459a-a8f9-56b8a099a335 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:55.526478 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc31c79-6745-459a-a8f9-56b8a099a335 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:55.528269 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 657/1293] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:05:55.533441 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e37f23-88ac-48e7-8ec3-0e2dbad2eb6f None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:55.533823 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e37f23-88ac-48e7-8ec3-0e2dbad2eb6f None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:55.534029 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e37f23-88ac-48e7-8ec3-0e2dbad2eb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:55.551562 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-40e37f23-88ac-48e7-8ec3-0e2dbad2eb6f None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:05:55.552858 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-40e37f23-88ac-48e7-8ec3-0e2dbad2eb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:05:55.616610 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 637/1294] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:05:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:05:55.639187 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc31c79-6745-459a-a8f9-56b8a099a335 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:55.737439 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc31c79-6745-459a-a8f9-56b8a099a335 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:55.769811 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cd8b6-e43d-4861-9815-abb1fb1d824b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:55.771526 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cd8b6-e43d-4861-9815-abb1fb1d824b None admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:55.771823 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cd8b6-e43d-4861-9815-abb1fb1d824b None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:55.772107 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cd8b6-e43d-4861-9815-abb1fb1d824b None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:55.772825 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4cd8b6-e43d-4861-9815-abb1fb1d824b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:55.774208 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4cd8b6-e43d-4861-9815-abb1fb1d824b None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:55.914086 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 658/1295] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Mar 29 20:05:55 2022] POST /identity/v3/services => generated 246 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:05:58.188498 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a01883-9284-4ff5-8ff7-1569a25ad3f9 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:58.189050 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a01883-9284-4ff5-8ff7-1569a25ad3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:58.189050 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a01883-9284-4ff5-8ff7-1569a25ad3f9 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:58.190814 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 638/1296] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:05:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:05:58.196864 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e49711-69a4-4717-b58f-208053e98d33 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:58.197318 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e49711-69a4-4717-b58f-208053e98d33 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:58.197467 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e49711-69a4-4717-b58f-208053e98d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:58.214768 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-58e49711-69a4-4717-b58f-208053e98d33 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:05:58.215950 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-58e49711-69a4-4717-b58f-208053e98d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:05:58.285598 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 659/1297] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:05:58 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:05:58.308292 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a01883-9284-4ff5-8ff7-1569a25ad3f9 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:58.406851 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a01883-9284-4ff5-8ff7-1569a25ad3f9 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:58.439457 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb5367-b495-4c6c-b6e6-4f4845fbbf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:58.440175 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb5367-b495-4c6c-b6e6-4f4845fbbf81 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:58.440456 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb5367-b495-4c6c-b6e6-4f4845fbbf81 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:58.440734 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb5367-b495-4c6c-b6e6-4f4845fbbf81 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:58.441426 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb5367-b495-4c6c-b6e6-4f4845fbbf81 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:58.447755 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb5367-b495-4c6c-b6e6-4f4845fbbf81 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:58.454897 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-03fb5367-b495-4c6c-b6e6-4f4845fbbf81 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 29 20:05:58.456021 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 639/1298] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Mar 29 20:05:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:05:58.462662 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e49711-69a4-4717-b58f-208053e98d33 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:58.558337 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e49711-69a4-4717-b58f-208053e98d33 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:58.591175 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb672746-f1bf-4874-a54e-52a1fd917159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:58.591834 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb672746-f1bf-4874-a54e-52a1fd917159 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:58.592117 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb672746-f1bf-4874-a54e-52a1fd917159 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:58.592396 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb672746-f1bf-4874-a54e-52a1fd917159 None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:58.593125 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb672746-f1bf-4874-a54e-52a1fd917159 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:58.593464 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb672746-f1bf-4874-a54e-52a1fd917159 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:58.594831 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb672746-f1bf-4874-a54e-52a1fd917159 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:58.600335 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 660/1299] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Mar 29 20:05:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:58.606260 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb5367-b495-4c6c-b6e6-4f4845fbbf81 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:58.702861 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb5367-b495-4c6c-b6e6-4f4845fbbf81 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:58.733955 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942380f-bd84-493e-8d5e-335a60fbf5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:58.734597 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942380f-bd84-493e-8d5e-335a60fbf5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:58.734880 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942380f-bd84-493e-8d5e-335a60fbf5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:58.735155 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942380f-bd84-493e-8d5e-335a60fbf5a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:58.735931 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942380f-bd84-493e-8d5e-335a60fbf5a0 None admin] RBAC: Adding query filter params (interface=public, service_id=b0c086269b5e421aaf8315edb3a9f68d, region_id=RegionOne) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:05:58.736243 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942380f-bd84-493e-8d5e-335a60fbf5a0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:58.737620 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942380f-bd84-493e-8d5e-335a60fbf5a0 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:58.742950 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 640/1300] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Mar 29 20:05:58 2022] GET /identity/v3/endpoints?service_id=b0c086269b5e421aaf8315edb3a9f68d&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:05:58.748678 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb672746-f1bf-4874-a54e-52a1fd917159 None admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:05:58.847085 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb672746-f1bf-4874-a54e-52a1fd917159 None admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:05:58.880265 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46d4ff-535b-45d9-b4c5-901564d75683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:05:58.880928 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46d4ff-535b-45d9-b4c5-901564d75683 None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:05:58.881189 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46d4ff-535b-45d9-b4c5-901564d75683 None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:05:58.881494 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46d4ff-535b-45d9-b4c5-901564d75683 None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:05:58.882157 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46d4ff-535b-45d9-b4c5-901564d75683 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:05:58.883533 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46d4ff-535b-45d9-b4c5-901564d75683 None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:05:58.890125 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 661/1301] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Mar 29 20:05:58 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:06:01.208104 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9196a4b-dc0f-4570-88ad-2a02c5d36fe2 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:06:01.208677 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9196a4b-dc0f-4570-88ad-2a02c5d36fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:06:01.208774 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9196a4b-dc0f-4570-88ad-2a02c5d36fe2 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:06:01.210569 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 641/1302] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:06:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:06:01.215614 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e354dfe-764c-4578-a9db-e476f9ec07af None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:06:01.216039 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e354dfe-764c-4578-a9db-e476f9ec07af None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:06:01.216163 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e354dfe-764c-4578-a9db-e476f9ec07af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:06:01.233869 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-8e354dfe-764c-4578-a9db-e476f9ec07af None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:06:01.235045 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-8e354dfe-764c-4578-a9db-e476f9ec07af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:06:01.298861 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 662/1303] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:06:01 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 20:06:01.322840 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9196a4b-dc0f-4570-88ad-2a02c5d36fe2 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:06:01.422812 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9196a4b-dc0f-4570-88ad-2a02c5d36fe2 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:06:01.454137 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c602a3d-d250-4dee-96d3-1d01fabcae56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:06:01.454929 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c602a3d-d250-4dee-96d3-1d01fabcae56 None admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:06:01.455210 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c602a3d-d250-4dee-96d3-1d01fabcae56 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:06:01.455486 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c602a3d-d250-4dee-96d3-1d01fabcae56 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:06:01.456134 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c602a3d-d250-4dee-96d3-1d01fabcae56 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:06:01.457514 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c602a3d-d250-4dee-96d3-1d01fabcae56 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:06:01.469133 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING keystone.server.flask.application [None req-1c602a3d-d250-4dee-96d3-1d01fabcae56 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 29 20:06:01.470239 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 642/1304] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Mar 29 20:06:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 20:06:01.476625 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e354dfe-764c-4578-a9db-e476f9ec07af None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:06:01.572147 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e354dfe-764c-4578-a9db-e476f9ec07af None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:06:01.605145 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01456cf5-43b8-4aad-948f-72c5e6640e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:06:01.605830 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01456cf5-43b8-4aad-948f-72c5e6640e4e None admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:06:01.607231 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01456cf5-43b8-4aad-948f-72c5e6640e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:06:01.607231 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01456cf5-43b8-4aad-948f-72c5e6640e4e None admin] PATH_INFO: `/v3/services` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:06:01.607231 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01456cf5-43b8-4aad-948f-72c5e6640e4e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:06:01.607499 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01456cf5-43b8-4aad-948f-72c5e6640e4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:06:01.608863 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01456cf5-43b8-4aad-948f-72c5e6640e4e None admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:06:01.613943 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 663/1305] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Mar 29 20:06:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:06:01.620236 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c602a3d-d250-4dee-96d3-1d01fabcae56 None admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:06:01.716595 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c602a3d-d250-4dee-96d3-1d01fabcae56 None admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:06:01.748329 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5269be-45f4-4093-9916-5733d72b8d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:06:01.748977 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5269be-45f4-4093-9916-5733d72b8d28 None admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:06:01.749261 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5269be-45f4-4093-9916-5733d72b8d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:06:01.749573 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5269be-45f4-4093-9916-5733d72b8d28 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:06:01.750316 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5269be-45f4-4093-9916-5733d72b8d28 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:06:01.751671 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5269be-45f4-4093-9916-5733d72b8d28 None admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:06:01.825212 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 643/1306] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Mar 29 20:06:01 2022] POST /identity/v3/endpoints => generated 331 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:12:12.921460 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d798e-e42f-4334-b029-b9e3897af3bd None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:12.922430 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d798e-e42f-4334-b029-b9e3897af3bd None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:12.922923 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d798e-e42f-4334-b029-b9e3897af3bd None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:12.930708 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230d093-3afc-4ef3-81f8-e88640de91d3 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:12.931637 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230d093-3afc-4ef3-81f8-e88640de91d3 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:12.932087 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230d093-3afc-4ef3-81f8-e88640de91d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:12.936267 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 664/1307] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:12:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:12:13.016452 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-8230d093-3afc-4ef3-81f8-e88640de91d3 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:12:13.018076 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-8230d093-3afc-4ef3-81f8-e88640de91d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:13.141746 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 644/1308] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:12:13.179621 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b3731-d0fc-43c2-81be-d880d459746f None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:13.180290 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b3731-d0fc-43c2-81be-d880d459746f None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:13.180783 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b3731-d0fc-43c2-81be-d880d459746f None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:13.182863 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 665/1309] 10.222.0.43 () {54 vars in 963 bytes} [Tue Mar 29 20:12:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:12:13.189063 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7144aa-523a-4957-b4ec-b2fe01bd6297 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:13.189645 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7144aa-523a-4957-b4ec-b2fe01bd6297 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:13.190146 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7144aa-523a-4957-b4ec-b2fe01bd6297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:13.276175 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-9c7144aa-523a-4957-b4ec-b2fe01bd6297 None None] MFA Rules not processed for user `22bdaa02b1b14be3837b337fbf6e0eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:12:13.277803 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9c7144aa-523a-4957-b4ec-b2fe01bd6297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:13.427463 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b3731-d0fc-43c2-81be-d880d459746f None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:12:13.430519 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b97b3731-d0fc-43c2-81be-d880d459746f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:13.441378 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 645/1310] 10.222.0.43 () {58 vars in 1060 bytes} [Tue Mar 29 20:12:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:12:13.609444 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b3731-d0fc-43c2-81be-d880d459746f None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:12:13.689280 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b4ec5-2d21-47cd-973b-3614ec0dab49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:12:13.692429 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b4ec5-2d21-47cd-973b-3614ec0dab49 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:13.692429 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b4ec5-2d21-47cd-973b-3614ec0dab49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:13.692429 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b4ec5-2d21-47cd-973b-3614ec0dab49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:13.692429 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b76b4ec5-2d21-47cd-973b-3614ec0dab49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:13.809453 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b4ec5-2d21-47cd-973b-3614ec0dab49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:12:13.811104 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b4ec5-2d21-47cd-973b-3614ec0dab49 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:12:13.832150 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 666/1311] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:12:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:12:16.420723 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04eec4-fd1b-48b1-b14e-f3aba46a9936 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:16.421238 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04eec4-fd1b-48b1-b14e-f3aba46a9936 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:16.421363 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04eec4-fd1b-48b1-b14e-f3aba46a9936 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:16.423104 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 646/1312] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:12:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:12:16.429901 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216a845-08c3-4166-a59b-632d4b435bbe None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:16.429901 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216a845-08c3-4166-a59b-632d4b435bbe None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:16.429901 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216a845-08c3-4166-a59b-632d4b435bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:16.502148 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-9216a845-08c3-4166-a59b-632d4b435bbe None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:12:16.503372 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-9216a845-08c3-4166-a59b-632d4b435bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:16.598357 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 667/1313] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:12:16.638681 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04eec4-fd1b-48b1-b14e-f3aba46a9936 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:12:16.640211 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-1f04eec4-fd1b-48b1-b14e-f3aba46a9936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:16.745118 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04eec4-fd1b-48b1-b14e-f3aba46a9936 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:12:16.816952 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b9a32-1f8a-4f87-8d70-9109434e4f9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:12:16.817552 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b9a32-1f8a-4f87-8d70-9109434e4f9d service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:16.817843 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b9a32-1f8a-4f87-8d70-9109434e4f9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:16.818789 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b9a32-1f8a-4f87-8d70-9109434e4f9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:16.820422 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-5f2b9a32-1f8a-4f87-8d70-9109434e4f9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:16.925939 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b9a32-1f8a-4f87-8d70-9109434e4f9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:12:16.927437 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b9a32-1f8a-4f87-8d70-9109434e4f9d service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:12:16.946787 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 647/1314] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:12:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:12:19.823241 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a66325-147d-45c4-b40c-0a0e38bb820c None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:19.823814 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a66325-147d-45c4-b40c-0a0e38bb820c None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:19.823814 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a66325-147d-45c4-b40c-0a0e38bb820c None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:19.825616 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 668/1315] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:12:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:12:19.831171 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fda33e-197d-426e-9862-27a4af06372d None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:19.831734 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fda33e-197d-426e-9862-27a4af06372d None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:19.831837 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fda33e-197d-426e-9862-27a4af06372d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:19.900879 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-34fda33e-197d-426e-9862-27a4af06372d None None] MFA Rules not processed for user `1aa2a0d7c3c94ca69150064a665859b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:12:19.902100 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-34fda33e-197d-426e-9862-27a4af06372d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:19.998299 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 648/1316] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:12:19 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:12:20.038839 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a66325-147d-45c4-b40c-0a0e38bb820c None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:12:20.040346 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-11a66325-147d-45c4-b40c-0a0e38bb820c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:20.149541 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a66325-147d-45c4-b40c-0a0e38bb820c None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:12:20.221343 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8fa02-305a-4b05-8980-640d9928e378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:12:20.221988 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8fa02-305a-4b05-8980-640d9928e378 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:20.222313 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8fa02-305a-4b05-8980-640d9928e378 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:20.222589 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8fa02-305a-4b05-8980-640d9928e378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:20.225396 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-28d8fa02-305a-4b05-8980-640d9928e378 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:20.333008 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8fa02-305a-4b05-8980-640d9928e378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:12:20.335201 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8fa02-305a-4b05-8980-640d9928e378 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:12:20.361103 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 669/1317] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:12:20 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:12:23.463501 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396a21d-4deb-4c9f-a3fa-822fd5aeb80a None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:23.464114 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396a21d-4deb-4c9f-a3fa-822fd5aeb80a None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:23.464114 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396a21d-4deb-4c9f-a3fa-822fd5aeb80a None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:23.465880 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 649/1318] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:12:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:12:23.470868 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d1e31-9f8e-49cf-8361-4c82f996853d None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:23.471273 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d1e31-9f8e-49cf-8361-4c82f996853d None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:23.471433 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d1e31-9f8e-49cf-8361-4c82f996853d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:23.534795 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-0d3d1e31-9f8e-49cf-8361-4c82f996853d None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:12:23.535988 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-0d3d1e31-9f8e-49cf-8361-4c82f996853d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:23.630428 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 670/1319] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:12:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:12:23.684459 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78318fbd-9791-44a4-9432-6ccec7596ce8 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:23.684756 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78318fbd-9791-44a4-9432-6ccec7596ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:23.685049 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78318fbd-9791-44a4-9432-6ccec7596ce8 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:23.686890 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 650/1320] 10.222.0.43 () {54 vars in 963 bytes} [Tue Mar 29 20:12:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:12:23.692615 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b313910-4387-4ff0-96ec-ece18155b2ff None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:23.693076 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b313910-4387-4ff0-96ec-ece18155b2ff None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:23.693396 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b313910-4387-4ff0-96ec-ece18155b2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:23.766227 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-9b313910-4387-4ff0-96ec-ece18155b2ff None None] MFA Rules not processed for user `22bdaa02b1b14be3837b337fbf6e0eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:12:23.779698 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-9b313910-4387-4ff0-96ec-ece18155b2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:23.839850 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 671/1321] 10.222.0.43 () {58 vars in 1060 bytes} [Tue Mar 29 20:12:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:12:23.849554 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78318fbd-9791-44a4-9432-6ccec7596ce8 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:12:23.851203 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-78318fbd-9791-44a4-9432-6ccec7596ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:23.953584 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78318fbd-9791-44a4-9432-6ccec7596ce8 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:12:24.023392 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca420e-862b-4ccd-a1d4-f5ce56a83832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:12:24.023977 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca420e-862b-4ccd-a1d4-f5ce56a83832 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:24.024263 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca420e-862b-4ccd-a1d4-f5ce56a83832 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:24.024538 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca420e-862b-4ccd-a1d4-f5ce56a83832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:24.026181 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-5eca420e-862b-4ccd-a1d4-f5ce56a83832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:24.129167 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca420e-862b-4ccd-a1d4-f5ce56a83832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:12:24.130662 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca420e-862b-4ccd-a1d4-f5ce56a83832 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:12:24.148810 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 651/1322] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:12:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:12:27.887046 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7dd6e-bca8-4a23-a78f-1f7bba744eb2 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:27.887615 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7dd6e-bca8-4a23-a78f-1f7bba744eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:27.887704 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7dd6e-bca8-4a23-a78f-1f7bba744eb2 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:27.889520 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 672/1323] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:12:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:12:27.894824 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd6c94-1c00-4a35-99d0-89603f3c0ded None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:27.895232 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd6c94-1c00-4a35-99d0-89603f3c0ded None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:27.895400 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd6c94-1c00-4a35-99d0-89603f3c0ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:27.960345 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-38dd6c94-1c00-4a35-99d0-89603f3c0ded None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:12:27.961646 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-38dd6c94-1c00-4a35-99d0-89603f3c0ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:28.054889 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 652/1324] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:12:28.091594 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7dd6e-bca8-4a23-a78f-1f7bba744eb2 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:12:28.093120 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-3da7dd6e-bca8-4a23-a78f-1f7bba744eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:28.191064 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7dd6e-bca8-4a23-a78f-1f7bba744eb2 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:12:28.263388 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bde56-c256-44c6-92a2-c28880fb757c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:12:28.264074 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bde56-c256-44c6-92a2-c28880fb757c service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:28.264338 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bde56-c256-44c6-92a2-c28880fb757c service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:28.264611 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bde56-c256-44c6-92a2-c28880fb757c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:28.266259 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-c89bde56-c256-44c6-92a2-c28880fb757c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:28.373534 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bde56-c256-44c6-92a2-c28880fb757c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:12:28.374977 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bde56-c256-44c6-92a2-c28880fb757c service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:12:28.392676 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 673/1325] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:12:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:12:30.806872 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eee4fa-b87c-4c57-bcca-ea46af363fc0 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:30.807434 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eee4fa-b87c-4c57-bcca-ea46af363fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:30.807434 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eee4fa-b87c-4c57-bcca-ea46af363fc0 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:30.809203 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 653/1326] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:12:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:12:30.814586 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621282c-bd2e-471a-9d1d-8720f6575e91 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:30.815071 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621282c-bd2e-471a-9d1d-8720f6575e91 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:30.815167 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621282c-bd2e-471a-9d1d-8720f6575e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:30.882633 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-5621282c-bd2e-471a-9d1d-8720f6575e91 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:12:30.883812 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-5621282c-bd2e-471a-9d1d-8720f6575e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:30.980105 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 674/1327] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:12:31.016129 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eee4fa-b87c-4c57-bcca-ea46af363fc0 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:12:31.017708 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-a6eee4fa-b87c-4c57-bcca-ea46af363fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:31.121169 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eee4fa-b87c-4c57-bcca-ea46af363fc0 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:12:31.193792 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5dad39-8ce8-4e8c-b36b-763cc30b7658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:12:31.194442 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dad39-8ce8-4e8c-b36b-763cc30b7658 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:31.194739 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dad39-8ce8-4e8c-b36b-763cc30b7658 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:31.195021 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dad39-8ce8-4e8c-b36b-763cc30b7658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:31.196926 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-ce5dad39-8ce8-4e8c-b36b-763cc30b7658 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:31.304149 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5dad39-8ce8-4e8c-b36b-763cc30b7658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:12:31.305607 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5dad39-8ce8-4e8c-b36b-763cc30b7658 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:12:31.323977 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 654/1328] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:12:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:12:33.651406 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c54daf-2570-4cac-a65c-cac6ebcf81d8 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:33.651996 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c54daf-2570-4cac-a65c-cac6ebcf81d8 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:33.651996 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c54daf-2570-4cac-a65c-cac6ebcf81d8 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:33.653830 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 675/1329] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:12:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:12:33.659237 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a3c44-ec0a-4e78-9af7-7d9dd6750d56 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:33.659653 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a3c44-ec0a-4e78-9af7-7d9dd6750d56 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:33.659822 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a3c44-ec0a-4e78-9af7-7d9dd6750d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:33.725021 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-033a3c44-ec0a-4e78-9af7-7d9dd6750d56 None None] MFA Rules not processed for user `1aa2a0d7c3c94ca69150064a665859b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:12:33.726243 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-033a3c44-ec0a-4e78-9af7-7d9dd6750d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:33.818790 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 655/1330] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:12:33 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:12:33.857154 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c54daf-2570-4cac-a65c-cac6ebcf81d8 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:12:33.858738 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-d4c54daf-2570-4cac-a65c-cac6ebcf81d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:33.964096 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c54daf-2570-4cac-a65c-cac6ebcf81d8 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:12:34.044512 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55422efe-d256-49ae-9146-41b06fc86740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:12:34.045161 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55422efe-d256-49ae-9146-41b06fc86740 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:34.045476 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55422efe-d256-49ae-9146-41b06fc86740 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:34.045756 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55422efe-d256-49ae-9146-41b06fc86740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:34.047380 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-55422efe-d256-49ae-9146-41b06fc86740 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:34.162198 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55422efe-d256-49ae-9146-41b06fc86740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:12:34.163626 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55422efe-d256-49ae-9146-41b06fc86740 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:12:34.180832 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 676/1331] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:12:33 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:12:36.961888 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c76b0-896e-4891-9fdb-026a0f614fc3 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:36.966591 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c76b0-896e-4891-9fdb-026a0f614fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:36.966591 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c76b0-896e-4891-9fdb-026a0f614fc3 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:36.966591 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 656/1332] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:12:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:12:36.969421 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e9c19-7b3a-4cb5-8aaa-cd25221d2983 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:36.969843 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e9c19-7b3a-4cb5-8aaa-cd25221d2983 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:36.969980 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e9c19-7b3a-4cb5-8aaa-cd25221d2983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:37.035488 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-d22e9c19-7b3a-4cb5-8aaa-cd25221d2983 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:12:37.036978 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-d22e9c19-7b3a-4cb5-8aaa-cd25221d2983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:37.142273 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 677/1333] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:12:37.179607 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c76b0-896e-4891-9fdb-026a0f614fc3 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:12:37.181235 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-219c76b0-896e-4891-9fdb-026a0f614fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:37.293460 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c76b0-896e-4891-9fdb-026a0f614fc3 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:12:37.372521 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ef38f-ee61-489f-ad69-17cbb9effae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:12:37.373178 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ef38f-ee61-489f-ad69-17cbb9effae3 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:37.373537 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ef38f-ee61-489f-ad69-17cbb9effae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:37.373778 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ef38f-ee61-489f-ad69-17cbb9effae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:37.375417 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-438ef38f-ee61-489f-ad69-17cbb9effae3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:37.490830 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ef38f-ee61-489f-ad69-17cbb9effae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:12:37.492265 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ef38f-ee61-489f-ad69-17cbb9effae3 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:12:37.513527 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 657/1334] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:12:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:12:39.843305 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2680cf0-198c-422b-bec3-c5cb500faace None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:39.843877 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2680cf0-198c-422b-bec3-c5cb500faace None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:39.843877 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2680cf0-198c-422b-bec3-c5cb500faace None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:39.845714 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 678/1335] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:12:39.851463 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b655ca3-1dee-4369-8781-6035588f489d None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:39.851924 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b655ca3-1dee-4369-8781-6035588f489d None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:39.852103 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b655ca3-1dee-4369-8781-6035588f489d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:39.914370 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-1b655ca3-1dee-4369-8781-6035588f489d None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:12:39.915556 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-1b655ca3-1dee-4369-8781-6035588f489d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:40.009214 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 658/1336] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:12:40.048232 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2680cf0-198c-422b-bec3-c5cb500faace None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:12:40.049813 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-d2680cf0-198c-422b-bec3-c5cb500faace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:40.153091 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2680cf0-198c-422b-bec3-c5cb500faace None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:12:40.225813 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a6b20-02f1-4548-ae45-f3dab0773e92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:12:40.226464 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a6b20-02f1-4548-ae45-f3dab0773e92 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:40.226750 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a6b20-02f1-4548-ae45-f3dab0773e92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:40.227031 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a6b20-02f1-4548-ae45-f3dab0773e92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:40.228667 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-6f1a6b20-02f1-4548-ae45-f3dab0773e92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:40.333587 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a6b20-02f1-4548-ae45-f3dab0773e92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:12:40.335018 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a6b20-02f1-4548-ae45-f3dab0773e92 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:12:40.352969 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 679/1337] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:12:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:12:43.345087 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e0c40-571a-4668-9aca-46def1ee2148 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:43.345653 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e0c40-571a-4668-9aca-46def1ee2148 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:43.345774 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e0c40-571a-4668-9aca-46def1ee2148 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:43.347476 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 659/1338] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:12:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:12:43.354627 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1beb0-e9ca-4708-af97-eb8be065bf9e None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:43.355039 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1beb0-e9ca-4708-af97-eb8be065bf9e None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:43.355194 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1beb0-e9ca-4708-af97-eb8be065bf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:43.418718 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-07a1beb0-e9ca-4708-af97-eb8be065bf9e None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:12:43.419919 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-07a1beb0-e9ca-4708-af97-eb8be065bf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:43.520734 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 680/1339] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:12:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:12:43.557794 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e0c40-571a-4668-9aca-46def1ee2148 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:12:43.560011 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-a94e0c40-571a-4668-9aca-46def1ee2148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:43.668396 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e0c40-571a-4668-9aca-46def1ee2148 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:12:43.671997 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5303de-0468-4260-a16b-ba1eb28bfe3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:12:43.672641 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5303de-0468-4260-a16b-ba1eb28bfe3b service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:43.672926 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5303de-0468-4260-a16b-ba1eb28bfe3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:43.673201 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5303de-0468-4260-a16b-ba1eb28bfe3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:43.758860 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5303de-0468-4260-a16b-ba1eb28bfe3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:12:43.760287 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5303de-0468-4260-a16b-ba1eb28bfe3b service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:12:43.778520 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 660/1340] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:12:43 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:12:48.302267 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df6a5a-b89f-4ce1-a830-eba42479f943 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:48.302792 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df6a5a-b89f-4ce1-a830-eba42479f943 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:48.302792 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df6a5a-b89f-4ce1-a830-eba42479f943 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:48.304572 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 681/1341] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:12:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:12:48.309947 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7d545-61a6-473d-a0be-fcbd1ece8176 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:48.310393 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7d545-61a6-473d-a0be-fcbd1ece8176 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:48.310518 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7d545-61a6-473d-a0be-fcbd1ece8176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:48.369719 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-77d7d545-61a6-473d-a0be-fcbd1ece8176 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:12:48.370824 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-77d7d545-61a6-473d-a0be-fcbd1ece8176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:48.447915 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 661/1342] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:12:48.486831 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df6a5a-b89f-4ce1-a830-eba42479f943 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:12:48.498149 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df6a5a-b89f-4ce1-a830-eba42479f943 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:12:48.501631 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22a53b-5e66-41a0-944f-acb77c945142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:12:48.502265 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22a53b-5e66-41a0-944f-acb77c945142 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:48.502549 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22a53b-5e66-41a0-944f-acb77c945142 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:48.502826 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22a53b-5e66-41a0-944f-acb77c945142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:48.512708 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22a53b-5e66-41a0-944f-acb77c945142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:12:48.514211 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22a53b-5e66-41a0-944f-acb77c945142 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:12:48.524111 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 682/1343] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:12:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:12:51.807108 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebaf16-1d62-4f2b-bbae-307d10bae297 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:51.807685 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebaf16-1d62-4f2b-bbae-307d10bae297 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:51.807768 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebaf16-1d62-4f2b-bbae-307d10bae297 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:51.809677 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 662/1344] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:12:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:12:51.814718 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67e478-36e8-4cbb-95cd-576fde9cb28a None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:51.815125 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67e478-36e8-4cbb-95cd-576fde9cb28a None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:51.815277 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67e478-36e8-4cbb-95cd-576fde9cb28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:51.844898 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-1f67e478-36e8-4cbb-95cd-576fde9cb28a None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:12:51.846170 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-1f67e478-36e8-4cbb-95cd-576fde9cb28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:51.855050 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 683/1345] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:12:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:12:51.892152 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebaf16-1d62-4f2b-bbae-307d10bae297 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:12:51.903746 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebaf16-1d62-4f2b-bbae-307d10bae297 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:12:51.907211 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1bb9b-4bfb-4026-8fdd-8daab0381d25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:12:51.907842 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1bb9b-4bfb-4026-8fdd-8daab0381d25 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:51.908125 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1bb9b-4bfb-4026-8fdd-8daab0381d25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:51.908404 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1bb9b-4bfb-4026-8fdd-8daab0381d25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:51.918640 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1bb9b-4bfb-4026-8fdd-8daab0381d25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:12:51.920055 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1bb9b-4bfb-4026-8fdd-8daab0381d25 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:12:51.930597 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 663/1346] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:12:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:12:56.582316 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce560fa-324c-4b67-9d84-63e85f137eea None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:56.584115 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce560fa-324c-4b67-9d84-63e85f137eea None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:56.584115 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce560fa-324c-4b67-9d84-63e85f137eea None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:56.584834 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 684/1347] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:12:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:12:56.590203 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb4471-341d-4f1c-a071-a3401bc48111 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:56.590662 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb4471-341d-4f1c-a071-a3401bc48111 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:56.590756 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb4471-341d-4f1c-a071-a3401bc48111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:56.609643 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-70bb4471-341d-4f1c-a071-a3401bc48111 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:12:56.615661 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-70bb4471-341d-4f1c-a071-a3401bc48111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:12:56.619155 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 664/1348] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:12:56.657892 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce560fa-324c-4b67-9d84-63e85f137eea None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:12:56.668539 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce560fa-324c-4b67-9d84-63e85f137eea None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:12:56.672068 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87006b-9584-478f-b74c-50ab088c7c3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:12:56.672706 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87006b-9584-478f-b74c-50ab088c7c3a service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:12:56.672987 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87006b-9584-478f-b74c-50ab088c7c3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:12:56.673264 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87006b-9584-478f-b74c-50ab088c7c3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:12:56.682485 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87006b-9584-478f-b74c-50ab088c7c3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:12:56.688362 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87006b-9584-478f-b74c-50ab088c7c3a service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:12:56.694551 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 685/1349] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:12:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:13:02.072084 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9e9c5-737c-4d22-b36d-bfa6b5c192f7 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:02.072923 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9e9c5-737c-4d22-b36d-bfa6b5c192f7 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:02.073392 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9e9c5-737c-4d22-b36d-bfa6b5c192f7 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:02.075399 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 665/1350] 10.222.0.43 () {54 vars in 921 bytes} [Tue Mar 29 20:13:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:13:02.080748 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5e0e4-6b25-49f6-b9a8-7a58c34921db None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:02.081763 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5e0e4-6b25-49f6-b9a8-7a58c34921db None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:02.082455 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5e0e4-6b25-49f6-b9a8-7a58c34921db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:02.156701 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-c6e5e0e4-6b25-49f6-b9a8-7a58c34921db None None] MFA Rules not processed for user `5ef0001e91524a13a9ca601a601de66b`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:13:02.158399 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-c6e5e0e4-6b25-49f6-b9a8-7a58c34921db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:13:02.262298 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 686/1351] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Mar 29 20:13:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:13:06.678904 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bbf6a-8912-4d31-83aa-16291a6b92bb None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:06.679509 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bbf6a-8912-4d31-83aa-16291a6b92bb None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:06.679509 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bbf6a-8912-4d31-83aa-16291a6b92bb None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:06.681445 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 666/1352] 10.222.0.43 () {54 vars in 921 bytes} [Tue Mar 29 20:13:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:13:06.687518 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f51a24-d7b8-4d08-9480-d6f488a23953 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:06.688101 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f51a24-d7b8-4d08-9480-d6f488a23953 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:06.688101 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f51a24-d7b8-4d08-9480-d6f488a23953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:06.709156 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-51f51a24-d7b8-4d08-9480-d6f488a23953 None None] MFA Rules not processed for user `5ef0001e91524a13a9ca601a601de66b`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:13:06.710401 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-51f51a24-d7b8-4d08-9480-d6f488a23953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:13:06.719357 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 687/1353] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Mar 29 20:13:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:13:08.327366 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4d765-cead-4f4a-ab69-28ab2557b5f2 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:08.327909 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4d765-cead-4f4a-ab69-28ab2557b5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:08.328130 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4d765-cead-4f4a-ab69-28ab2557b5f2 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:08.330141 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 667/1354] 10.222.0.43 () {54 vars in 921 bytes} [Tue Mar 29 20:13:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:13:08.335667 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7db6c7-16e8-4320-adcd-0fef06d5f342 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:08.336083 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7db6c7-16e8-4320-adcd-0fef06d5f342 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:08.336350 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7db6c7-16e8-4320-adcd-0fef06d5f342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:08.355270 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-dc7db6c7-16e8-4320-adcd-0fef06d5f342 None None] MFA Rules not processed for user `5ef0001e91524a13a9ca601a601de66b`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:13:08.356559 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-dc7db6c7-16e8-4320-adcd-0fef06d5f342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:13:08.365416 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 688/1355] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Mar 29 20:13:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:13:12.144167 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c26d13-938f-4092-a3d9-db08e38b440a None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:12.144723 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c26d13-938f-4092-a3d9-db08e38b440a None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:12.144723 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c26d13-938f-4092-a3d9-db08e38b440a None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:12.146515 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 668/1356] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:13:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:13:12.151684 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb06b4-ef24-4c5d-b3d4-d7434772b521 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:12.152083 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb06b4-ef24-4c5d-b3d4-d7434772b521 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:12.152240 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb06b4-ef24-4c5d-b3d4-d7434772b521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:12.178892 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-15cb06b4-ef24-4c5d-b3d4-d7434772b521 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:13:12.180116 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-15cb06b4-ef24-4c5d-b3d4-d7434772b521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:13:12.188484 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 689/1357] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:13:12.238806 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632f0a2-d058-4e49-8744-f5c626aa239e None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:12.239373 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632f0a2-d058-4e49-8744-f5c626aa239e None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:12.239808 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632f0a2-d058-4e49-8744-f5c626aa239e None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:12.242222 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 669/1358] 10.222.0.43 () {54 vars in 960 bytes} [Tue Mar 29 20:13:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:13:12.252456 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430eb5d-15b1-4cde-83e8-634a6f4f957b None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:12.252931 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430eb5d-15b1-4cde-83e8-634a6f4f957b None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:12.253765 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430eb5d-15b1-4cde-83e8-634a6f4f957b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:12.308321 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-a430eb5d-15b1-4cde-83e8-634a6f4f957b None None] MFA Rules not processed for user `b797e15939694c9abf1f2b8e9aee4d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:13:12.309972 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a430eb5d-15b1-4cde-83e8-634a6f4f957b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:13:12.400573 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 690/1359] 10.222.0.43 () {58 vars in 1057 bytes} [Tue Mar 29 20:13:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:13:12.408952 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632f0a2-d058-4e49-8744-f5c626aa239e None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:13:12.424756 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632f0a2-d058-4e49-8744-f5c626aa239e None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:13:12.430784 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c588b-8a1e-4a3e-8367-854fbe7ba43a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:13:12.431505 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c588b-8a1e-4a3e-8367-854fbe7ba43a service nova] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:12.431864 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c588b-8a1e-4a3e-8367-854fbe7ba43a service nova] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:12.432357 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c588b-8a1e-4a3e-8367-854fbe7ba43a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:12.441878 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c588b-8a1e-4a3e-8367-854fbe7ba43a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:13:12.443508 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c588b-8a1e-4a3e-8367-854fbe7ba43a service nova] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:13:12.453666 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 670/1360] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:13:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:13:15.006022 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c5b8c-14e2-4c0e-9f2e-7dde7b36323c None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:15.006594 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c5b8c-14e2-4c0e-9f2e-7dde7b36323c None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:15.006594 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c5b8c-14e2-4c0e-9f2e-7dde7b36323c None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:15.008669 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 691/1361] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:13:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:13:15.013548 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc95030-825e-4e99-b4d7-1a49039b13cf None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:15.013963 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc95030-825e-4e99-b4d7-1a49039b13cf None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:15.014104 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc95030-825e-4e99-b4d7-1a49039b13cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:15.032497 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-7bc95030-825e-4e99-b4d7-1a49039b13cf None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:13:15.033688 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-7bc95030-825e-4e99-b4d7-1a49039b13cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:13:15.042259 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 671/1362] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:13:15.087901 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c5b8c-14e2-4c0e-9f2e-7dde7b36323c None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:13:15.104263 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c5b8c-14e2-4c0e-9f2e-7dde7b36323c None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:13:15.109858 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3da1f2-3276-47d0-a639-09111110c0a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:13:15.110503 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3da1f2-3276-47d0-a639-09111110c0a4 service nova] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:15.110791 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3da1f2-3276-47d0-a639-09111110c0a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:15.111073 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3da1f2-3276-47d0-a639-09111110c0a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:15.120661 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3da1f2-3276-47d0-a639-09111110c0a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:13:15.122279 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3da1f2-3276-47d0-a639-09111110c0a4 service nova] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:13:15.132573 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 692/1363] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:13:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:13:17.964529 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92c730-78fe-48ce-985f-88e95b692a74 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:17.965042 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92c730-78fe-48ce-985f-88e95b692a74 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:17.965151 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92c730-78fe-48ce-985f-88e95b692a74 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:17.966887 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 672/1364] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:13:17.971978 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9474503-ae8d-4fe4-b8fe-754dd0268be5 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:17.972977 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9474503-ae8d-4fe4-b8fe-754dd0268be5 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:17.972977 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9474503-ae8d-4fe4-b8fe-754dd0268be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:17.992373 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-d9474503-ae8d-4fe4-b8fe-754dd0268be5 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:13:17.993751 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-d9474503-ae8d-4fe4-b8fe-754dd0268be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:13:18.002004 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 693/1365] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:13:18.057176 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6028faa-8628-49d7-a425-1cb137177e7a None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:18.057758 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6028faa-8628-49d7-a425-1cb137177e7a None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:18.058045 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6028faa-8628-49d7-a425-1cb137177e7a None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:18.059817 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 673/1366] 10.222.0.43 () {54 vars in 960 bytes} [Tue Mar 29 20:13:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:13:18.066023 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966a0d1-b852-4d4f-91ca-e5ba1564f460 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:18.066328 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966a0d1-b852-4d4f-91ca-e5ba1564f460 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:18.067408 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966a0d1-b852-4d4f-91ca-e5ba1564f460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:18.091183 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-4966a0d1-b852-4d4f-91ca-e5ba1564f460 None None] MFA Rules not processed for user `b797e15939694c9abf1f2b8e9aee4d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:13:18.092467 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-4966a0d1-b852-4d4f-91ca-e5ba1564f460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:13:18.103389 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 694/1367] 10.222.0.43 () {58 vars in 1057 bytes} [Tue Mar 29 20:13:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:13:18.113107 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6028faa-8628-49d7-a425-1cb137177e7a None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:13:18.129180 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6028faa-8628-49d7-a425-1cb137177e7a None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:13:18.136167 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85a6ec-1038-4aaa-91b8-7f8fcdea3175 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:13:18.136881 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85a6ec-1038-4aaa-91b8-7f8fcdea3175 service nova] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:18.137273 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85a6ec-1038-4aaa-91b8-7f8fcdea3175 service nova] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:18.137678 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85a6ec-1038-4aaa-91b8-7f8fcdea3175 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:18.147717 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85a6ec-1038-4aaa-91b8-7f8fcdea3175 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:13:18.149509 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85a6ec-1038-4aaa-91b8-7f8fcdea3175 service nova] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:13:18.160427 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 674/1368] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:13:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:13:20.440691 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b64877-3510-4d62-a078-f3ca624171d1 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:20.441252 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b64877-3510-4d62-a078-f3ca624171d1 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:20.441252 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b64877-3510-4d62-a078-f3ca624171d1 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:20.443064 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 695/1369] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:13:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:13:20.448620 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e32487-18d4-4037-a780-6b7df09ca96f None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:20.449060 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e32487-18d4-4037-a780-6b7df09ca96f None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:20.449170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e32487-18d4-4037-a780-6b7df09ca96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:20.467833 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-55e32487-18d4-4037-a780-6b7df09ca96f None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:13:20.469024 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-55e32487-18d4-4037-a780-6b7df09ca96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:13:20.477396 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 675/1370] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:13:20.634504 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55bac1-5619-4757-9e35-62420a5b39b7 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:20.635043 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55bac1-5619-4757-9e35-62420a5b39b7 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:20.635331 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55bac1-5619-4757-9e35-62420a5b39b7 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:20.637135 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 696/1371] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:13:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:13:20.642785 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd76659-3d62-43c8-89a0-d2e9544e8765 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:20.643275 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd76659-3d62-43c8-89a0-d2e9544e8765 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:20.643565 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd76659-3d62-43c8-89a0-d2e9544e8765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:20.662696 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-8fd76659-3d62-43c8-89a0-d2e9544e8765 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:13:20.663879 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-8fd76659-3d62-43c8-89a0-d2e9544e8765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:13:20.672150 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 676/1372] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:13:20.716968 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55bac1-5619-4757-9e35-62420a5b39b7 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:13:20.735933 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55bac1-5619-4757-9e35-62420a5b39b7 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:13:20.742406 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496703e3-fd11-4907-ba6a-f3ba0f79d035 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:13:20.743056 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496703e3-fd11-4907-ba6a-f3ba0f79d035 service nova] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:20.743372 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496703e3-fd11-4907-ba6a-f3ba0f79d035 service nova] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:20.743658 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496703e3-fd11-4907-ba6a-f3ba0f79d035 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:20.757121 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496703e3-fd11-4907-ba6a-f3ba0f79d035 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:13:20.758606 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496703e3-fd11-4907-ba6a-f3ba0f79d035 service nova] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:13:20.770720 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da8cfb-0251-4c78-b0c2-c31c60c8e15e None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:20.770720 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da8cfb-0251-4c78-b0c2-c31c60c8e15e None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:20.770720 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da8cfb-0251-4c78-b0c2-c31c60c8e15e None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:20.772555 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 677/1373] 10.222.0.43 () {54 vars in 962 bytes} [Tue Mar 29 20:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:13:20.773473 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 697/1374] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:13:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:13:20.777353 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580d837-01d5-4b34-869e-7b3aca1bfd11 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:20.777643 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580d837-01d5-4b34-869e-7b3aca1bfd11 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:20.777946 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580d837-01d5-4b34-869e-7b3aca1bfd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:20.827425 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-b580d837-01d5-4b34-869e-7b3aca1bfd11 None None] MFA Rules not processed for user `1d8ea87a7fd34751896b2a0ffaedab2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:13:20.828673 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-b580d837-01d5-4b34-869e-7b3aca1bfd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:13:20.891843 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 678/1375] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Mar 29 20:13:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:13:20.900237 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496703e3-fd11-4907-ba6a-f3ba0f79d035 service nova] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:13:20.909359 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496703e3-fd11-4907-ba6a-f3ba0f79d035 service nova] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:13:20.913022 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c15a4-ee20-445c-9dae-60a5b8c7b79f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:13:20.913790 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c15a4-ee20-445c-9dae-60a5b8c7b79f service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:20.914139 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c15a4-ee20-445c-9dae-60a5b8c7b79f service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:20.914488 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c15a4-ee20-445c-9dae-60a5b8c7b79f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:20.924260 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c15a4-ee20-445c-9dae-60a5b8c7b79f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:13:20.926534 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c15a4-ee20-445c-9dae-60a5b8c7b79f service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:13:20.940467 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 698/1376] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:13:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:13:23.268063 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2f29d-71c6-4e26-a4b3-e9f63ccca906 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:23.268528 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2f29d-71c6-4e26-a4b3-e9f63ccca906 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:23.268611 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2f29d-71c6-4e26-a4b3-e9f63ccca906 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:23.270583 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 679/1377] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:13:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:13:23.275641 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4947930-a0cd-470b-bdd2-f6f3a764fd46 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:23.276025 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4947930-a0cd-470b-bdd2-f6f3a764fd46 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:23.276575 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4947930-a0cd-470b-bdd2-f6f3a764fd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:23.295795 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-e4947930-a0cd-470b-bdd2-f6f3a764fd46 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:13:23.297000 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e4947930-a0cd-470b-bdd2-f6f3a764fd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:13:23.306342 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 699/1378] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:13:23.351145 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2f29d-71c6-4e26-a4b3-e9f63ccca906 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:13:23.366146 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2f29d-71c6-4e26-a4b3-e9f63ccca906 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:13:23.371806 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5204f-0357-48fb-9a6c-ca4766ff0e97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:13:23.372214 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5204f-0357-48fb-9a6c-ca4766ff0e97 service nova] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:23.372502 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5204f-0357-48fb-9a6c-ca4766ff0e97 service nova] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:23.372785 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5204f-0357-48fb-9a6c-ca4766ff0e97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:23.381706 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5204f-0357-48fb-9a6c-ca4766ff0e97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:13:23.383294 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5204f-0357-48fb-9a6c-ca4766ff0e97 service nova] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:13:23.393831 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 680/1379] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:13:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:13:25.888704 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b45af2-aa4d-41a1-bf45-15176c818111 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:25.889531 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b45af2-aa4d-41a1-bf45-15176c818111 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:25.889531 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b45af2-aa4d-41a1-bf45-15176c818111 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:25.891231 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 700/1380] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:13:25.897992 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769357b-9186-4c29-bef7-8f92719c73a0 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:25.898967 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769357b-9186-4c29-bef7-8f92719c73a0 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:25.899255 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769357b-9186-4c29-bef7-8f92719c73a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:25.917423 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-a769357b-9186-4c29-bef7-8f92719c73a0 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:13:25.918630 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-a769357b-9186-4c29-bef7-8f92719c73a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:13:25.926594 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 681/1381] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:13:25.971699 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b45af2-aa4d-41a1-bf45-15176c818111 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:13:25.986154 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b45af2-aa4d-41a1-bf45-15176c818111 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:13:25.991898 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b65c4-d8ab-493b-b55f-0b9ab33a3e89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:13:25.992543 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b65c4-d8ab-493b-b55f-0b9ab33a3e89 service nova] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:25.992827 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b65c4-d8ab-493b-b55f-0b9ab33a3e89 service nova] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:25.993165 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b65c4-d8ab-493b-b55f-0b9ab33a3e89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:26.001822 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b65c4-d8ab-493b-b55f-0b9ab33a3e89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:13:26.004048 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b65c4-d8ab-493b-b55f-0b9ab33a3e89 service nova] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:13:26.013933 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 701/1382] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:13:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:13:28.481911 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23f3e9-96d5-4a80-ba91-071ac24452e2 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:28.482461 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23f3e9-96d5-4a80-ba91-071ac24452e2 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:28.482461 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23f3e9-96d5-4a80-ba91-071ac24452e2 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:28.484249 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 682/1383] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:13:28.497639 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17bf9d-8cd4-4f87-91fe-d3db173ef609 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:28.498155 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17bf9d-8cd4-4f87-91fe-d3db173ef609 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:28.498241 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17bf9d-8cd4-4f87-91fe-d3db173ef609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:28.519648 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-3e17bf9d-8cd4-4f87-91fe-d3db173ef609 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:13:28.520833 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-3e17bf9d-8cd4-4f87-91fe-d3db173ef609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:13:28.528754 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 702/1384] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:13:28.572429 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23f3e9-96d5-4a80-ba91-071ac24452e2 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:13:28.587365 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23f3e9-96d5-4a80-ba91-071ac24452e2 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:13:28.593104 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb2be7-ecf8-4aaa-9127-022d146d9aea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:13:28.593839 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb2be7-ecf8-4aaa-9127-022d146d9aea service nova] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:28.594202 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb2be7-ecf8-4aaa-9127-022d146d9aea service nova] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:28.594551 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb2be7-ecf8-4aaa-9127-022d146d9aea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:28.603688 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb2be7-ecf8-4aaa-9127-022d146d9aea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:13:28.605445 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb2be7-ecf8-4aaa-9127-022d146d9aea service nova] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:13:28.616291 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 683/1385] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:13:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:13:31.338258 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be287c4f-9d36-45ae-9fe9-ad2079cf9c94 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:31.338832 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be287c4f-9d36-45ae-9fe9-ad2079cf9c94 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:31.338832 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be287c4f-9d36-45ae-9fe9-ad2079cf9c94 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:31.340654 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 703/1386] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:13:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:13:31.347328 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff89507-b8cf-48ca-bb3b-e3adf1ed330d None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:31.347815 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff89507-b8cf-48ca-bb3b-e3adf1ed330d None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:31.347922 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff89507-b8cf-48ca-bb3b-e3adf1ed330d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:31.366524 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-8ff89507-b8cf-48ca-bb3b-e3adf1ed330d None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:13:31.367708 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-8ff89507-b8cf-48ca-bb3b-e3adf1ed330d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:13:31.375452 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 684/1387] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:13:31.434072 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be287c4f-9d36-45ae-9fe9-ad2079cf9c94 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:13:31.448633 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be287c4f-9d36-45ae-9fe9-ad2079cf9c94 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:13:31.454425 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cdb25-71a2-4b95-a439-d4b7607be33c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:13:31.455839 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cdb25-71a2-4b95-a439-d4b7607be33c service nova] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:31.456305 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cdb25-71a2-4b95-a439-d4b7607be33c service nova] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:31.456601 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cdb25-71a2-4b95-a439-d4b7607be33c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:31.465436 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0cdb25-71a2-4b95-a439-d4b7607be33c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:13:31.467027 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0cdb25-71a2-4b95-a439-d4b7607be33c service nova] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:13:31.479482 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 704/1388] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:13:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:13:34.028516 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440d0ae-adba-47e0-89f0-d5fa517ea957 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:34.029093 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440d0ae-adba-47e0-89f0-d5fa517ea957 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:34.029093 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440d0ae-adba-47e0-89f0-d5fa517ea957 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:34.031019 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 685/1389] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:13:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:13:34.036604 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5ddf6-3ddd-45c8-9658-da225f6ff013 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:34.037173 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5ddf6-3ddd-45c8-9658-da225f6ff013 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:34.037173 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5ddf6-3ddd-45c8-9658-da225f6ff013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:34.055754 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-e9c5ddf6-3ddd-45c8-9658-da225f6ff013 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:13:34.056956 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e9c5ddf6-3ddd-45c8-9658-da225f6ff013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:13:34.065559 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 705/1390] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:13:34.115899 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440d0ae-adba-47e0-89f0-d5fa517ea957 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:13:34.133549 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440d0ae-adba-47e0-89f0-d5fa517ea957 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:13:34.139157 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20df9a2-cfef-46d8-b042-19986cb4dce1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:13:34.139802 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20df9a2-cfef-46d8-b042-19986cb4dce1 service nova] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:34.140093 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20df9a2-cfef-46d8-b042-19986cb4dce1 service nova] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:34.140376 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20df9a2-cfef-46d8-b042-19986cb4dce1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:34.149228 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20df9a2-cfef-46d8-b042-19986cb4dce1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:13:34.150853 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20df9a2-cfef-46d8-b042-19986cb4dce1 service nova] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:13:34.161172 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 686/1391] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:13:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:13:36.772511 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25394027-9d11-4600-97ea-3514a699f6fe None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:36.773127 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25394027-9d11-4600-97ea-3514a699f6fe None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:36.773127 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25394027-9d11-4600-97ea-3514a699f6fe None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:36.775122 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 706/1392] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:13:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:13:36.780037 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b4d72-ed3b-432f-95d3-40262a3b1ace None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:36.780481 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b4d72-ed3b-432f-95d3-40262a3b1ace None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:36.780606 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b4d72-ed3b-432f-95d3-40262a3b1ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:36.802801 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-a69b4d72-ed3b-432f-95d3-40262a3b1ace None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:13:36.803998 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-a69b4d72-ed3b-432f-95d3-40262a3b1ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:13:36.811864 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 687/1393] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:13:36.857316 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25394027-9d11-4600-97ea-3514a699f6fe None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:13:36.872403 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25394027-9d11-4600-97ea-3514a699f6fe None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:13:36.878898 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52b03e-15e1-4ec4-ad88-0fd4b405cea1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:13:36.879534 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52b03e-15e1-4ec4-ad88-0fd4b405cea1 service nova] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:36.879815 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52b03e-15e1-4ec4-ad88-0fd4b405cea1 service nova] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:36.880090 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52b03e-15e1-4ec4-ad88-0fd4b405cea1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:36.888232 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52b03e-15e1-4ec4-ad88-0fd4b405cea1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:13:36.889840 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52b03e-15e1-4ec4-ad88-0fd4b405cea1 service nova] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:13:36.900965 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 707/1394] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:13:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:13:37.270139 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98114243-7e12-4ace-96fe-fca18642ce10 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:37.270433 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98114243-7e12-4ace-96fe-fca18642ce10 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:37.270718 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98114243-7e12-4ace-96fe-fca18642ce10 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:37.272517 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 688/1395] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:13:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:13:37.277785 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ae6fb-1781-486c-ad5d-4c5df6896dc4 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:37.278076 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ae6fb-1781-486c-ad5d-4c5df6896dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:37.278359 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ae6fb-1781-486c-ad5d-4c5df6896dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:37.296783 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-118ae6fb-1781-486c-ad5d-4c5df6896dc4 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:13:37.298272 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-118ae6fb-1781-486c-ad5d-4c5df6896dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:13:37.307103 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 708/1396] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:13:37.365443 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69cf48-d218-4b7d-a283-384c3b38ffba None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:37.365739 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69cf48-d218-4b7d-a283-384c3b38ffba None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:37.366027 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69cf48-d218-4b7d-a283-384c3b38ffba None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:37.367834 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 689/1397] 10.222.0.43 () {54 vars in 961 bytes} [Tue Mar 29 20:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:13:37.373003 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83f50f-f200-4f40-9783-51ef83efc31e None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:37.373312 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83f50f-f200-4f40-9783-51ef83efc31e None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:37.373595 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83f50f-f200-4f40-9783-51ef83efc31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:37.428526 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-ae83f50f-f200-4f40-9783-51ef83efc31e None None] MFA Rules not processed for user `0b169395c92c4fbfbbe4fd14a235f81f`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:13:37.429764 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-ae83f50f-f200-4f40-9783-51ef83efc31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:13:37.487785 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 709/1398] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Mar 29 20:13:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:13:37.495420 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69cf48-d218-4b7d-a283-384c3b38ffba None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:13:37.506179 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69cf48-d218-4b7d-a283-384c3b38ffba None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:13:37.509712 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9767feb-e883-45ff-bf66-6447667b10fd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b169395c92c4fbfbbe4fd14a235f81f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:13:37.510344 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9767feb-e883-45ff-bf66-6447667b10fd service glance] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:37.510627 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9767feb-e883-45ff-bf66-6447667b10fd service glance] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:37.510899 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9767feb-e883-45ff-bf66-6447667b10fd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:37.520142 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9767feb-e883-45ff-bf66-6447667b10fd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:13:37.521573 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9767feb-e883-45ff-bf66-6447667b10fd service glance] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:13:37.531008 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 690/1399] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:13:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:13:38.096308 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81c2ae-458f-45ab-a94c-7c55fff06b2f None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:38.096795 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81c2ae-458f-45ab-a94c-7c55fff06b2f None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:38.096900 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81c2ae-458f-45ab-a94c-7c55fff06b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:38.145128 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-af81c2ae-458f-45ab-a94c-7c55fff06b2f None None] MFA Rules not processed for user `a706b6d0163549bc80285c4158331b94`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:13:38.146284 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-af81c2ae-458f-45ab-a94c-7c55fff06b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:13:38.210168 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 710/1400] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Mar 29 20:13:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:13:38.252547 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b21e1a-d2f1-44af-a82f-8148a15dbfab None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:38.253055 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b21e1a-d2f1-44af-a82f-8148a15dbfab None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:38.253165 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b21e1a-d2f1-44af-a82f-8148a15dbfab None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:38.255209 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 691/1401] 10.222.0.43 () {54 vars in 942 bytes} [Tue Mar 29 20:13:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:13:38.261191 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e6955-b190-4c3e-9fbf-8cad4191593f None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:38.261599 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e6955-b190-4c3e-9fbf-8cad4191593f None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:38.261951 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e6955-b190-4c3e-9fbf-8cad4191593f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:38.309520 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-261e6955-b190-4c3e-9fbf-8cad4191593f None None] MFA Rules not processed for user `9d6d8e7788494f2c92ad5c183c8fa283`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:13:38.310713 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-261e6955-b190-4c3e-9fbf-8cad4191593f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:13:38.380647 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 711/1402] 10.222.0.43 () {58 vars in 1039 bytes} [Tue Mar 29 20:13:38 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:13:38.389959 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b21e1a-d2f1-44af-a82f-8148a15dbfab None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:13:38.403869 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b21e1a-d2f1-44af-a82f-8148a15dbfab None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:13:38.409527 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb702f-0850-4a35-badf-c0e9140fe0b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d6d8e7788494f2c92ad5c183c8fa283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:13:38.410166 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb702f-0850-4a35-badf-c0e9140fe0b2 service swift] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:38.410455 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb702f-0850-4a35-badf-c0e9140fe0b2 service swift] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:38.410742 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb702f-0850-4a35-badf-c0e9140fe0b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:38.418608 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb702f-0850-4a35-badf-c0e9140fe0b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:13:38.420193 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb702f-0850-4a35-badf-c0e9140fe0b2 service swift] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:13:38.428306 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 692/1403] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Mar 29 20:13:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 20:13:39.382160 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29414159-4db4-40cf-81bb-b19e296b8035 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:39.382725 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29414159-4db4-40cf-81bb-b19e296b8035 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:39.382725 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29414159-4db4-40cf-81bb-b19e296b8035 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:39.384497 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 712/1404] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:13:39.389908 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af65e52-09af-44c5-9388-7947d10c5a82 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:39.390404 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af65e52-09af-44c5-9388-7947d10c5a82 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:39.390489 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af65e52-09af-44c5-9388-7947d10c5a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:39.409831 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-6af65e52-09af-44c5-9388-7947d10c5a82 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:13:39.411033 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-6af65e52-09af-44c5-9388-7947d10c5a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:13:39.424522 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 693/1405] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:13:39.464691 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29414159-4db4-40cf-81bb-b19e296b8035 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:13:39.479664 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29414159-4db4-40cf-81bb-b19e296b8035 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:13:39.485269 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546414c1-cc18-46ab-bed9-f8d3d1c06d45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:13:39.486545 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546414c1-cc18-46ab-bed9-f8d3d1c06d45 service nova] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:39.486925 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546414c1-cc18-46ab-bed9-f8d3d1c06d45 service nova] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:39.487209 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546414c1-cc18-46ab-bed9-f8d3d1c06d45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:39.496698 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546414c1-cc18-46ab-bed9-f8d3d1c06d45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:13:39.498481 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546414c1-cc18-46ab-bed9-f8d3d1c06d45 service nova] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:13:39.509114 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 713/1406] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:13:42.041411 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a429f-38da-406b-8726-4ce4267540eb None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:42.041983 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a429f-38da-406b-8726-4ce4267540eb None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:42.042199 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a429f-38da-406b-8726-4ce4267540eb None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:42.044064 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 694/1407] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:13:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:13:42.050003 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00131d-310d-4601-a026-47b918db99ab None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:42.050461 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00131d-310d-4601-a026-47b918db99ab None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:42.050556 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00131d-310d-4601-a026-47b918db99ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:42.068848 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-1f00131d-310d-4601-a026-47b918db99ab None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:13:42.071747 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-1f00131d-310d-4601-a026-47b918db99ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:13:42.079905 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 714/1408] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:13:42.124647 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a429f-38da-406b-8726-4ce4267540eb None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:13:42.139948 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a429f-38da-406b-8726-4ce4267540eb None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:13:42.147081 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723d3e2-ede9-4943-a542-1b4979320bb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:13:42.147751 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723d3e2-ede9-4943-a542-1b4979320bb3 service nova] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:13:42.148040 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723d3e2-ede9-4943-a542-1b4979320bb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:13:42.148325 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723d3e2-ede9-4943-a542-1b4979320bb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:13:42.156909 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723d3e2-ede9-4943-a542-1b4979320bb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:13:42.158707 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723d3e2-ede9-4943-a542-1b4979320bb3 service nova] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:13:42.184798 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 695/1409] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:14:02.934535 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10ac87-553c-4306-bdc8-feb38bbfcd0b None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:02.935007 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10ac87-553c-4306-bdc8-feb38bbfcd0b None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:02.935113 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10ac87-553c-4306-bdc8-feb38bbfcd0b None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:02.936918 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 715/1410] 10.222.0.43 () {54 vars in 918 bytes} [Tue Mar 29 20:14:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:14:02.943356 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732084b-24b2-4d9f-8901-bcd5f2668c1c None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:02.943890 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732084b-24b2-4d9f-8901-bcd5f2668c1c None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:02.943996 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732084b-24b2-4d9f-8901-bcd5f2668c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:02.963403 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-7732084b-24b2-4d9f-8901-bcd5f2668c1c None None] MFA Rules not processed for user `5ef0001e91524a13a9ca601a601de66b`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:14:02.964584 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-7732084b-24b2-4d9f-8901-bcd5f2668c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:14:02.973266 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 696/1411] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Mar 29 20:14:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:14:02.988296 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a72419-7830-44f0-ba7c-5bdcd81fdf2d None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:02.988614 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a72419-7830-44f0-ba7c-5bdcd81fdf2d None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:02.988899 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a72419-7830-44f0-ba7c-5bdcd81fdf2d None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:02.990742 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 716/1412] 10.222.0.43 () {54 vars in 918 bytes} [Tue Mar 29 20:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:14:02.995144 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d2793-f5ed-4272-b0b3-e3a2c5a91d04 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:02.995437 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d2793-f5ed-4272-b0b3-e3a2c5a91d04 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:02.995719 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d2793-f5ed-4272-b0b3-e3a2c5a91d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:03.013940 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-612d2793-f5ed-4272-b0b3-e3a2c5a91d04 None None] MFA Rules not processed for user `b797e15939694c9abf1f2b8e9aee4d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:14:03.015109 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-612d2793-f5ed-4272-b0b3-e3a2c5a91d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:14:03.024806 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 697/1413] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Mar 29 20:14:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:14:05.764739 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058f68f-c61f-4923-8329-767bae7a3df5 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:05.765362 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058f68f-c61f-4923-8329-767bae7a3df5 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:05.765362 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058f68f-c61f-4923-8329-767bae7a3df5 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:05.767197 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 717/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 20:14:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:14:05.772355 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612868a6-9f89-402a-ab78-3017f86c1ee2 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:05.772774 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612868a6-9f89-402a-ab78-3017f86c1ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:05.772919 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612868a6-9f89-402a-ab78-3017f86c1ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:05.790820 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-612868a6-9f89-402a-ab78-3017f86c1ee2 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:14:05.792002 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-612868a6-9f89-402a-ab78-3017f86c1ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:14:05.800367 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 698/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 20:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:14:05.841710 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058f68f-c61f-4923-8329-767bae7a3df5 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:14:05.856323 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058f68f-c61f-4923-8329-767bae7a3df5 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:14:05.862352 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d66b9c-8401-4764-ab98-8c7748f0fc73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:14:05.862985 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d66b9c-8401-4764-ab98-8c7748f0fc73 service nova] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:05.863270 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d66b9c-8401-4764-ab98-8c7748f0fc73 service nova] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:05.863556 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d66b9c-8401-4764-ab98-8c7748f0fc73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:05.871841 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d66b9c-8401-4764-ab98-8c7748f0fc73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:14:05.873434 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d66b9c-8401-4764-ab98-8c7748f0fc73 service nova] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:14:05.883402 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 718/1416] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:14:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:14:07.230025 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60a677-54d7-4503-9b0b-297183d9f24d None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:07.230551 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60a677-54d7-4503-9b0b-297183d9f24d None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:07.230551 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60a677-54d7-4503-9b0b-297183d9f24d None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:07.232314 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 699/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 29 20:14:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:14:07.238070 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96742253-4162-4a86-a456-72040cfe566e None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:07.238494 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96742253-4162-4a86-a456-72040cfe566e None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:07.238660 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96742253-4162-4a86-a456-72040cfe566e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:07.256429 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-96742253-4162-4a86-a456-72040cfe566e None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:14:07.257651 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-96742253-4162-4a86-a456-72040cfe566e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:14:07.265273 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 719/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 29 20:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:14:07.435025 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60a677-54d7-4503-9b0b-297183d9f24d None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:14:07.449658 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60a677-54d7-4503-9b0b-297183d9f24d None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:14:07.455567 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1a577-f77b-4cea-a1e8-c8fe79cf427a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:14:07.456193 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1a577-f77b-4cea-a1e8-c8fe79cf427a service nova] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:07.456472 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1a577-f77b-4cea-a1e8-c8fe79cf427a service nova] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:07.456747 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1a577-f77b-4cea-a1e8-c8fe79cf427a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:07.464604 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1a577-f77b-4cea-a1e8-c8fe79cf427a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:14:07.466189 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1a577-f77b-4cea-a1e8-c8fe79cf427a service nova] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:14:07.475918 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 700/1419] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:14:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:14:08.786592 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04afff-41fa-4d18-b40d-4937479ca422 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:08.787168 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04afff-41fa-4d18-b40d-4937479ca422 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:08.787168 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04afff-41fa-4d18-b40d-4937479ca422 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:08.789005 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 720/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 29 20:14:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:14:08.794083 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d82d9-36fb-4cb1-abbe-58c320277be3 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:08.794563 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d82d9-36fb-4cb1-abbe-58c320277be3 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:08.794661 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d82d9-36fb-4cb1-abbe-58c320277be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:08.812810 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-be7d82d9-36fb-4cb1-abbe-58c320277be3 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:14:08.814154 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-be7d82d9-36fb-4cb1-abbe-58c320277be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:14:08.822112 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 701/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 29 20:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:14:08.974910 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04afff-41fa-4d18-b40d-4937479ca422 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:14:08.989242 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04afff-41fa-4d18-b40d-4937479ca422 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:14:08.994514 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe107b5-3262-4288-81d8-dc8598661cb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:14:08.995144 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe107b5-3262-4288-81d8-dc8598661cb8 service nova] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:08.995423 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe107b5-3262-4288-81d8-dc8598661cb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:08.995697 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe107b5-3262-4288-81d8-dc8598661cb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:09.003981 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe107b5-3262-4288-81d8-dc8598661cb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:14:09.005600 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe107b5-3262-4288-81d8-dc8598661cb8 service nova] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:14:09.014594 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 721/1422] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:14:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:14:10.317414 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6e490-1ba8-468e-ac6d-576eee55203a None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:10.318065 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6e490-1ba8-468e-ac6d-576eee55203a None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:10.318065 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6e490-1ba8-468e-ac6d-576eee55203a None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:10.319741 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 702/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 29 20:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:14:10.324918 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731cfd5-fab4-45fe-b128-96f7bccc1b07 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:10.325413 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731cfd5-fab4-45fe-b128-96f7bccc1b07 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:10.325510 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731cfd5-fab4-45fe-b128-96f7bccc1b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:10.344412 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-9731cfd5-fab4-45fe-b128-96f7bccc1b07 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:14:10.345628 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-9731cfd5-fab4-45fe-b128-96f7bccc1b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:14:10.353187 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 722/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 29 20:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:14:10.507089 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6e490-1ba8-468e-ac6d-576eee55203a None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:14:10.521429 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6e490-1ba8-468e-ac6d-576eee55203a None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:14:10.526782 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195600e-8f0a-45ea-8df5-dff61f78f881 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:14:10.527416 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195600e-8f0a-45ea-8df5-dff61f78f881 service nova] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:10.527706 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195600e-8f0a-45ea-8df5-dff61f78f881 service nova] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:10.527989 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195600e-8f0a-45ea-8df5-dff61f78f881 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:10.536218 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195600e-8f0a-45ea-8df5-dff61f78f881 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:14:10.537815 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195600e-8f0a-45ea-8df5-dff61f78f881 service nova] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:14:10.547613 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 703/1425] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:14:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:14:11.843258 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57598e-0db8-40fb-83c5-99c1824fbbd1 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:11.844002 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57598e-0db8-40fb-83c5-99c1824fbbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:11.844002 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57598e-0db8-40fb-83c5-99c1824fbbd1 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:11.845645 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 723/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 29 20:14:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:14:11.850700 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d64065-1cdd-49d0-ac05-62304651c6f0 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:11.851151 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d64065-1cdd-49d0-ac05-62304651c6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:11.851310 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d64065-1cdd-49d0-ac05-62304651c6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:11.869512 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-22d64065-1cdd-49d0-ac05-62304651c6f0 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:14:11.870689 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-22d64065-1cdd-49d0-ac05-62304651c6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:14:11.879363 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 704/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 29 20:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:14:12.031223 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57598e-0db8-40fb-83c5-99c1824fbbd1 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:14:12.045836 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57598e-0db8-40fb-83c5-99c1824fbbd1 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:14:12.051621 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e19321-a85f-4502-bbec-13bff18b176d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:14:12.052254 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e19321-a85f-4502-bbec-13bff18b176d service nova] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:12.052538 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e19321-a85f-4502-bbec-13bff18b176d service nova] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:12.052813 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e19321-a85f-4502-bbec-13bff18b176d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:12.060727 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e19321-a85f-4502-bbec-13bff18b176d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:14:12.062901 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e19321-a85f-4502-bbec-13bff18b176d service nova] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:14:12.072383 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 724/1428] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:14:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:14:13.377455 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58007f1-1004-45d6-b3b1-22f4659ed7b1 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:13.378059 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58007f1-1004-45d6-b3b1-22f4659ed7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:13.378059 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58007f1-1004-45d6-b3b1-22f4659ed7b1 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:13.379815 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 705/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 29 20:14:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:14:13.384923 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4b8dd-1be7-4c6c-af57-4ab48c504c29 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:13.385354 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4b8dd-1be7-4c6c-af57-4ab48c504c29 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:13.385541 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4b8dd-1be7-4c6c-af57-4ab48c504c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:13.403605 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-f6d4b8dd-1be7-4c6c-af57-4ab48c504c29 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:14:13.404815 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-f6d4b8dd-1be7-4c6c-af57-4ab48c504c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:14:13.413594 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 725/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 29 20:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:14:13.563699 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58007f1-1004-45d6-b3b1-22f4659ed7b1 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:14:13.578583 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58007f1-1004-45d6-b3b1-22f4659ed7b1 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:14:13.584023 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67986c-5b8b-4d18-b572-01e423149064 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:14:13.584665 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67986c-5b8b-4d18-b572-01e423149064 service nova] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:13.584954 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67986c-5b8b-4d18-b572-01e423149064 service nova] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:13.585237 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67986c-5b8b-4d18-b572-01e423149064 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:13.593515 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67986c-5b8b-4d18-b572-01e423149064 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:14:13.595311 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67986c-5b8b-4d18-b572-01e423149064 service nova] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:14:13.604652 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 706/1431] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:14:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:14:14.954318 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db22709-8a10-4a0b-9f77-bc0d4063cd38 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:14.954858 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db22709-8a10-4a0b-9f77-bc0d4063cd38 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:14.954858 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db22709-8a10-4a0b-9f77-bc0d4063cd38 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:14.956670 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 726/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 29 20:14:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:14:14.961617 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef6f7b-0bf4-4bc4-85df-6bc3d8271a77 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:14.962065 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef6f7b-0bf4-4bc4-85df-6bc3d8271a77 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:14.962202 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef6f7b-0bf4-4bc4-85df-6bc3d8271a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:14.979752 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-98ef6f7b-0bf4-4bc4-85df-6bc3d8271a77 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:14:14.980929 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-98ef6f7b-0bf4-4bc4-85df-6bc3d8271a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:14:14.989354 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 707/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 29 20:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:14:15.142596 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db22709-8a10-4a0b-9f77-bc0d4063cd38 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:14:15.157346 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db22709-8a10-4a0b-9f77-bc0d4063cd38 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:14:15.162695 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b24867-7e80-4f0d-9dcc-4f19b0c34236 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:14:15.163333 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b24867-7e80-4f0d-9dcc-4f19b0c34236 service nova] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:15.163622 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b24867-7e80-4f0d-9dcc-4f19b0c34236 service nova] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:15.163905 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b24867-7e80-4f0d-9dcc-4f19b0c34236 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:15.171937 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b24867-7e80-4f0d-9dcc-4f19b0c34236 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:14:15.173709 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b24867-7e80-4f0d-9dcc-4f19b0c34236 service nova] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:14:15.186088 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 727/1434] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:14:16.492334 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ae5e3-6ab8-497a-9518-f2a899142456 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:16.492907 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ae5e3-6ab8-497a-9518-f2a899142456 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:16.492907 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ae5e3-6ab8-497a-9518-f2a899142456 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:16.494794 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 708/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 29 20:14:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:14:16.500327 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e33697-d8b3-4f23-818f-a9da19f70f93 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:16.500755 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e33697-d8b3-4f23-818f-a9da19f70f93 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:16.500924 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e33697-d8b3-4f23-818f-a9da19f70f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:16.519227 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-56e33697-d8b3-4f23-818f-a9da19f70f93 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:14:16.520422 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-56e33697-d8b3-4f23-818f-a9da19f70f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:14:16.528265 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 728/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 29 20:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:14:16.682488 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ae5e3-6ab8-497a-9518-f2a899142456 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:14:16.697273 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ae5e3-6ab8-497a-9518-f2a899142456 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:14:16.702603 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb2bc9-d208-4a43-b650-bcfde48889a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:14:16.703254 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb2bc9-d208-4a43-b650-bcfde48889a5 service nova] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:16.703536 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb2bc9-d208-4a43-b650-bcfde48889a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:16.703810 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb2bc9-d208-4a43-b650-bcfde48889a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:16.711795 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb2bc9-d208-4a43-b650-bcfde48889a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:14:16.713370 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb2bc9-d208-4a43-b650-bcfde48889a5 service nova] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:14:16.722643 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 709/1437] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:14:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:14:18.065645 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea98ceb-5f54-4e43-9047-c14e62dcaee3 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:18.066212 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea98ceb-5f54-4e43-9047-c14e62dcaee3 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:18.066212 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea98ceb-5f54-4e43-9047-c14e62dcaee3 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:18.068027 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 729/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 29 20:14:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:14:18.073206 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb51dd3-e473-4bf8-b044-4fa516c8ca5f None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:18.073671 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb51dd3-e473-4bf8-b044-4fa516c8ca5f None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:18.073803 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb51dd3-e473-4bf8-b044-4fa516c8ca5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:18.092277 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-dbb51dd3-e473-4bf8-b044-4fa516c8ca5f None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:14:18.094085 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-dbb51dd3-e473-4bf8-b044-4fa516c8ca5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:14:18.101933 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 710/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 29 20:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:14:18.250989 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea98ceb-5f54-4e43-9047-c14e62dcaee3 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:14:18.265574 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea98ceb-5f54-4e43-9047-c14e62dcaee3 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:14:18.270920 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1766deb-10ca-4a9b-a251-a79371c9ed4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:14:18.271552 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1766deb-10ca-4a9b-a251-a79371c9ed4c service nova] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:18.271842 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1766deb-10ca-4a9b-a251-a79371c9ed4c service nova] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:18.272120 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1766deb-10ca-4a9b-a251-a79371c9ed4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:18.280078 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1766deb-10ca-4a9b-a251-a79371c9ed4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:14:18.282273 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1766deb-10ca-4a9b-a251-a79371c9ed4c service nova] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:14:18.291501 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 730/1440] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:14:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:14:20.478897 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d988e-89e3-435d-a6c5-4b78b6c39be5 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:20.479478 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d988e-89e3-435d-a6c5-4b78b6c39be5 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:20.479478 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d988e-89e3-435d-a6c5-4b78b6c39be5 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:20.481239 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 711/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 20:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:14:20.487044 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19d118-7312-4b6a-8bfa-d60a4f64633e None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:20.487485 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19d118-7312-4b6a-8bfa-d60a4f64633e None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:20.487593 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19d118-7312-4b6a-8bfa-d60a4f64633e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:20.505914 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-9f19d118-7312-4b6a-8bfa-d60a4f64633e None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:14:20.507091 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-9f19d118-7312-4b6a-8bfa-d60a4f64633e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:14:20.514627 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 731/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 20:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:14:20.552760 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d988e-89e3-435d-a6c5-4b78b6c39be5 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:14:20.563843 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d988e-89e3-435d-a6c5-4b78b6c39be5 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:14:20.567490 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e22a4-c3de-42c6-9258-2c139946abba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:14:20.568115 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e22a4-c3de-42c6-9258-2c139946abba service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:20.568402 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e22a4-c3de-42c6-9258-2c139946abba service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:20.568679 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e22a4-c3de-42c6-9258-2c139946abba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:20.577915 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e22a4-c3de-42c6-9258-2c139946abba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:14:20.579337 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e22a4-c3de-42c6-9258-2c139946abba service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:14:20.588805 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 712/1443] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:14:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:14:23.046748 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef319a-8345-4177-b413-f6bf21a1757f None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:23.047350 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef319a-8345-4177-b413-f6bf21a1757f None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:23.047350 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef319a-8345-4177-b413-f6bf21a1757f None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:23.049148 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 732/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 20:14:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:14:23.054915 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e08ee-1e2c-483e-8af7-1f09e48f831b None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:23.055387 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e08ee-1e2c-483e-8af7-1f09e48f831b None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:23.055490 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e08ee-1e2c-483e-8af7-1f09e48f831b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:23.073578 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-b76e08ee-1e2c-483e-8af7-1f09e48f831b None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:14:23.074763 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-b76e08ee-1e2c-483e-8af7-1f09e48f831b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:14:23.082648 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 713/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 20:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:14:23.120778 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef319a-8345-4177-b413-f6bf21a1757f None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:14:23.131404 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef319a-8345-4177-b413-f6bf21a1757f None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:14:23.134892 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50c880-da55-4a1a-9788-73a5a933b2e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:14:23.135525 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50c880-da55-4a1a-9788-73a5a933b2e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:23.135809 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50c880-da55-4a1a-9788-73a5a933b2e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:23.136083 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50c880-da55-4a1a-9788-73a5a933b2e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:23.145617 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50c880-da55-4a1a-9788-73a5a933b2e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:14:23.147039 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50c880-da55-4a1a-9788-73a5a933b2e3 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:14:23.156859 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 733/1446] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:14:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:14:25.819643 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb544ae0-ec3e-48ed-8d07-a03385850bd7 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:25.820508 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb544ae0-ec3e-48ed-8d07-a03385850bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:25.820508 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb544ae0-ec3e-48ed-8d07-a03385850bd7 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:25.822285 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 714/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 20:14:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:14:25.827856 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b203f1c-d763-4b6e-ad6e-e4e4555a3361 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:25.827856 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b203f1c-d763-4b6e-ad6e-e4e4555a3361 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:25.828471 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b203f1c-d763-4b6e-ad6e-e4e4555a3361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:25.846099 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-6b203f1c-d763-4b6e-ad6e-e4e4555a3361 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:14:25.847273 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-6b203f1c-d763-4b6e-ad6e-e4e4555a3361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:14:25.854828 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 734/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 20:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:14:25.892762 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb544ae0-ec3e-48ed-8d07-a03385850bd7 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:14:25.903230 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb544ae0-ec3e-48ed-8d07-a03385850bd7 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:14:25.907373 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416009f-4921-4fdf-916f-2da7beeb47f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:14:25.908011 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416009f-4921-4fdf-916f-2da7beeb47f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:25.908295 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416009f-4921-4fdf-916f-2da7beeb47f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:25.908573 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416009f-4921-4fdf-916f-2da7beeb47f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:25.917472 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416009f-4921-4fdf-916f-2da7beeb47f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:14:25.918887 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416009f-4921-4fdf-916f-2da7beeb47f0 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:14:25.931696 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 715/1449] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:14:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:14:28.311290 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cde34b-894a-4864-a972-b8adf5fc4430 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:28.312588 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cde34b-894a-4864-a972-b8adf5fc4430 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:28.312880 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cde34b-894a-4864-a972-b8adf5fc4430 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:28.314729 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 735/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 20:14:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:14:28.320242 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c4112-83d6-4125-be73-fdd7702d5c55 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:28.320665 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c4112-83d6-4125-be73-fdd7702d5c55 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:28.320813 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c4112-83d6-4125-be73-fdd7702d5c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:28.339179 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-fa5c4112-83d6-4125-be73-fdd7702d5c55 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:14:28.340364 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-fa5c4112-83d6-4125-be73-fdd7702d5c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:14:28.348427 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 716/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 20:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:14:28.386217 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cde34b-894a-4864-a972-b8adf5fc4430 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:14:28.397186 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cde34b-894a-4864-a972-b8adf5fc4430 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:14:28.400643 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd39b9c-2403-4545-8862-123f10b24607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:14:28.401273 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd39b9c-2403-4545-8862-123f10b24607 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:28.401582 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd39b9c-2403-4545-8862-123f10b24607 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:28.401860 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd39b9c-2403-4545-8862-123f10b24607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:28.410779 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd39b9c-2403-4545-8862-123f10b24607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:14:28.412198 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd39b9c-2403-4545-8862-123f10b24607 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:14:28.421386 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 736/1452] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:14:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:14:30.788030 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9677f0-539a-41df-866d-acd3a2093fcb None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:30.788612 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9677f0-539a-41df-866d-acd3a2093fcb None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:30.788612 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9677f0-539a-41df-866d-acd3a2093fcb None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:30.790402 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 717/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 20:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:14:30.795556 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b28a0-8be1-4ce3-86b8-4227dafa0288 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:30.797039 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b28a0-8be1-4ce3-86b8-4227dafa0288 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:30.797039 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b28a0-8be1-4ce3-86b8-4227dafa0288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:30.814907 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-030b28a0-8be1-4ce3-86b8-4227dafa0288 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:14:30.816095 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-030b28a0-8be1-4ce3-86b8-4227dafa0288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:14:30.824190 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 737/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 20:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:14:30.861487 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9677f0-539a-41df-866d-acd3a2093fcb None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:14:30.871827 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9677f0-539a-41df-866d-acd3a2093fcb None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:14:30.875882 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a4117-e9cf-4348-bac9-4b05c3d9f42f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:14:30.876508 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a4117-e9cf-4348-bac9-4b05c3d9f42f service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:30.876796 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a4117-e9cf-4348-bac9-4b05c3d9f42f service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:30.877079 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a4117-e9cf-4348-bac9-4b05c3d9f42f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:30.885741 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a4117-e9cf-4348-bac9-4b05c3d9f42f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:14:30.887154 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a4117-e9cf-4348-bac9-4b05c3d9f42f service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:14:30.896314 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 718/1455] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:14:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:14:33.225471 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3094863-d318-4b8b-88dd-1b8deb11f4e5 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:33.226003 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3094863-d318-4b8b-88dd-1b8deb11f4e5 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:33.226003 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3094863-d318-4b8b-88dd-1b8deb11f4e5 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:33.227720 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 738/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 20:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:14:33.232952 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd4e2a-5509-4915-9fad-9dc5d058a02a None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:33.234593 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd4e2a-5509-4915-9fad-9dc5d058a02a None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:33.234889 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd4e2a-5509-4915-9fad-9dc5d058a02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:33.253066 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-f6cd4e2a-5509-4915-9fad-9dc5d058a02a None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:14:33.254283 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-f6cd4e2a-5509-4915-9fad-9dc5d058a02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:14:33.262226 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 719/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 20:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:14:33.300426 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3094863-d318-4b8b-88dd-1b8deb11f4e5 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:14:33.310842 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3094863-d318-4b8b-88dd-1b8deb11f4e5 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:14:33.315482 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f64489-4e01-47c0-88e4-a62e3dfcf272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:14:33.316106 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f64489-4e01-47c0-88e4-a62e3dfcf272 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:33.316387 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f64489-4e01-47c0-88e4-a62e3dfcf272 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:33.316661 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f64489-4e01-47c0-88e4-a62e3dfcf272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:33.325528 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f64489-4e01-47c0-88e4-a62e3dfcf272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:14:33.327068 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f64489-4e01-47c0-88e4-a62e3dfcf272 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:14:33.336601 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 739/1458] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:14:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:14:35.650647 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73da8f9-8a8d-463d-b3a5-bdf2ee2c5cff None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:35.651220 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73da8f9-8a8d-463d-b3a5-bdf2ee2c5cff None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:35.651220 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73da8f9-8a8d-463d-b3a5-bdf2ee2c5cff None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:35.653024 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 720/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 20:14:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:14:35.659301 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a8dd6-ee33-4bdf-9e3a-1bd81444f01a None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:35.659737 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a8dd6-ee33-4bdf-9e3a-1bd81444f01a None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:35.659865 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a8dd6-ee33-4bdf-9e3a-1bd81444f01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:35.678083 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-a86a8dd6-ee33-4bdf-9e3a-1bd81444f01a None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:14:35.679271 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a86a8dd6-ee33-4bdf-9e3a-1bd81444f01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:14:35.686956 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 740/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 20:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:14:35.724683 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73da8f9-8a8d-463d-b3a5-bdf2ee2c5cff None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:14:35.735681 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73da8f9-8a8d-463d-b3a5-bdf2ee2c5cff None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:14:35.739145 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984070da-c065-4880-ba00-c0aeb72fbfcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:14:35.739770 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984070da-c065-4880-ba00-c0aeb72fbfcc service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:35.740053 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984070da-c065-4880-ba00-c0aeb72fbfcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:35.740330 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984070da-c065-4880-ba00-c0aeb72fbfcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:35.748855 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984070da-c065-4880-ba00-c0aeb72fbfcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:14:35.750286 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984070da-c065-4880-ba00-c0aeb72fbfcc service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:14:35.759361 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 721/1461] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:14:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:14:38.086445 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe3ccd-4940-4dbc-bd8b-4d231917b693 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:38.087291 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe3ccd-4940-4dbc-bd8b-4d231917b693 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:38.087473 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe3ccd-4940-4dbc-bd8b-4d231917b693 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:38.089400 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 741/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 20:14:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:14:38.095028 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323b3c7-464c-41a8-904b-da1ac4179bac None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:38.095471 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323b3c7-464c-41a8-904b-da1ac4179bac None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:38.095579 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323b3c7-464c-41a8-904b-da1ac4179bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:38.114945 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-7323b3c7-464c-41a8-904b-da1ac4179bac None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:14:38.116128 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-7323b3c7-464c-41a8-904b-da1ac4179bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:14:38.124880 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 722/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 20:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:14:38.162398 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe3ccd-4940-4dbc-bd8b-4d231917b693 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:14:38.172905 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe3ccd-4940-4dbc-bd8b-4d231917b693 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:14:38.176430 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a70fbf-33d1-4bcf-ad88-a4b76bb25c2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:14:38.177062 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a70fbf-33d1-4bcf-ad88-a4b76bb25c2e service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:38.177375 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a70fbf-33d1-4bcf-ad88-a4b76bb25c2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:38.177663 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a70fbf-33d1-4bcf-ad88-a4b76bb25c2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:38.186941 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a70fbf-33d1-4bcf-ad88-a4b76bb25c2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:14:38.188307 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a70fbf-33d1-4bcf-ad88-a4b76bb25c2e service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:14:38.197799 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 742/1464] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:14:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:14:40.571202 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fba23b-690b-4150-910a-311edf51d492 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:40.571814 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fba23b-690b-4150-910a-311edf51d492 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:40.571814 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fba23b-690b-4150-910a-311edf51d492 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:40.573548 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 723/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 20:14:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:14:40.579701 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a275989-6f8c-4072-87e4-72df7ca37c5d None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:40.580168 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a275989-6f8c-4072-87e4-72df7ca37c5d None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:40.580273 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a275989-6f8c-4072-87e4-72df7ca37c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:40.598896 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-6a275989-6f8c-4072-87e4-72df7ca37c5d None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:14:40.600090 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-6a275989-6f8c-4072-87e4-72df7ca37c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:14:40.608036 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 743/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 20:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:14:40.647092 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fba23b-690b-4150-910a-311edf51d492 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:14:40.658342 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fba23b-690b-4150-910a-311edf51d492 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:14:40.661818 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103c7fe-385e-4e85-b32e-615872f2c242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:14:40.662448 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103c7fe-385e-4e85-b32e-615872f2c242 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:40.662739 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103c7fe-385e-4e85-b32e-615872f2c242 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:40.663017 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103c7fe-385e-4e85-b32e-615872f2c242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:40.671680 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103c7fe-385e-4e85-b32e-615872f2c242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:14:40.673098 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103c7fe-385e-4e85-b32e-615872f2c242 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:14:40.682307 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 724/1467] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:14:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:14:42.991913 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7764284-fb87-4097-91bc-0ff2627eccce None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:42.992820 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7764284-fb87-4097-91bc-0ff2627eccce None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:42.992820 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7764284-fb87-4097-91bc-0ff2627eccce None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:42.994342 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 744/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 20:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:14:43.000310 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b0f45-33db-4953-af4c-5d629bf939e5 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:43.000786 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b0f45-33db-4953-af4c-5d629bf939e5 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:43.001198 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b0f45-33db-4953-af4c-5d629bf939e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:43.020782 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-a48b0f45-33db-4953-af4c-5d629bf939e5 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:14:43.022068 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-a48b0f45-33db-4953-af4c-5d629bf939e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:14:43.030747 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 725/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 20:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:14:43.072433 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7764284-fb87-4097-91bc-0ff2627eccce None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:14:43.085885 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7764284-fb87-4097-91bc-0ff2627eccce None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:14:43.090315 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e91acb-4979-4487-97b2-97554b128e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:14:43.090959 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e91acb-4979-4487-97b2-97554b128e8d service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:14:43.091242 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e91acb-4979-4487-97b2-97554b128e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:14:43.091522 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e91acb-4979-4487-97b2-97554b128e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:14:43.110228 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e91acb-4979-4487-97b2-97554b128e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:14:43.111682 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e91acb-4979-4487-97b2-97554b128e8d service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:14:43.131832 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 745/1470] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:15:03.962170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f25786-4c0e-46d5-8383-f1aab34f7358 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:15:03.962739 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f25786-4c0e-46d5-8383-f1aab34f7358 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:15:03.962739 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f25786-4c0e-46d5-8383-f1aab34f7358 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:15:03.964501 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 726/1471] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:15:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:15:03.970377 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a527a-2378-451e-a97d-31a42533aaaa None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:15:03.970816 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a527a-2378-451e-a97d-31a42533aaaa None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:15:03.970947 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a527a-2378-451e-a97d-31a42533aaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:15:03.988496 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-c03a527a-2378-451e-a97d-31a42533aaaa None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:15:03.989736 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-c03a527a-2378-451e-a97d-31a42533aaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:15:03.997556 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 746/1472] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:15:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:15:04.043409 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cd4ac-b632-46e3-8a0d-30131a50c820 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:15:04.043705 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cd4ac-b632-46e3-8a0d-30131a50c820 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:15:04.044561 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cd4ac-b632-46e3-8a0d-30131a50c820 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:15:04.046419 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 727/1473] 10.222.0.43 () {54 vars in 961 bytes} [Tue Mar 29 20:15:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:15:04.051311 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701808f-5714-4cf2-8801-d7786199cea8 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:15:04.051608 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701808f-5714-4cf2-8801-d7786199cea8 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:15:04.051893 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701808f-5714-4cf2-8801-d7786199cea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:15:04.071389 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-b701808f-5714-4cf2-8801-d7786199cea8 None None] MFA Rules not processed for user `0b169395c92c4fbfbbe4fd14a235f81f`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:15:04.072580 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b701808f-5714-4cf2-8801-d7786199cea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:15:04.079280 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 747/1474] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Mar 29 20:15:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:15:04.086448 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cd4ac-b632-46e3-8a0d-30131a50c820 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:15:04.097372 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cd4ac-b632-46e3-8a0d-30131a50c820 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:15:04.100843 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e35c7-5bde-4fb4-bcaf-6558302f2289 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b169395c92c4fbfbbe4fd14a235f81f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:15:04.101496 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e35c7-5bde-4fb4-bcaf-6558302f2289 service glance] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:15:04.101786 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e35c7-5bde-4fb4-bcaf-6558302f2289 service glance] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:15:04.102064 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e35c7-5bde-4fb4-bcaf-6558302f2289 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:15:04.110914 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e35c7-5bde-4fb4-bcaf-6558302f2289 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:15:04.112329 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e35c7-5bde-4fb4-bcaf-6558302f2289 service glance] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:15:04.121449 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 728/1475] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:15:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:15:06.498615 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c74e5-925f-4169-89e6-0f101b6e8fb9 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:15:06.499218 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c74e5-925f-4169-89e6-0f101b6e8fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:15:06.499218 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c74e5-925f-4169-89e6-0f101b6e8fb9 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:15:06.500956 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 748/1476] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:15:06.506228 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c84521-3306-4450-bee5-627a3ecb01b7 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:15:06.506648 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c84521-3306-4450-bee5-627a3ecb01b7 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:15:06.506799 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c84521-3306-4450-bee5-627a3ecb01b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:15:06.525796 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-e3c84521-3306-4450-bee5-627a3ecb01b7 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:15:06.526996 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-e3c84521-3306-4450-bee5-627a3ecb01b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:15:06.534743 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 729/1477] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:15:06.557647 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c74e5-925f-4169-89e6-0f101b6e8fb9 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:15:06.570778 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c74e5-925f-4169-89e6-0f101b6e8fb9 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:15:06.575840 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea257d0a-c1e1-43f9-bf4d-dd7030331bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:15:06.576478 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea257d0a-c1e1-43f9-bf4d-dd7030331bad admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:15:06.576761 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea257d0a-c1e1-43f9-bf4d-dd7030331bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:15:06.577036 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea257d0a-c1e1-43f9-bf4d-dd7030331bad admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:15:06.577796 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea257d0a-c1e1-43f9-bf4d-dd7030331bad admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:15:06.579552 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING py.warnings [None req-ea257d0a-c1e1-43f9-bf4d-dd7030331bad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 29 20:15:06.579552 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: warnings.warn(msg) Mar 29 20:15:06.579552 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: Mar 29 20:15:06.580684 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea257d0a-c1e1-43f9-bf4d-dd7030331bad admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:15:06.599487 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 749/1478] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Mar 29 20:15:06 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:15:08.908095 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9f4ea-b990-4368-b249-ef2923ba0a9e None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:15:08.908675 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9f4ea-b990-4368-b249-ef2923ba0a9e None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:15:08.908675 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9f4ea-b990-4368-b249-ef2923ba0a9e None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:15:08.910466 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 730/1479] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:15:08.915596 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68429237-a200-407c-8374-6c5eed91603e None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:15:08.916053 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68429237-a200-407c-8374-6c5eed91603e None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:15:08.916193 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68429237-a200-407c-8374-6c5eed91603e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:15:08.934238 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-68429237-a200-407c-8374-6c5eed91603e None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:15:08.935482 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-68429237-a200-407c-8374-6c5eed91603e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:15:08.943275 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 750/1480] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:15:08.997367 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9f4ea-b990-4368-b249-ef2923ba0a9e None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:15:09.011275 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9f4ea-b990-4368-b249-ef2923ba0a9e None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:15:09.018617 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29949b-1765-4b4b-bd84-ef503ef56643 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:15:09.019248 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29949b-1765-4b4b-bd84-ef503ef56643 service nova] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:15:09.019533 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29949b-1765-4b4b-bd84-ef503ef56643 service nova] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:15:09.019816 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29949b-1765-4b4b-bd84-ef503ef56643 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:15:09.027844 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29949b-1765-4b4b-bd84-ef503ef56643 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:15:09.030093 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29949b-1765-4b4b-bd84-ef503ef56643 service nova] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:15:09.039260 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 731/1481] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:15:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:15:11.504526 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50410949-e51e-4a37-859b-a59f3cda2637 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:15:11.505098 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50410949-e51e-4a37-859b-a59f3cda2637 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:15:11.505098 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50410949-e51e-4a37-859b-a59f3cda2637 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:15:11.506925 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 751/1482] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:15:11.512109 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b819f7-8c37-40bb-acba-1941aa4a7c11 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:15:11.513179 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b819f7-8c37-40bb-acba-1941aa4a7c11 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:15:11.513443 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b819f7-8c37-40bb-acba-1941aa4a7c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:15:11.531243 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-a1b819f7-8c37-40bb-acba-1941aa4a7c11 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:15:11.532422 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-a1b819f7-8c37-40bb-acba-1941aa4a7c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:15:11.540128 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 732/1483] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:15:11.576349 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50410949-e51e-4a37-859b-a59f3cda2637 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:15:11.586835 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50410949-e51e-4a37-859b-a59f3cda2637 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:15:11.592154 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfca83a-fa14-4812-a358-b08547a46edf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:15:11.592154 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfca83a-fa14-4812-a358-b08547a46edf service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:15:11.592154 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfca83a-fa14-4812-a358-b08547a46edf service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:15:11.592154 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfca83a-fa14-4812-a358-b08547a46edf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:15:11.600796 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfca83a-fa14-4812-a358-b08547a46edf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:15:11.602711 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfca83a-fa14-4812-a358-b08547a46edf service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:15:11.612040 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 752/1484] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:15:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:15:13.960578 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e69055-ba1c-4c3f-8729-e4d1f4d0b1e8 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:15:13.961112 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e69055-ba1c-4c3f-8729-e4d1f4d0b1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:15:13.961222 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e69055-ba1c-4c3f-8729-e4d1f4d0b1e8 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:15:13.962995 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 733/1485] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:15:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:15:13.968124 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa919d3-c1aa-471a-8ae1-4a6d31ba8a20 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:15:13.968541 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa919d3-c1aa-471a-8ae1-4a6d31ba8a20 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:15:13.968682 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa919d3-c1aa-471a-8ae1-4a6d31ba8a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:15:13.986367 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-5aa919d3-c1aa-471a-8ae1-4a6d31ba8a20 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:15:13.987549 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-5aa919d3-c1aa-471a-8ae1-4a6d31ba8a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:15:13.995324 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 753/1486] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:15:14.033960 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e69055-ba1c-4c3f-8729-e4d1f4d0b1e8 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:15:14.044561 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e69055-ba1c-4c3f-8729-e4d1f4d0b1e8 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:15:14.048074 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fbb99-0b52-4812-a1f9-7c22fa389e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:15:14.048702 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fbb99-0b52-4812-a1f9-7c22fa389e50 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:15:14.048985 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fbb99-0b52-4812-a1f9-7c22fa389e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:15:14.049264 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fbb99-0b52-4812-a1f9-7c22fa389e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:15:14.058013 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7fbb99-0b52-4812-a1f9-7c22fa389e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:15:14.060087 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7fbb99-0b52-4812-a1f9-7c22fa389e50 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:15:14.069526 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 734/1487] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:15:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:15:16.545461 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7816e13-622f-40e9-bc40-c6a25ee1f958 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:15:16.545997 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7816e13-622f-40e9-bc40-c6a25ee1f958 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:15:16.545997 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7816e13-622f-40e9-bc40-c6a25ee1f958 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:15:16.547851 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 754/1488] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:15:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:15:16.553085 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7026c4b-6f6b-4e53-8028-382c3fe16aa7 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:15:16.553578 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7026c4b-6f6b-4e53-8028-382c3fe16aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:15:16.553676 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7026c4b-6f6b-4e53-8028-382c3fe16aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:15:16.571822 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-a7026c4b-6f6b-4e53-8028-382c3fe16aa7 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:15:16.572998 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-a7026c4b-6f6b-4e53-8028-382c3fe16aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:15:16.580932 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 735/1489] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:15:16.620445 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7816e13-622f-40e9-bc40-c6a25ee1f958 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:15:16.631677 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7816e13-622f-40e9-bc40-c6a25ee1f958 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:15:16.635151 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f37c3-c385-47f3-adc3-478a09032721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:15:16.635781 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f37c3-c385-47f3-adc3-478a09032721 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:15:16.636065 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f37c3-c385-47f3-adc3-478a09032721 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:15:16.636342 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f37c3-c385-47f3-adc3-478a09032721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:15:16.645300 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f37c3-c385-47f3-adc3-478a09032721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:15:16.646728 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f37c3-c385-47f3-adc3-478a09032721 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:15:16.656216 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 755/1490] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:15:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:15:19.328925 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7831f-b6f3-4203-8dc7-f0fba04098b0 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:15:19.329531 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7831f-b6f3-4203-8dc7-f0fba04098b0 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:15:19.329531 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7831f-b6f3-4203-8dc7-f0fba04098b0 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:15:19.331289 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 736/1491] 10.222.0.43 () {54 vars in 926 bytes} [Tue Mar 29 20:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:15:19.336388 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46cf8d-1a76-4d4c-a1ba-12ea3a038c08 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:15:19.336821 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46cf8d-1a76-4d4c-a1ba-12ea3a038c08 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:15:19.336982 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46cf8d-1a76-4d4c-a1ba-12ea3a038c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:15:19.355248 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-be46cf8d-1a76-4d4c-a1ba-12ea3a038c08 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:15:19.357603 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-be46cf8d-1a76-4d4c-a1ba-12ea3a038c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:15:19.365178 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 756/1492] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Mar 29 20:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:15:19.403694 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7831f-b6f3-4203-8dc7-f0fba04098b0 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:15:19.414083 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7831f-b6f3-4203-8dc7-f0fba04098b0 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:15:19.417602 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538537ec-9658-4593-97ae-6ec4e45f54d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:15:19.418842 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538537ec-9658-4593-97ae-6ec4e45f54d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:15:19.419125 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538537ec-9658-4593-97ae-6ec4e45f54d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:15:19.419482 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538537ec-9658-4593-97ae-6ec4e45f54d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:15:19.428143 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538537ec-9658-4593-97ae-6ec4e45f54d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:15:19.429577 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538537ec-9658-4593-97ae-6ec4e45f54d3 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:15:19.438872 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 737/1493] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:15:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:16:47.402916 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab2f8e-fc63-4076-b26d-b0d57d975c37 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:16:47.403511 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab2f8e-fc63-4076-b26d-b0d57d975c37 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:16:47.403511 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab2f8e-fc63-4076-b26d-b0d57d975c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:16:47.421304 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-6bab2f8e-fc63-4076-b26d-b0d57d975c37 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:16:47.422494 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-6bab2f8e-fc63-4076-b26d-b0d57d975c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:16:47.430779 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 757/1494] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:16:47.439894 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0363ae-621c-4e7d-b388-31be9e1b1344 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:16:47.440399 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0363ae-621c-4e7d-b388-31be9e1b1344 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:16:47.440399 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0363ae-621c-4e7d-b388-31be9e1b1344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:16:47.458882 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-9e0363ae-621c-4e7d-b388-31be9e1b1344 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:16:47.460079 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9e0363ae-621c-4e7d-b388-31be9e1b1344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:16:47.468024 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 738/1495] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:16:47.472645 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab2f8e-fc63-4076-b26d-b0d57d975c37 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:16:47.482277 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab2f8e-fc63-4076-b26d-b0d57d975c37 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:16:47.486694 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804b33b-ec7c-4733-915e-39cd6da57fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:16:47.487341 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804b33b-ec7c-4733-915e-39cd6da57fac admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:16:47.487625 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804b33b-ec7c-4733-915e-39cd6da57fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:16:47.487905 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804b33b-ec7c-4733-915e-39cd6da57fac admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:16:47.488617 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804b33b-ec7c-4733-915e-39cd6da57fac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:16:47.488928 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804b33b-ec7c-4733-915e-39cd6da57fac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:16:47.489967 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING py.warnings [None req-1804b33b-ec7c-4733-915e-39cd6da57fac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 20:16:47.489967 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: warnings.warn(msg) Mar 29 20:16:47.489967 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: Mar 29 20:16:47.490854 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804b33b-ec7c-4733-915e-39cd6da57fac admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:16:47.502482 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 758/1496] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:16:47.511510 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0363ae-621c-4e7d-b388-31be9e1b1344 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:16:47.520532 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0363ae-621c-4e7d-b388-31be9e1b1344 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:16:47.525133 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73123f-e2e2-41b3-8ae8-648ce7a0aa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:16:47.525804 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73123f-e2e2-41b3-8ae8-648ce7a0aa17 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:16:47.526091 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73123f-e2e2-41b3-8ae8-648ce7a0aa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:16:47.526375 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73123f-e2e2-41b3-8ae8-648ce7a0aa17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:16:47.527073 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b73123f-e2e2-41b3-8ae8-648ce7a0aa17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:16:47.528752 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING py.warnings [None req-8b73123f-e2e2-41b3-8ae8-648ce7a0aa17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 29 20:16:47.528752 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: warnings.warn(msg) Mar 29 20:16:47.528752 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: Mar 29 20:16:47.529966 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b73123f-e2e2-41b3-8ae8-648ce7a0aa17 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:16:47.629168 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 739/1497] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:16:47 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:16:47.634027 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804b33b-ec7c-4733-915e-39cd6da57fac admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:16:47.643921 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804b33b-ec7c-4733-915e-39cd6da57fac admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:16:47.698285 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1805f-6e99-417f-a2d2-5ad29e3e5cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:16:47.698872 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1805f-6e99-417f-a2d2-5ad29e3e5cbb admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:16:47.699153 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1805f-6e99-417f-a2d2-5ad29e3e5cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:16:47.699445 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1805f-6e99-417f-a2d2-5ad29e3e5cbb admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:16:47.700106 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1805f-6e99-417f-a2d2-5ad29e3e5cbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:16:47.701107 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING py.warnings [None req-c3d1805f-6e99-417f-a2d2-5ad29e3e5cbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 29 20:16:47.701107 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: warnings.warn(msg) Mar 29 20:16:47.701107 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: Mar 29 20:16:47.702332 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1805f-6e99-417f-a2d2-5ad29e3e5cbb admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:16:47.777228 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 759/1498] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:16:47 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:16:47.781347 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73123f-e2e2-41b3-8ae8-648ce7a0aa17 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:16:47.791861 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73123f-e2e2-41b3-8ae8-648ce7a0aa17 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:16:47.796436 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0d9a9-8006-42c4-ba43-4b9ebb7e886c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:16:47.797090 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0d9a9-8006-42c4-ba43-4b9ebb7e886c admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:16:47.797479 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0d9a9-8006-42c4-ba43-4b9ebb7e886c admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:16:47.803162 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0d9a9-8006-42c4-ba43-4b9ebb7e886c admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:16:47.803162 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0d9a9-8006-42c4-ba43-4b9ebb7e886c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:16:47.803162 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING py.warnings [None req-ffd0d9a9-8006-42c4-ba43-4b9ebb7e886c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 20:16:47.803162 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: warnings.warn(msg) Mar 29 20:16:47.803162 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: Mar 29 20:16:47.803162 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0d9a9-8006-42c4-ba43-4b9ebb7e886c admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:16:47.812886 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 740/1499] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:16:47.816984 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1805f-6e99-417f-a2d2-5ad29e3e5cbb admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:16:47.827900 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1805f-6e99-417f-a2d2-5ad29e3e5cbb admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:16:47.832624 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d657f1c-88b0-415e-9055-ca437b029796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:16:47.833323 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d657f1c-88b0-415e-9055-ca437b029796 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:16:47.833670 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d657f1c-88b0-415e-9055-ca437b029796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:16:47.833953 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d657f1c-88b0-415e-9055-ca437b029796 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:16:47.834678 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d657f1c-88b0-415e-9055-ca437b029796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:16:47.835694 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING py.warnings [None req-4d657f1c-88b0-415e-9055-ca437b029796 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 20:16:47.835694 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: warnings.warn(msg) Mar 29 20:16:47.835694 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: Mar 29 20:16:47.837199 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d657f1c-88b0-415e-9055-ca437b029796 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:16:47.850430 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 760/1500] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:16:47.854592 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0d9a9-8006-42c4-ba43-4b9ebb7e886c admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:16:47.864465 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0d9a9-8006-42c4-ba43-4b9ebb7e886c admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:16:47.869758 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc5a74-e018-4146-8bb9-26293602473e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:16:47.870831 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc5a74-e018-4146-8bb9-26293602473e admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:16:47.871125 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc5a74-e018-4146-8bb9-26293602473e admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:16:47.871403 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc5a74-e018-4146-8bb9-26293602473e admin admin] PATH_INFO: `/v3/projects/3ae80b28b4a34c4e8be3fb2ed80c5098/users/637adcd48f39494bba6d144b6c47e2d3/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:16:47.887614 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc5a74-e018-4146-8bb9-26293602473e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ae80b28b4a34c4e8be3fb2ed80c5098, user_id=637adcd48f39494bba6d144b6c47e2d3, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:16:47.888625 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING py.warnings [None req-53fc5a74-e018-4146-8bb9-26293602473e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 29 20:16:47.888625 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: warnings.warn(msg) Mar 29 20:16:47.888625 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: Mar 29 20:16:47.890651 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc5a74-e018-4146-8bb9-26293602473e admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:16:47.960782 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 741/1501] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:16:47 2022] PUT /identity/v3/projects/3ae80b28b4a34c4e8be3fb2ed80c5098/users/637adcd48f39494bba6d144b6c47e2d3/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:16:47.972139 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edc76e-a766-40f1-b3e9-0245935d9984 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:16:47.972435 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edc76e-a766-40f1-b3e9-0245935d9984 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:16:47.972723 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edc76e-a766-40f1-b3e9-0245935d9984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:16:47.998715 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-a9edc76e-a766-40f1-b3e9-0245935d9984 None None] MFA Rules not processed for user `637adcd48f39494bba6d144b6c47e2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:16:47.999913 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a9edc76e-a766-40f1-b3e9-0245935d9984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:16:48.061176 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 761/1502] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:16:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:16:48.072999 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc5a74-e018-4146-8bb9-26293602473e admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:16:48.140516 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc5a74-e018-4146-8bb9-26293602473e admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:16:48.145931 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a55625-f940-4820-a147-45b21318a92a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:16:48.146573 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a55625-f940-4820-a147-45b21318a92a service nova] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:16:48.146864 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a55625-f940-4820-a147-45b21318a92a service nova] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:16:48.147146 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a55625-f940-4820-a147-45b21318a92a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:16:48.154768 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a55625-f940-4820-a147-45b21318a92a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:16:48.156340 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a55625-f940-4820-a147-45b21318a92a service nova] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:16:48.164983 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 742/1503] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:16:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:16:48.234750 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ab1c0-32f4-4ea1-9873-ba51354b446b None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:16:48.235044 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ab1c0-32f4-4ea1-9873-ba51354b446b None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:16:48.235327 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ab1c0-32f4-4ea1-9873-ba51354b446b None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:16:48.237039 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 762/1504] 10.222.0.43 () {52 vars in 829 bytes} [Tue Mar 29 20:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:16:48.240517 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a55625-f940-4820-a147-45b21318a92a service nova] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:16:48.299616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a55625-f940-4820-a147-45b21318a92a service nova] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:16:48.304060 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc577c8-3cbf-4813-a1b9-db7ff9a8e8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:16:48.305430 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc577c8-3cbf-4813-a1b9-db7ff9a8e8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:16:48.305755 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc577c8-3cbf-4813-a1b9-db7ff9a8e8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:16:48.306028 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc577c8-3cbf-4813-a1b9-db7ff9a8e8d3 admin admin] PATH_INFO: `/v3/users/637adcd48f39494bba6d144b6c47e2d3` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:16:48.307211 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc577c8-3cbf-4813-a1b9-db7ff9a8e8d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=637adcd48f39494bba6d144b6c47e2d3)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:16:48.308210 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING py.warnings [None req-8dc577c8-3cbf-4813-a1b9-db7ff9a8e8d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 29 20:16:48.308210 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: warnings.warn(msg) Mar 29 20:16:48.308210 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: Mar 29 20:16:48.309433 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc577c8-3cbf-4813-a1b9-db7ff9a8e8d3 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:16:48.543424 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8dc577c8-3cbf-4813-a1b9-db7ff9a8e8d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '637adcd48f39494bba6d144b6c47e2d3'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:16:48.622915 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8dc577c8-3cbf-4813-a1b9-db7ff9a8e8d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '637adcd48f39494bba6d144b6c47e2d3'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:16:48.623538 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8dc577c8-3cbf-4813-a1b9-db7ff9a8e8d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '637adcd48f39494bba6d144b6c47e2d3'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:16:48.636292 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8dc577c8-3cbf-4813-a1b9-db7ff9a8e8d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '637adcd48f39494bba6d144b6c47e2d3'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:16:48.656070 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8dc577c8-3cbf-4813-a1b9-db7ff9a8e8d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '637adcd48f39494bba6d144b6c47e2d3'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:16:48.662116 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 743/1505] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:16:48 2022] DELETE /identity/v3/users/637adcd48f39494bba6d144b6c47e2d3 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:16:48.667389 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf891f0-49c2-4b22-8702-20da2ff1128b None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:16:48.667889 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf891f0-49c2-4b22-8702-20da2ff1128b None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:16:48.667986 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf891f0-49c2-4b22-8702-20da2ff1128b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:16:48.685677 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-edf891f0-49c2-4b22-8702-20da2ff1128b None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:16:48.686859 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-edf891f0-49c2-4b22-8702-20da2ff1128b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:16:48.743498 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 763/1506] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:16:48.752884 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc577c8-3cbf-4813-a1b9-db7ff9a8e8d3 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:16:48.754286 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-8dc577c8-3cbf-4813-a1b9-db7ff9a8e8d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:16:48.808779 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc577c8-3cbf-4813-a1b9-db7ff9a8e8d3 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:16:48.812282 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb207f41-206c-4562-a088-410a652f0477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:16:48.812920 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb207f41-206c-4562-a088-410a652f0477 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:16:48.813207 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb207f41-206c-4562-a088-410a652f0477 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:16:48.813513 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb207f41-206c-4562-a088-410a652f0477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:16:48.823286 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb207f41-206c-4562-a088-410a652f0477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:16:48.824703 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb207f41-206c-4562-a088-410a652f0477 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:16:48.833883 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 744/1507] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:16:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:16:49.332885 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf891f0-49c2-4b22-8702-20da2ff1128b None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:16:49.334476 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-edf891f0-49c2-4b22-8702-20da2ff1128b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:16:49.346641 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf891f0-49c2-4b22-8702-20da2ff1128b None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:16:49.351252 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb54a54-1a18-4fbd-acc1-5d5d68ef0224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:16:49.353257 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb54a54-1a18-4fbd-acc1-5d5d68ef0224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:16:49.356309 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb54a54-1a18-4fbd-acc1-5d5d68ef0224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:16:49.356309 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb54a54-1a18-4fbd-acc1-5d5d68ef0224 admin admin] PATH_INFO: `/v3/projects/3ae80b28b4a34c4e8be3fb2ed80c5098` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:16:49.356309 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb54a54-1a18-4fbd-acc1-5d5d68ef0224 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ae80b28b4a34c4e8be3fb2ed80c5098)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:16:49.356309 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING py.warnings [None req-3cb54a54-1a18-4fbd-acc1-5d5d68ef0224 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 29 20:16:49.356309 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: warnings.warn(msg) Mar 29 20:16:49.356309 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: Mar 29 20:16:49.357224 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb54a54-1a18-4fbd-acc1-5d5d68ef0224 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:16:49.486362 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3cb54a54-1a18-4fbd-acc1-5d5d68ef0224 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ae80b28b4a34c4e8be3fb2ed80c5098', 'request_id': 'req-3cb54a54-1a18-4fbd-acc1-5d5d68ef0224'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:16:49.492250 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3cb54a54-1a18-4fbd-acc1-5d5d68ef0224 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ae80b28b4a34c4e8be3fb2ed80c5098', 'request_id': 'req-3cb54a54-1a18-4fbd-acc1-5d5d68ef0224'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:16:49.506329 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3cb54a54-1a18-4fbd-acc1-5d5d68ef0224 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ae80b28b4a34c4e8be3fb2ed80c5098', 'request_id': 'req-3cb54a54-1a18-4fbd-acc1-5d5d68ef0224'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:16:49.604670 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3cb54a54-1a18-4fbd-acc1-5d5d68ef0224 admin admin] The token cache is being invalidate because project 3ae80b28b4a34c4e8be3fb2ed80c5098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:16:49.604878 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3cb54a54-1a18-4fbd-acc1-5d5d68ef0224 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:16:49.605607 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3cb54a54-1a18-4fbd-acc1-5d5d68ef0224 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:16:49.607243 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 764/1508] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:16:49 2022] DELETE /identity/v3/projects/3ae80b28b4a34c4e8be3fb2ed80c5098 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:18:24.249772 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fa50c-e97b-4f1c-a9fc-8f9c39bfa0e7 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:24.250367 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fa50c-e97b-4f1c-a9fc-8f9c39bfa0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:24.250367 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fa50c-e97b-4f1c-a9fc-8f9c39bfa0e7 None None] PATH_INFO: `/v3` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:24.251627 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 745/1509] 10.222.0.42 () {54 vars in 925 bytes} [Tue Mar 29 20:18:24 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:18:24.258340 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca0f0e-2e9a-4345-bc44-06d5d365ec4e None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:24.258835 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca0f0e-2e9a-4345-bc44-06d5d365ec4e None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:24.259006 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca0f0e-2e9a-4345-bc44-06d5d365ec4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:24.280100 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-4fca0f0e-2e9a-4345-bc44-06d5d365ec4e None None] MFA Rules not processed for user `5ef0001e91524a13a9ca601a601de66b`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:18:24.284187 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-4fca0f0e-2e9a-4345-bc44-06d5d365ec4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:18:24.347867 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 765/1510] 10.222.0.42 () {58 vars in 1015 bytes} [Tue Mar 29 20:18:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:18:24.451251 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009defe-50f8-4d29-9a16-31d0fee5d00e None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:24.451541 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009defe-50f8-4d29-9a16-31d0fee5d00e None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:24.451823 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009defe-50f8-4d29-9a16-31d0fee5d00e None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:24.453715 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 746/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 29 20:18:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:18:24.458740 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94042abe-4d5f-479b-b903-a34f12dc2cc2 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:24.459100 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94042abe-4d5f-479b-b903-a34f12dc2cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:24.459387 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94042abe-4d5f-479b-b903-a34f12dc2cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:24.477381 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-94042abe-4d5f-479b-b903-a34f12dc2cc2 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:18:24.478568 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-94042abe-4d5f-479b-b903-a34f12dc2cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:18:24.536859 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 766/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 29 20:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:18:24.691714 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009defe-50f8-4d29-9a16-31d0fee5d00e None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:18:24.693415 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-a009defe-50f8-4d29-9a16-31d0fee5d00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:18:24.765798 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009defe-50f8-4d29-9a16-31d0fee5d00e None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:18:24.771026 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f08eee-d6cc-4e07-89f4-d6a5ad4996ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:18:24.771661 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f08eee-d6cc-4e07-89f4-d6a5ad4996ce service nova] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:24.771946 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f08eee-d6cc-4e07-89f4-d6a5ad4996ce service nova] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:24.772226 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f08eee-d6cc-4e07-89f4-d6a5ad4996ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:24.780266 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f08eee-d6cc-4e07-89f4-d6a5ad4996ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:18:24.781878 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f08eee-d6cc-4e07-89f4-d6a5ad4996ce service nova] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:18:24.791670 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 747/1513] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:18:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:18:26.086002 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59ac55-a869-4d95-9618-4394bda3dd5d None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:26.086538 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59ac55-a869-4d95-9618-4394bda3dd5d None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:26.086633 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59ac55-a869-4d95-9618-4394bda3dd5d None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:26.088367 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 767/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 29 20:18:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:18:26.093199 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea976c-d7b4-45d5-9c64-8569804ea8ff None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:26.093632 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea976c-d7b4-45d5-9c64-8569804ea8ff None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:26.093794 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea976c-d7b4-45d5-9c64-8569804ea8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:26.112404 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-7dea976c-d7b4-45d5-9c64-8569804ea8ff None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:18:26.113639 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-7dea976c-d7b4-45d5-9c64-8569804ea8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:18:26.121467 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 748/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 29 20:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:18:26.279888 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59ac55-a869-4d95-9618-4394bda3dd5d None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:18:26.294915 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59ac55-a869-4d95-9618-4394bda3dd5d None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:18:26.300268 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5275d5b-45b7-4237-abdd-cf2367d17a16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:18:26.301115 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5275d5b-45b7-4237-abdd-cf2367d17a16 service nova] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:26.301476 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5275d5b-45b7-4237-abdd-cf2367d17a16 service nova] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:26.301651 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5275d5b-45b7-4237-abdd-cf2367d17a16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:26.310736 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5275d5b-45b7-4237-abdd-cf2367d17a16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:18:26.317701 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5275d5b-45b7-4237-abdd-cf2367d17a16 service nova] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:18:26.322958 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 768/1516] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:18:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:18:28.428774 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbba97-2966-4d6f-a735-a8749ae01d66 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:28.430189 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbba97-2966-4d6f-a735-a8749ae01d66 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:28.430478 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbba97-2966-4d6f-a735-a8749ae01d66 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:28.432256 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 749/1517] 10.222.0.43 () {54 vars in 960 bytes} [Tue Mar 29 20:18:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:18:28.437879 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47073cd9-962c-4c6b-97db-eead961103d4 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:28.438336 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47073cd9-962c-4c6b-97db-eead961103d4 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:28.438438 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47073cd9-962c-4c6b-97db-eead961103d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:28.456515 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-47073cd9-962c-4c6b-97db-eead961103d4 None None] MFA Rules not processed for user `5ef0001e91524a13a9ca601a601de66b`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:18:28.457734 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-47073cd9-962c-4c6b-97db-eead961103d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:18:28.466621 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 769/1518] 10.222.0.43 () {58 vars in 1057 bytes} [Tue Mar 29 20:18:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:18:28.474378 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cbba97-2966-4d6f-a735-a8749ae01d66 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:18:28.488420 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cbba97-2966-4d6f-a735-a8749ae01d66 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:18:28.494732 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc06e2-8f35-44e1-bef6-2c6a43cbf6b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef0001e91524a13a9ca601a601de66b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:18:28.495366 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc06e2-8f35-44e1-bef6-2c6a43cbf6b5 service placement] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:28.495655 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc06e2-8f35-44e1-bef6-2c6a43cbf6b5 service placement] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:28.495941 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc06e2-8f35-44e1-bef6-2c6a43cbf6b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:28.504303 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc06e2-8f35-44e1-bef6-2c6a43cbf6b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:18:28.505914 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc06e2-8f35-44e1-bef6-2c6a43cbf6b5 service placement] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:18:28.515668 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 750/1519] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:18:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:18:38.021569 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea1272-ff9a-4c4a-9bb0-128ea5fb6bfc None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:38.022164 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea1272-ff9a-4c4a-9bb0-128ea5fb6bfc None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:38.022164 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea1272-ff9a-4c4a-9bb0-128ea5fb6bfc None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:38.024563 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 770/1520] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 29 20:18:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:18:38.029488 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75db10-22e7-4d06-a448-c8f5b2cffbdc None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:38.029908 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75db10-22e7-4d06-a448-c8f5b2cffbdc None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:38.030054 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75db10-22e7-4d06-a448-c8f5b2cffbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:38.048126 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-1d75db10-22e7-4d06-a448-c8f5b2cffbdc None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:18:38.049278 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-1d75db10-22e7-4d06-a448-c8f5b2cffbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:18:38.056906 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 751/1521] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 29 20:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:18:38.212328 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea1272-ff9a-4c4a-9bb0-128ea5fb6bfc None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:18:38.226555 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea1272-ff9a-4c4a-9bb0-128ea5fb6bfc None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:18:38.231832 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d18ee-afde-45d1-9bd8-afd2d1fd74f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:18:38.232461 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d18ee-afde-45d1-9bd8-afd2d1fd74f3 service nova] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:38.232743 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d18ee-afde-45d1-9bd8-afd2d1fd74f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:38.233018 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d18ee-afde-45d1-9bd8-afd2d1fd74f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:38.240922 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d18ee-afde-45d1-9bd8-afd2d1fd74f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:18:38.242571 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d18ee-afde-45d1-9bd8-afd2d1fd74f3 service nova] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:18:38.251650 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 771/1522] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:18:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:18:39.515657 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a60d4-dad0-4b31-8aef-b0074184a112 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:39.516188 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a60d4-dad0-4b31-8aef-b0074184a112 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:39.516188 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a60d4-dad0-4b31-8aef-b0074184a112 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:39.517959 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 752/1523] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 29 20:18:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:18:39.523422 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97cb43-31f4-469c-99cc-b7801cc66c7d None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:39.523843 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97cb43-31f4-469c-99cc-b7801cc66c7d None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:39.524105 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97cb43-31f4-469c-99cc-b7801cc66c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:39.542323 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-1d97cb43-31f4-469c-99cc-b7801cc66c7d None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:18:39.554537 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-1d97cb43-31f4-469c-99cc-b7801cc66c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:18:39.554537 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 772/1524] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 29 20:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:18:39.716089 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a60d4-dad0-4b31-8aef-b0074184a112 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:18:39.730484 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a60d4-dad0-4b31-8aef-b0074184a112 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:18:39.735872 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaab66f-4a1a-4926-97c7-8b6d8a9784f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:18:39.736504 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaab66f-4a1a-4926-97c7-8b6d8a9784f3 service nova] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:39.736791 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaab66f-4a1a-4926-97c7-8b6d8a9784f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:39.737071 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaab66f-4a1a-4926-97c7-8b6d8a9784f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:39.745096 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaab66f-4a1a-4926-97c7-8b6d8a9784f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:18:39.746698 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaab66f-4a1a-4926-97c7-8b6d8a9784f3 service nova] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:18:39.755909 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 753/1525] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:18:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:18:43.966621 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b27e9-807c-457f-aa8e-570ca85dd76c None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:43.967139 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b27e9-807c-457f-aa8e-570ca85dd76c None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:43.967248 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b27e9-807c-457f-aa8e-570ca85dd76c None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:43.968960 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 773/1526] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 20:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:18:43.974043 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f437cfc-858a-4f9b-8f6c-5207df12be37 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:43.974501 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f437cfc-858a-4f9b-8f6c-5207df12be37 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:43.974614 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f437cfc-858a-4f9b-8f6c-5207df12be37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:43.993004 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-2f437cfc-858a-4f9b-8f6c-5207df12be37 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:18:43.994238 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-2f437cfc-858a-4f9b-8f6c-5207df12be37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:18:44.002256 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 754/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 20:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:18:44.038238 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b27e9-807c-457f-aa8e-570ca85dd76c None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:18:44.040172 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-4c6b27e9-807c-457f-aa8e-570ca85dd76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:18:44.096626 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b27e9-807c-457f-aa8e-570ca85dd76c None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:18:44.100197 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed9c8d-f025-4f7d-88d1-e18f6c9aa7e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:18:44.100838 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed9c8d-f025-4f7d-88d1-e18f6c9aa7e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:44.101673 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed9c8d-f025-4f7d-88d1-e18f6c9aa7e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:44.101962 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed9c8d-f025-4f7d-88d1-e18f6c9aa7e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:44.110807 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed9c8d-f025-4f7d-88d1-e18f6c9aa7e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:18:44.116191 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed9c8d-f025-4f7d-88d1-e18f6c9aa7e3 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:18:44.122110 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 774/1528] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:18:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:18:46.552298 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb2aba-7284-4226-9831-e9488217ea0d None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:46.552842 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb2aba-7284-4226-9831-e9488217ea0d None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:46.552842 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb2aba-7284-4226-9831-e9488217ea0d None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:46.554922 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 755/1529] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 20:18:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:18:46.559998 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f3ae8-768b-4c53-98e0-0139b94f47a2 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:46.560438 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f3ae8-768b-4c53-98e0-0139b94f47a2 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:46.560576 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f3ae8-768b-4c53-98e0-0139b94f47a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:46.579984 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-807f3ae8-768b-4c53-98e0-0139b94f47a2 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:18:46.581183 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-807f3ae8-768b-4c53-98e0-0139b94f47a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:18:46.589741 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 775/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 20:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:18:46.624564 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb2aba-7284-4226-9831-e9488217ea0d None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:18:46.635832 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb2aba-7284-4226-9831-e9488217ea0d None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:18:46.639295 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf87857-fe37-4317-8466-4b163a7882c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:18:46.639930 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf87857-fe37-4317-8466-4b163a7882c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:46.640220 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf87857-fe37-4317-8466-4b163a7882c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:46.640504 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf87857-fe37-4317-8466-4b163a7882c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:46.649860 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf87857-fe37-4317-8466-4b163a7882c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:18:46.651289 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf87857-fe37-4317-8466-4b163a7882c4 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:18:46.660527 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 756/1531] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:18:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:18:50.551724 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26e108-06ce-4fc1-9e7e-350742204603 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:50.552312 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26e108-06ce-4fc1-9e7e-350742204603 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:50.552312 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26e108-06ce-4fc1-9e7e-350742204603 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:50.554698 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 776/1532] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 20:18:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:18:50.559758 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb7a69-ee78-431d-84bd-9b49fdb54224 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:50.560190 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb7a69-ee78-431d-84bd-9b49fdb54224 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:50.560317 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb7a69-ee78-431d-84bd-9b49fdb54224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:50.578792 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-c5cb7a69-ee78-431d-84bd-9b49fdb54224 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:18:50.579964 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-c5cb7a69-ee78-431d-84bd-9b49fdb54224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:18:50.587753 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 757/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 20:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:18:50.841467 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26e108-06ce-4fc1-9e7e-350742204603 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:18:50.843138 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-1a26e108-06ce-4fc1-9e7e-350742204603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:18:50.899981 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26e108-06ce-4fc1-9e7e-350742204603 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:18:50.903475 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821bb57-3a07-46ba-b6dc-7673aadaa49b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:18:50.904116 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821bb57-3a07-46ba-b6dc-7673aadaa49b service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:50.904426 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821bb57-3a07-46ba-b6dc-7673aadaa49b service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:50.904730 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821bb57-3a07-46ba-b6dc-7673aadaa49b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:50.914211 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821bb57-3a07-46ba-b6dc-7673aadaa49b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:18:50.915832 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821bb57-3a07-46ba-b6dc-7673aadaa49b service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:18:50.924972 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 777/1534] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:18:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:18:53.245655 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3eb91-0591-47e6-963c-04704c6127b1 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:53.246212 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3eb91-0591-47e6-963c-04704c6127b1 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:53.246212 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3eb91-0591-47e6-963c-04704c6127b1 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:53.248001 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 758/1535] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 20:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:18:53.253070 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03818b5c-d1a4-4304-b4f8-9fe30ad14d5b None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:53.253553 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03818b5c-d1a4-4304-b4f8-9fe30ad14d5b None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:53.254183 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03818b5c-d1a4-4304-b4f8-9fe30ad14d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:53.272351 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-03818b5c-d1a4-4304-b4f8-9fe30ad14d5b None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:18:53.274194 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-03818b5c-d1a4-4304-b4f8-9fe30ad14d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:18:53.281876 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 778/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 20:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:18:53.537611 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62858ff-0b56-4cb3-8e0d-e77eea09dab1 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:53.537899 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62858ff-0b56-4cb3-8e0d-e77eea09dab1 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:53.538178 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62858ff-0b56-4cb3-8e0d-e77eea09dab1 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:53.540136 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 759/1537] 10.222.0.43 () {54 vars in 962 bytes} [Tue Mar 29 20:18:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:18:53.544855 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b048893-fcf5-4499-b589-5271684d1970 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:53.545145 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b048893-fcf5-4499-b589-5271684d1970 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:53.545466 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b048893-fcf5-4499-b589-5271684d1970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:53.565603 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-9b048893-fcf5-4499-b589-5271684d1970 None None] MFA Rules not processed for user `1d8ea87a7fd34751896b2a0ffaedab2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:18:53.566787 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-9b048893-fcf5-4499-b589-5271684d1970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:18:53.573718 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 779/1538] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Mar 29 20:18:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:18:53.582709 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62858ff-0b56-4cb3-8e0d-e77eea09dab1 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:18:53.592978 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62858ff-0b56-4cb3-8e0d-e77eea09dab1 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:18:53.596412 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc306b4c-d56c-4370-9057-99f78adf5098 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:18:53.597040 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc306b4c-d56c-4370-9057-99f78adf5098 service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:18:53.597346 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc306b4c-d56c-4370-9057-99f78adf5098 service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:18:53.597628 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc306b4c-d56c-4370-9057-99f78adf5098 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:18:53.606381 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc306b4c-d56c-4370-9057-99f78adf5098 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:18:53.607790 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc306b4c-d56c-4370-9057-99f78adf5098 service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:18:53.617375 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 760/1539] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:18:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:21.826679 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa88d9-1b07-419a-be6c-4ca50b8ea01b None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:21.829306 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa88d9-1b07-419a-be6c-4ca50b8ea01b None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:21.829306 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa88d9-1b07-419a-be6c-4ca50b8ea01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:21.850545 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-06fa88d9-1b07-419a-be6c-4ca50b8ea01b None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:21.851755 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-06fa88d9-1b07-419a-be6c-4ca50b8ea01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:21.864624 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 780/1540] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:20:21.875024 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893d6f2-0afb-4704-8cf9-12efd5a1ebfc None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:21.877867 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893d6f2-0afb-4704-8cf9-12efd5a1ebfc None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:21.877867 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893d6f2-0afb-4704-8cf9-12efd5a1ebfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:21.896876 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-2893d6f2-0afb-4704-8cf9-12efd5a1ebfc None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:21.902710 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-2893d6f2-0afb-4704-8cf9-12efd5a1ebfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:21.914585 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 761/1541] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:20:21.919232 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa88d9-1b07-419a-be6c-4ca50b8ea01b None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:21.936201 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa88d9-1b07-419a-be6c-4ca50b8ea01b None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:21.949324 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19daecc-9561-410a-bcb2-ccd4a6d4c08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:21.949324 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19daecc-9561-410a-bcb2-ccd4a6d4c08b admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:21.949324 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19daecc-9561-410a-bcb2-ccd4a6d4c08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:21.949324 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19daecc-9561-410a-bcb2-ccd4a6d4c08b admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:21.949764 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19daecc-9561-410a-bcb2-ccd4a6d4c08b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:20:21.949764 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19daecc-9561-410a-bcb2-ccd4a6d4c08b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:21.951238 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19daecc-9561-410a-bcb2-ccd4a6d4c08b admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:21.979877 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 781/1542] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:20:21.988476 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893d6f2-0afb-4704-8cf9-12efd5a1ebfc None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:22.002337 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893d6f2-0afb-4704-8cf9-12efd5a1ebfc None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:22.009110 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb418f-ee11-4c9f-a594-ae630752d6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:22.009799 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb418f-ee11-4c9f-a594-ae630752d6e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:22.010082 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb418f-ee11-4c9f-a594-ae630752d6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:22.010363 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb418f-ee11-4c9f-a594-ae630752d6e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:22.011073 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb418f-ee11-4c9f-a594-ae630752d6e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:22.012990 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb418f-ee11-4c9f-a594-ae630752d6e0 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:22.122427 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 762/1543] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:20:21 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:22.126535 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19daecc-9561-410a-bcb2-ccd4a6d4c08b admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:22.140096 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19daecc-9561-410a-bcb2-ccd4a6d4c08b admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:22.212766 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d682c5-3472-44eb-bf2a-faed1788d4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:22.213498 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d682c5-3472-44eb-bf2a-faed1788d4ed admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:22.213786 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d682c5-3472-44eb-bf2a-faed1788d4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:22.214067 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d682c5-3472-44eb-bf2a-faed1788d4ed admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:22.214768 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d682c5-3472-44eb-bf2a-faed1788d4ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:22.217012 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d682c5-3472-44eb-bf2a-faed1788d4ed admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:22.227699 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ef443-4343-48f5-a054-195fae36685b None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:22.228030 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ef443-4343-48f5-a054-195fae36685b None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:22.228313 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ef443-4343-48f5-a054-195fae36685b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:22.258901 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-9d4ef443-4343-48f5-a054-195fae36685b None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:22.261764 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9d4ef443-4343-48f5-a054-195fae36685b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:22.276596 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 763/1544] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:20:22.288390 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15df9d6-a16e-427f-b82f-de59149aa5f9 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:22.288716 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15df9d6-a16e-427f-b82f-de59149aa5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:22.288946 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15df9d6-a16e-427f-b82f-de59149aa5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:22.310026 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-f15df9d6-a16e-427f-b82f-de59149aa5f9 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:22.314757 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-f15df9d6-a16e-427f-b82f-de59149aa5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:22.317340 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 782/1545] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:20:22 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:22.321832 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d682c5-3472-44eb-bf2a-faed1788d4ed admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:22.327123 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 764/1546] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:20:22.332412 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15df9d6-a16e-427f-b82f-de59149aa5f9 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:22.342253 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d682c5-3472-44eb-bf2a-faed1788d4ed admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:22.346220 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15df9d6-a16e-427f-b82f-de59149aa5f9 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:22.356397 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afe271-deb3-4f58-9a06-2b962dbedd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:22.357583 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1e359-b60c-446f-a9b8-b7b237424692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:22.357898 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afe271-deb3-4f58-9a06-2b962dbedd01 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:22.358257 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1e359-b60c-446f-a9b8-b7b237424692 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:22.358455 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afe271-deb3-4f58-9a06-2b962dbedd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:22.358569 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1e359-b60c-446f-a9b8-b7b237424692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:22.358732 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afe271-deb3-4f58-9a06-2b962dbedd01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:22.358869 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1e359-b60c-446f-a9b8-b7b237424692 admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:22.359474 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afe271-deb3-4f58-9a06-2b962dbedd01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:22.359598 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1e359-b60c-446f-a9b8-b7b237424692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:20:22.359815 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1e359-b60c-446f-a9b8-b7b237424692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:22.360830 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING py.warnings [None req-40d1e359-b60c-446f-a9b8-b7b237424692 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 20:20:22.360830 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: warnings.warn(msg) Mar 29 20:20:22.360830 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: Mar 29 20:20:22.361413 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afe271-deb3-4f58-9a06-2b962dbedd01 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:22.362014 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1e359-b60c-446f-a9b8-b7b237424692 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:22.386076 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 765/1547] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:20:22.389080 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 783/1548] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:22.393632 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1e359-b60c-446f-a9b8-b7b237424692 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:22.397195 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afe271-deb3-4f58-9a06-2b962dbedd01 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:22.406047 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1e359-b60c-446f-a9b8-b7b237424692 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:22.417485 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29d750-58d5-44d1-a9c3-83586c0de0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:22.418170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29d750-58d5-44d1-a9c3-83586c0de0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:22.418456 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29d750-58d5-44d1-a9c3-83586c0de0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:22.418989 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29d750-58d5-44d1-a9c3-83586c0de0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:22.419672 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29d750-58d5-44d1-a9c3-83586c0de0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:22.421503 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29d750-58d5-44d1-a9c3-83586c0de0a2 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:22.424028 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afe271-deb3-4f58-9a06-2b962dbedd01 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:22.441666 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 766/1549] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:22.446431 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29d750-58d5-44d1-a9c3-83586c0de0a2 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:22.449991 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9681ae-257c-4ce6-b899-613b6dc7e5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:22.450964 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9681ae-257c-4ce6-b899-613b6dc7e5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:22.451256 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9681ae-257c-4ce6-b899-613b6dc7e5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:22.451567 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9681ae-257c-4ce6-b899-613b6dc7e5c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:22.452434 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9681ae-257c-4ce6-b899-613b6dc7e5c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:22.453574 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING py.warnings [None req-5a9681ae-257c-4ce6-b899-613b6dc7e5c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 29 20:20:22.453574 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: warnings.warn(msg) Mar 29 20:20:22.453574 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: Mar 29 20:20:22.454816 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9681ae-257c-4ce6-b899-613b6dc7e5c2 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:22.463617 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29d750-58d5-44d1-a9c3-83586c0de0a2 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:22.473794 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deafb8d-648f-4eb6-8f4a-86d363f3b38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:22.474773 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deafb8d-648f-4eb6-8f4a-86d363f3b38c admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:22.475501 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deafb8d-648f-4eb6-8f4a-86d363f3b38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:22.475501 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deafb8d-648f-4eb6-8f4a-86d363f3b38c admin admin] PATH_INFO: `/v3/projects/0950e898966240728e8398e186c48baf/users/cf8218ac35b5436bab50a7259894212c/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:22.497242 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deafb8d-648f-4eb6-8f4a-86d363f3b38c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0950e898966240728e8398e186c48baf, user_id=cf8218ac35b5436bab50a7259894212c, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:22.501417 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deafb8d-648f-4eb6-8f4a-86d363f3b38c admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:22.611063 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 784/1550] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:20:22 2022] POST /identity/v3/projects => generated 393 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:22.612274 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377bb42-2d89-4976-a404-fad54cc01d51 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:22.613309 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377bb42-2d89-4976-a404-fad54cc01d51 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:22.613601 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377bb42-2d89-4976-a404-fad54cc01d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:22.621485 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 767/1551] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:22 2022] PUT /identity/v3/projects/0950e898966240728e8398e186c48baf/users/cf8218ac35b5436bab50a7259894212c/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:20:22.626466 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deafb8d-648f-4eb6-8f4a-86d363f3b38c admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:22.640200 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-c377bb42-2d89-4976-a404-fad54cc01d51 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:22.641380 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-c377bb42-2d89-4976-a404-fad54cc01d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:22.704673 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deafb8d-648f-4eb6-8f4a-86d363f3b38c admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:22.710080 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ba4df-a5fa-4688-bcde-2e4c41f0c2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:22.710874 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ba4df-a5fa-4688-bcde-2e4c41f0c2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:22.711168 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ba4df-a5fa-4688-bcde-2e4c41f0c2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:22.711452 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ba4df-a5fa-4688-bcde-2e4c41f0c2a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:22.712165 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ba4df-a5fa-4688-bcde-2e4c41f0c2a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:22.713179 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING py.warnings [None req-c46ba4df-a5fa-4688-bcde-2e4c41f0c2a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 29 20:20:22.713179 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: warnings.warn(msg) Mar 29 20:20:22.713179 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: Mar 29 20:20:22.714442 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ba4df-a5fa-4688-bcde-2e4c41f0c2a8 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:22.729358 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 785/1552] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:22.729358 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b85373-825f-4d70-be6a-1e9f35836dfb None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:22.729358 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b85373-825f-4d70-be6a-1e9f35836dfb None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:22.729358 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b85373-825f-4d70-be6a-1e9f35836dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:22.742388 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-25b85373-825f-4d70-be6a-1e9f35836dfb None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:22.743583 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-25b85373-825f-4d70-be6a-1e9f35836dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:22.751486 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 786/1553] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:22.752687 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b88b29-ae06-44b9-8caf-296ee43825cf None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:22.753007 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b88b29-ae06-44b9-8caf-296ee43825cf None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:22.753318 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b88b29-ae06-44b9-8caf-296ee43825cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:22.779071 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-b2b88b29-ae06-44b9-8caf-296ee43825cf None None] MFA Rules not processed for user `cf8218ac35b5436bab50a7259894212c`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:22.780261 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b2b88b29-ae06-44b9-8caf-296ee43825cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:22.842251 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 787/1554] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:22.846560 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 768/1555] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:20:22 2022] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:22.847227 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff64e2-e5c2-4f3a-98da-270c79118f3d None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:22.847227 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff64e2-e5c2-4f3a-98da-270c79118f3d None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:22.847227 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff64e2-e5c2-4f3a-98da-270c79118f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:22.847486 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd9dfc-d7b4-4fe7-9ffc-105abaca12e1 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:22.847486 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd9dfc-d7b4-4fe7-9ffc-105abaca12e1 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:22.847486 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd9dfc-d7b4-4fe7-9ffc-105abaca12e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:22.865600 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-80ff64e2-e5c2-4f3a-98da-270c79118f3d None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:22.866378 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-79bd9dfc-d7b4-4fe7-9ffc-105abaca12e1 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:22.866799 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-80ff64e2-e5c2-4f3a-98da-270c79118f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:22.868070 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-79bd9dfc-d7b4-4fe7-9ffc-105abaca12e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:22.874610 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 788/1556] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:22.875842 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09955978-e3d7-4c8f-88fb-a2ec81d83f6c None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:22.876151 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09955978-e3d7-4c8f-88fb-a2ec81d83f6c None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:22.884699 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09955978-e3d7-4c8f-88fb-a2ec81d83f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:22.884979 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 769/1557] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:22.884979 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc3726-4e52-49dd-9fae-13906e6d68c9 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:22.884979 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc3726-4e52-49dd-9fae-13906e6d68c9 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:22.884979 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc3726-4e52-49dd-9fae-13906e6d68c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:22.900099 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-b0cc3726-4e52-49dd-9fae-13906e6d68c9 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:22.901203 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-b0cc3726-4e52-49dd-9fae-13906e6d68c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:22.902074 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-09955978-e3d7-4c8f-88fb-a2ec81d83f6c None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:22.903222 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-09955978-e3d7-4c8f-88fb-a2ec81d83f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:22.909724 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 770/1558] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:22.911403 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c42bbf-a875-4bf4-ad3d-ff9f01fd27fa None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:22.911752 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c42bbf-a875-4bf4-ad3d-ff9f01fd27fa None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:22.912093 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c42bbf-a875-4bf4-ad3d-ff9f01fd27fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:22.914332 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 789/1559] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:22.915739 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2091d0f-fb72-4498-8bc8-5cde3230d3f7 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:22.916203 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2091d0f-fb72-4498-8bc8-5cde3230d3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:22.916635 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2091d0f-fb72-4498-8bc8-5cde3230d3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:22.932883 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-d1c42bbf-a875-4bf4-ad3d-ff9f01fd27fa None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:22.934233 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-d1c42bbf-a875-4bf4-ad3d-ff9f01fd27fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:22.936104 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-d2091d0f-fb72-4498-8bc8-5cde3230d3f7 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:22.937255 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-d2091d0f-fb72-4498-8bc8-5cde3230d3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:22.942741 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 771/1560] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:22.946670 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 790/1561] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:22.947168 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c42bbf-a875-4bf4-ad3d-ff9f01fd27fa None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:22.948010 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa78121-33d6-453d-90fb-85bf65900ecd None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:22.948296 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa78121-33d6-453d-90fb-85bf65900ecd None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:22.948574 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa78121-33d6-453d-90fb-85bf65900ecd None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:22.950297 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 791/1562] 10.222.0.43 () {54 vars in 960 bytes} [Tue Mar 29 20:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:20:22.951521 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed177c-3a57-4f77-a966-436402996a61 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:22.951876 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed177c-3a57-4f77-a966-436402996a61 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:22.952162 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed177c-3a57-4f77-a966-436402996a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:22.958846 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c42bbf-a875-4bf4-ad3d-ff9f01fd27fa None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:22.963383 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c22231-78f2-410d-a6c9-3da2a3e5b01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:22.964048 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c22231-78f2-410d-a6c9-3da2a3e5b01c admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:22.964331 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c22231-78f2-410d-a6c9-3da2a3e5b01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:22.964610 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c22231-78f2-410d-a6c9-3da2a3e5b01c admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:22.965380 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c22231-78f2-410d-a6c9-3da2a3e5b01c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:22.966970 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c22231-78f2-410d-a6c9-3da2a3e5b01c admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:22.970456 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-19ed177c-3a57-4f77-a966-436402996a61 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:22.972335 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-19ed177c-3a57-4f77-a966-436402996a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:22.977665 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 772/1563] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:22.978878 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f362e3e-4992-4cee-8c82-714c898d5339 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:22.979170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f362e3e-4992-4cee-8c82-714c898d5339 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:22.979443 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f362e3e-4992-4cee-8c82-714c898d5339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:22.983254 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 792/1564] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:22.984482 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ecfb1-698d-44a0-883b-2f2173891e4b None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:22.984773 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ecfb1-698d-44a0-883b-2f2173891e4b None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:22.985200 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ecfb1-698d-44a0-883b-2f2173891e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:22.998460 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-2f362e3e-4992-4cee-8c82-714c898d5339 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:22.999640 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-2f362e3e-4992-4cee-8c82-714c898d5339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:23.003979 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-978ecfb1-698d-44a0-883b-2f2173891e4b None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:23.005206 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-978ecfb1-698d-44a0-883b-2f2173891e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:23.007593 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 773/1565] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:23.008786 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64d9b1-ae31-4776-8410-1aa15526ea11 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:23.009073 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64d9b1-ae31-4776-8410-1aa15526ea11 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:23.009390 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64d9b1-ae31-4776-8410-1aa15526ea11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:23.016790 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 793/1566] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:23.017613 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ecfb1-698d-44a0-883b-2f2173891e4b None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:23.027564 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ecfb1-698d-44a0-883b-2f2173891e4b None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:23.027926 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-2d64d9b1-ae31-4776-8410-1aa15526ea11 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:23.029106 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-2d64d9b1-ae31-4776-8410-1aa15526ea11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:23.032638 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c417b-8375-46ce-85a6-330a1a6d49a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:23.033340 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c417b-8375-46ce-85a6-330a1a6d49a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:23.033631 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c417b-8375-46ce-85a6-330a1a6d49a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:23.033909 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c417b-8375-46ce-85a6-330a1a6d49a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:23.035245 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c417b-8375-46ce-85a6-330a1a6d49a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:20:23.035554 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c417b-8375-46ce-85a6-330a1a6d49a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:23.037143 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c417b-8375-46ce-85a6-330a1a6d49a2 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:23.037842 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 774/1567] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:23.041413 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64d9b1-ae31-4776-8410-1aa15526ea11 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:23.047667 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64d9b1-ae31-4776-8410-1aa15526ea11 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:23.056098 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 794/1568] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:20:23.056098 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29635ab-a7b9-43b6-92a8-a191939b1c91 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:23.056098 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29635ab-a7b9-43b6-92a8-a191939b1c91 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:23.056098 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29635ab-a7b9-43b6-92a8-a191939b1c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:23.056487 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1225af-6021-43cc-8160-a3b754cae7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:23.056487 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1225af-6021-43cc-8160-a3b754cae7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:23.056487 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1225af-6021-43cc-8160-a3b754cae7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:23.056487 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1225af-6021-43cc-8160-a3b754cae7d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:23.056789 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1225af-6021-43cc-8160-a3b754cae7d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:20:23.056789 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1225af-6021-43cc-8160-a3b754cae7d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:23.056789 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1225af-6021-43cc-8160-a3b754cae7d0 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:23.068880 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 775/1569] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:20:23.069684 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1225af-6021-43cc-8160-a3b754cae7d0 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:23.070768 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-c29635ab-a7b9-43b6-92a8-a191939b1c91 None None] MFA Rules not processed for user `b797e15939694c9abf1f2b8e9aee4d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:23.072205 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-c29635ab-a7b9-43b6-92a8-a191939b1c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:23.079304 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1225af-6021-43cc-8160-a3b754cae7d0 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:23.084752 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf5094-eef8-4b52-b41a-bc1966f96151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:23.085448 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf5094-eef8-4b52-b41a-bc1966f96151 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:23.085741 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf5094-eef8-4b52-b41a-bc1966f96151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:23.086046 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf5094-eef8-4b52-b41a-bc1966f96151 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:23.086767 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf5094-eef8-4b52-b41a-bc1966f96151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:23.088337 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf5094-eef8-4b52-b41a-bc1966f96151 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:23.098420 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 776/1570] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:23.099206 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf5094-eef8-4b52-b41a-bc1966f96151 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:23.108473 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf5094-eef8-4b52-b41a-bc1966f96151 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:23.113135 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4602c35-396d-4f83-96a0-e93818b39384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:23.113818 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4602c35-396d-4f83-96a0-e93818b39384 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:23.114106 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4602c35-396d-4f83-96a0-e93818b39384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:23.114389 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4602c35-396d-4f83-96a0-e93818b39384 admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:23.115121 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4602c35-396d-4f83-96a0-e93818b39384 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:20:23.115436 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4602c35-396d-4f83-96a0-e93818b39384 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:23.116984 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4602c35-396d-4f83-96a0-e93818b39384 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:23.128548 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 777/1571] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:20:23.129341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4602c35-396d-4f83-96a0-e93818b39384 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:23.139001 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4602c35-396d-4f83-96a0-e93818b39384 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:23.139149 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 795/1572] 10.222.0.43 () {58 vars in 1057 bytes} [Tue Mar 29 20:20:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:23.139973 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29635ab-a7b9-43b6-92a8-a191939b1c91 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:23.143698 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570426a-9201-40be-8742-e7ab89061788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:23.144343 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570426a-9201-40be-8742-e7ab89061788 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:23.144637 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570426a-9201-40be-8742-e7ab89061788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:23.144939 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570426a-9201-40be-8742-e7ab89061788 admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:23.145674 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570426a-9201-40be-8742-e7ab89061788 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:20:23.145994 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570426a-9201-40be-8742-e7ab89061788 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:23.147610 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570426a-9201-40be-8742-e7ab89061788 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:23.150238 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29635ab-a7b9-43b6-92a8-a191939b1c91 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:23.154656 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a4cc0-bfc7-402f-a687-4a3e31aa7b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:23.155302 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a4cc0-bfc7-402f-a687-4a3e31aa7b64 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:23.155588 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a4cc0-bfc7-402f-a687-4a3e31aa7b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:23.155868 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a4cc0-bfc7-402f-a687-4a3e31aa7b64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:23.156579 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a4cc0-bfc7-402f-a687-4a3e31aa7b64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:20:23.156889 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a4cc0-bfc7-402f-a687-4a3e31aa7b64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:23.160486 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a4cc0-bfc7-402f-a687-4a3e31aa7b64 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:23.162008 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 778/1573] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:20:23.162808 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570426a-9201-40be-8742-e7ab89061788 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:23.172476 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570426a-9201-40be-8742-e7ab89061788 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:23.177482 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 796/1574] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:20:23.177482 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a4cc0-bfc7-402f-a687-4a3e31aa7b64 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:23.180327 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c96d0c-8f12-4f5f-a4a1-1d45c1b38785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:23.180983 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c96d0c-8f12-4f5f-a4a1-1d45c1b38785 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:23.181269 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c96d0c-8f12-4f5f-a4a1-1d45c1b38785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:23.181574 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c96d0c-8f12-4f5f-a4a1-1d45c1b38785 admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:23.182299 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c96d0c-8f12-4f5f-a4a1-1d45c1b38785 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:20:23.182614 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c96d0c-8f12-4f5f-a4a1-1d45c1b38785 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:23.183900 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a4cc0-bfc7-402f-a687-4a3e31aa7b64 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:23.184196 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c96d0c-8f12-4f5f-a4a1-1d45c1b38785 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:23.188610 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c59bd-6eb5-49c6-86bc-ace387a352f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:23.189261 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c59bd-6eb5-49c6-86bc-ace387a352f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:23.189576 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c59bd-6eb5-49c6-86bc-ace387a352f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:23.189853 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c59bd-6eb5-49c6-86bc-ace387a352f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:23.190815 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c59bd-6eb5-49c6-86bc-ace387a352f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:23.194253 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c59bd-6eb5-49c6-86bc-ace387a352f8 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:23.203000 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 779/1575] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:20:23.203000 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c96d0c-8f12-4f5f-a4a1-1d45c1b38785 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:23.210353 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c96d0c-8f12-4f5f-a4a1-1d45c1b38785 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:23.214833 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683b319-e0b7-4ccf-b006-c755cbcc115c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:23.215471 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683b319-e0b7-4ccf-b006-c755cbcc115c admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:23.215756 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683b319-e0b7-4ccf-b006-c755cbcc115c admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:23.216037 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683b319-e0b7-4ccf-b006-c755cbcc115c admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:23.216721 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683b319-e0b7-4ccf-b006-c755cbcc115c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:23.218709 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683b319-e0b7-4ccf-b006-c755cbcc115c admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:23.302103 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 797/1576] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:20:23 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:23.303079 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c59bd-6eb5-49c6-86bc-ace387a352f8 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:23.322059 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 780/1577] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:20:23 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:23.322059 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683b319-e0b7-4ccf-b006-c755cbcc115c admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:23.365040 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c59bd-6eb5-49c6-86bc-ace387a352f8 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:23.381703 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683b319-e0b7-4ccf-b006-c755cbcc115c admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:23.386353 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6c3f7-da25-49bc-a6a2-f4ad10ae2bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:23.387005 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6c3f7-da25-49bc-a6a2-f4ad10ae2bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:23.387291 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6c3f7-da25-49bc-a6a2-f4ad10ae2bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:23.387634 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6c3f7-da25-49bc-a6a2-f4ad10ae2bb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:23.388331 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6c3f7-da25-49bc-a6a2-f4ad10ae2bb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:23.390341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6c3f7-da25-49bc-a6a2-f4ad10ae2bb0 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:23.419294 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5dd2e9-8afe-45e4-b70f-6f488e9ec3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:23.420108 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5dd2e9-8afe-45e4-b70f-6f488e9ec3cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:23.420399 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5dd2e9-8afe-45e4-b70f-6f488e9ec3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:23.420707 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5dd2e9-8afe-45e4-b70f-6f488e9ec3cd admin admin] PATH_INFO: `/v3/projects/378d35471c8d47cc9624b98530d05223/users/f752a7bea22542009cbf86e7b36c8e83/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:23.434666 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5dd2e9-8afe-45e4-b70f-6f488e9ec3cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=378d35471c8d47cc9624b98530d05223, user_id=f752a7bea22542009cbf86e7b36c8e83, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:23.435718 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING py.warnings [None req-6f5dd2e9-8afe-45e4-b70f-6f488e9ec3cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 29 20:20:23.435718 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: warnings.warn(msg) Mar 29 20:20:23.435718 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: Mar 29 20:20:23.437695 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5dd2e9-8afe-45e4-b70f-6f488e9ec3cd admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:23.449617 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 781/1578] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:20:23 2022] POST /identity/v3/projects => generated 363 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:23.451571 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6c3f7-da25-49bc-a6a2-f4ad10ae2bb0 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:23.494643 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 798/1579] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:23 2022] PUT /identity/v3/projects/378d35471c8d47cc9624b98530d05223/users/f752a7bea22542009cbf86e7b36c8e83/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:23.499202 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5dd2e9-8afe-45e4-b70f-6f488e9ec3cd admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:23.519797 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6c3f7-da25-49bc-a6a2-f4ad10ae2bb0 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:23.558328 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5dd2e9-8afe-45e4-b70f-6f488e9ec3cd admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:23.562906 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552b530-e48e-4d82-a692-0bc1acae568a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:23.563848 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552b530-e48e-4d82-a692-0bc1acae568a admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:23.564116 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552b530-e48e-4d82-a692-0bc1acae568a admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:23.564394 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552b530-e48e-4d82-a692-0bc1acae568a admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:23.565124 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552b530-e48e-4d82-a692-0bc1acae568a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:23.567313 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552b530-e48e-4d82-a692-0bc1acae568a admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:23.580335 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51f262-24ec-43fb-a9f0-d59c94213829 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:23.581640 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51f262-24ec-43fb-a9f0-d59c94213829 service nova] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:23.582121 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51f262-24ec-43fb-a9f0-d59c94213829 service nova] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:23.582620 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51f262-24ec-43fb-a9f0-d59c94213829 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:23.635487 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 799/1580] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:20:23 2022] POST /identity/v3/projects => generated 365 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:23.635487 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552b530-e48e-4d82-a692-0bc1acae568a admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:23.637331 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51f262-24ec-43fb-a9f0-d59c94213829 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:23.639022 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51f262-24ec-43fb-a9f0-d59c94213829 service nova] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:23.648549 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 782/1581] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:23.649352 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51f262-24ec-43fb-a9f0-d59c94213829 service nova] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:23.658763 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51f262-24ec-43fb-a9f0-d59c94213829 service nova] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:23.696201 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552b530-e48e-4d82-a692-0bc1acae568a admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:23.700825 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57472b-2c55-4143-aac9-10dc16c99fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:23.701541 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57472b-2c55-4143-aac9-10dc16c99fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:23.701821 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57472b-2c55-4143-aac9-10dc16c99fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:23.702107 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57472b-2c55-4143-aac9-10dc16c99fc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:23.702809 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57472b-2c55-4143-aac9-10dc16c99fc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:23.704674 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57472b-2c55-4143-aac9-10dc16c99fc2 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:23.722618 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30deb98f-992a-4294-a89b-0d77f6f5f8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:23.723366 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30deb98f-992a-4294-a89b-0d77f6f5f8eb admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:23.723731 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30deb98f-992a-4294-a89b-0d77f6f5f8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:23.724112 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30deb98f-992a-4294-a89b-0d77f6f5f8eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:23.724882 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30deb98f-992a-4294-a89b-0d77f6f5f8eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:23.726894 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30deb98f-992a-4294-a89b-0d77f6f5f8eb admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:23.785472 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 800/1582] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:20:23 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:23.785472 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57472b-2c55-4143-aac9-10dc16c99fc2 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:23.815990 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 783/1583] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:20:23 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:23.817181 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30deb98f-992a-4294-a89b-0d77f6f5f8eb admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:23.849022 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57472b-2c55-4143-aac9-10dc16c99fc2 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:23.881939 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30deb98f-992a-4294-a89b-0d77f6f5f8eb admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:23.887148 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a82f45-e940-45a1-884b-148d875257a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:23.887829 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a82f45-e940-45a1-884b-148d875257a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:23.888111 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a82f45-e940-45a1-884b-148d875257a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:23.888415 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a82f45-e940-45a1-884b-148d875257a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:23.889080 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a82f45-e940-45a1-884b-148d875257a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:23.891169 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a82f45-e940-45a1-884b-148d875257a1 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:23.914150 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30046b-6cab-41c6-b475-5d3085287641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:23.914822 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30046b-6cab-41c6-b475-5d3085287641 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:23.915104 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30046b-6cab-41c6-b475-5d3085287641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:23.915379 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30046b-6cab-41c6-b475-5d3085287641 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:23.916109 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30046b-6cab-41c6-b475-5d3085287641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:23.918083 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30046b-6cab-41c6-b475-5d3085287641 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:23.963701 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 784/1584] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:20:23 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:23.964517 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a82f45-e940-45a1-884b-148d875257a1 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:23.974014 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a82f45-e940-45a1-884b-148d875257a1 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:23.978644 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d48cf8-618c-47c8-bf72-82b459099634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:23.982236 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d48cf8-618c-47c8-bf72-82b459099634 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:23.982236 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d48cf8-618c-47c8-bf72-82b459099634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:23.982236 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d48cf8-618c-47c8-bf72-82b459099634 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:23.982236 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d48cf8-618c-47c8-bf72-82b459099634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:23.982571 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 801/1585] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:20:23 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:23.982657 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d48cf8-618c-47c8-bf72-82b459099634 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:23.982876 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea127398-27f8-415c-8b26-4c49b87633b1 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:23.983419 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea127398-27f8-415c-8b26-4c49b87633b1 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:23.984162 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea127398-27f8-415c-8b26-4c49b87633b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.004667 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-ea127398-27f8-415c-8b26-4c49b87633b1 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:24.005929 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-ea127398-27f8-415c-8b26-4c49b87633b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:24.013640 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 802/1586] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:24.017120 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea127398-27f8-415c-8b26-4c49b87633b1 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:24.024891 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea127398-27f8-415c-8b26-4c49b87633b1 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:24.030613 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328639e8-1d2f-4526-bb4a-39416a8cb0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:24.031280 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328639e8-1d2f-4526-bb4a-39416a8cb0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:24.031725 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328639e8-1d2f-4526-bb4a-39416a8cb0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:24.031995 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328639e8-1d2f-4526-bb4a-39416a8cb0e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.032678 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328639e8-1d2f-4526-bb4a-39416a8cb0e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:24.036318 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328639e8-1d2f-4526-bb4a-39416a8cb0e0 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:24.045795 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 785/1587] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:20:23 2022] POST /identity/v3/users => generated 282 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:24.045795 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d48cf8-618c-47c8-bf72-82b459099634 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:24.051782 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d48cf8-618c-47c8-bf72-82b459099634 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:24.056643 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6d620-8a04-4f69-a9cd-140f01763a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:24.057413 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6d620-8a04-4f69-a9cd-140f01763a89 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:24.057697 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6d620-8a04-4f69-a9cd-140f01763a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:24.057977 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6d620-8a04-4f69-a9cd-140f01763a89 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.058692 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6d620-8a04-4f69-a9cd-140f01763a89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:24.060644 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6d620-8a04-4f69-a9cd-140f01763a89 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:24.125915 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 803/1588] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:20:24 2022] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:24.125915 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328639e8-1d2f-4526-bb4a-39416a8cb0e0 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:24.134452 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328639e8-1d2f-4526-bb4a-39416a8cb0e0 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:24.139249 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9bf4a-a082-447c-9304-cab9bbddd517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:24.139910 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9bf4a-a082-447c-9304-cab9bbddd517 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:24.140214 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9bf4a-a082-447c-9304-cab9bbddd517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:24.140482 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9bf4a-a082-447c-9304-cab9bbddd517 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.141154 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9bf4a-a082-447c-9304-cab9bbddd517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:24.143086 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9bf4a-a082-447c-9304-cab9bbddd517 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:24.152718 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 786/1589] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:20:24 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:24.158767 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6d620-8a04-4f69-a9cd-140f01763a89 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:24.163078 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6d620-8a04-4f69-a9cd-140f01763a89 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:24.167798 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694f50a-079d-46ec-9856-97d360a1d9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:24.168434 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694f50a-079d-46ec-9856-97d360a1d9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:24.168716 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694f50a-079d-46ec-9856-97d360a1d9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:24.169019 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694f50a-079d-46ec-9856-97d360a1d9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.169759 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694f50a-079d-46ec-9856-97d360a1d9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:24.171381 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694f50a-079d-46ec-9856-97d360a1d9a1 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:24.181476 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 787/1590] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:24.182252 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694f50a-079d-46ec-9856-97d360a1d9a1 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:24.192002 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694f50a-079d-46ec-9856-97d360a1d9a1 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:24.196364 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bff0c6-a75c-4cdf-825b-2c37442608d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:24.196964 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bff0c6-a75c-4cdf-825b-2c37442608d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:24.197246 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bff0c6-a75c-4cdf-825b-2c37442608d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:24.200107 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bff0c6-a75c-4cdf-825b-2c37442608d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.200107 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bff0c6-a75c-4cdf-825b-2c37442608d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:24.200107 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bff0c6-a75c-4cdf-825b-2c37442608d2 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:24.209696 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 788/1591] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:24.210494 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bff0c6-a75c-4cdf-825b-2c37442608d2 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:24.220504 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 804/1592] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:20:24 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:24.222545 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9bf4a-a082-447c-9304-cab9bbddd517 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:24.232104 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9bf4a-a082-447c-9304-cab9bbddd517 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:24.236916 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6185e7-70b7-4d79-b36d-fb37e9096f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:24.238522 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6185e7-70b7-4d79-b36d-fb37e9096f26 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:24.238872 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6185e7-70b7-4d79-b36d-fb37e9096f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:24.239217 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6185e7-70b7-4d79-b36d-fb37e9096f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.240011 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6185e7-70b7-4d79-b36d-fb37e9096f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:24.241680 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6185e7-70b7-4d79-b36d-fb37e9096f26 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:24.252422 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 805/1593] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:24.253910 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6185e7-70b7-4d79-b36d-fb37e9096f26 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:24.263638 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6185e7-70b7-4d79-b36d-fb37e9096f26 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:24.267881 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bff0c6-a75c-4cdf-825b-2c37442608d2 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:24.268341 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c38e7-af1a-4cea-ae25-357f558f29d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:24.268994 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f273c0-4641-499b-af78-c7661b061801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:24.269142 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c38e7-af1a-4cea-ae25-357f558f29d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:24.269376 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c38e7-af1a-4cea-ae25-357f558f29d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:24.269657 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c38e7-af1a-4cea-ae25-357f558f29d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.269770 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f273c0-4641-499b-af78-c7661b061801 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:24.269938 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f273c0-4641-499b-af78-c7661b061801 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:24.270262 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f273c0-4641-499b-af78-c7661b061801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.270411 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c38e7-af1a-4cea-ae25-357f558f29d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:24.272038 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c38e7-af1a-4cea-ae25-357f558f29d9 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:24.279238 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f273c0-4641-499b-af78-c7661b061801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:24.280642 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f273c0-4641-499b-af78-c7661b061801 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:24.281851 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 806/1594] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:24.284953 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620dc3a-9e24-4181-822c-f9db06bf1c7d None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:24.284953 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620dc3a-9e24-4181-822c-f9db06bf1c7d None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:24.284953 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620dc3a-9e24-4181-822c-f9db06bf1c7d None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.285769 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 807/1595] 10.222.0.43 () {54 vars in 960 bytes} [Tue Mar 29 20:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:20:24.286546 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620dc3a-9e24-4181-822c-f9db06bf1c7d None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:24.295107 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 789/1596] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:24.296132 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f273c0-4641-499b-af78-c7661b061801 service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:24.299119 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620dc3a-9e24-4181-822c-f9db06bf1c7d None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:24.305138 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3c8cd-d01c-4eff-8ae8-e78cfd2a1e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:24.305827 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3c8cd-d01c-4eff-8ae8-e78cfd2a1e51 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:24.306161 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3c8cd-d01c-4eff-8ae8-e78cfd2a1e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:24.306441 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3c8cd-d01c-4eff-8ae8-e78cfd2a1e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.307158 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3c8cd-d01c-4eff-8ae8-e78cfd2a1e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:24.307279 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f273c0-4641-499b-af78-c7661b061801 service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:24.308794 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3c8cd-d01c-4eff-8ae8-e78cfd2a1e51 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:24.313138 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390360f-bde2-438f-a94f-3f3258d1dfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:24.313794 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390360f-bde2-438f-a94f-3f3258d1dfc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:24.314090 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390360f-bde2-438f-a94f-3f3258d1dfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:24.314951 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390360f-bde2-438f-a94f-3f3258d1dfc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.316893 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390360f-bde2-438f-a94f-3f3258d1dfc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:24.318697 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390360f-bde2-438f-a94f-3f3258d1dfc2 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:24.322746 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 808/1597] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:24.322746 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3c8cd-d01c-4eff-8ae8-e78cfd2a1e51 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:24.330490 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3c8cd-d01c-4eff-8ae8-e78cfd2a1e51 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:24.335672 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 790/1598] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:24.335672 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390360f-bde2-438f-a94f-3f3258d1dfc2 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:24.335903 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72af985-05db-4513-8c19-5a39f7749139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:24.336389 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72af985-05db-4513-8c19-5a39f7749139 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:24.336738 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72af985-05db-4513-8c19-5a39f7749139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:24.337001 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72af985-05db-4513-8c19-5a39f7749139 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.337758 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72af985-05db-4513-8c19-5a39f7749139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:24.339494 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72af985-05db-4513-8c19-5a39f7749139 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:24.343564 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390360f-bde2-438f-a94f-3f3258d1dfc2 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:24.348516 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208969d7-3244-4324-807e-07168e9454ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:24.349163 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208969d7-3244-4324-807e-07168e9454ac admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:24.349490 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208969d7-3244-4324-807e-07168e9454ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:24.349996 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208969d7-3244-4324-807e-07168e9454ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.350106 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 809/1599] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:24.350702 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208969d7-3244-4324-807e-07168e9454ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:24.350815 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72af985-05db-4513-8c19-5a39f7749139 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:24.352453 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208969d7-3244-4324-807e-07168e9454ac admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:24.361840 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72af985-05db-4513-8c19-5a39f7749139 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:24.368112 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 791/1600] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:24.368112 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208969d7-3244-4324-807e-07168e9454ac admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:24.368334 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3df08-6cc2-4ff3-b929-f245172e9ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:24.368334 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3df08-6cc2-4ff3-b929-f245172e9ddd admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:24.368334 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3df08-6cc2-4ff3-b929-f245172e9ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:24.368568 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3df08-6cc2-4ff3-b929-f245172e9ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.369121 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3df08-6cc2-4ff3-b929-f245172e9ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:24.370825 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3df08-6cc2-4ff3-b929-f245172e9ddd admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:24.376023 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208969d7-3244-4324-807e-07168e9454ac admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:24.381125 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f9946-6395-40e1-9482-d88ad055a05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:24.381831 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f9946-6395-40e1-9482-d88ad055a05d admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:24.382123 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f9946-6395-40e1-9482-d88ad055a05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:24.382411 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f9946-6395-40e1-9482-d88ad055a05d admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.382613 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 810/1601] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:24.383302 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f9946-6395-40e1-9482-d88ad055a05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:24.383884 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed98bc-180e-4a04-af4a-a4ba823745bf None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:24.384175 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed98bc-180e-4a04-af4a-a4ba823745bf None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:24.384458 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed98bc-180e-4a04-af4a-a4ba823745bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.385070 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f9946-6395-40e1-9482-d88ad055a05d admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:24.397945 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 792/1602] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:24.398878 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f9946-6395-40e1-9482-d88ad055a05d admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:24.405564 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-58ed98bc-180e-4a04-af4a-a4ba823745bf None None] MFA Rules not processed for user `b797e15939694c9abf1f2b8e9aee4d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:24.406805 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-58ed98bc-180e-4a04-af4a-a4ba823745bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:24.408676 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f9946-6395-40e1-9482-d88ad055a05d admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:24.413995 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb45cc9-6692-4b54-9de3-3a7f82be0860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:24.419928 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb45cc9-6692-4b54-9de3-3a7f82be0860 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:24.419928 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb45cc9-6692-4b54-9de3-3a7f82be0860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:24.419928 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb45cc9-6692-4b54-9de3-3a7f82be0860 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.419928 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb45cc9-6692-4b54-9de3-3a7f82be0860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:24.419928 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb45cc9-6692-4b54-9de3-3a7f82be0860 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:24.430867 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 793/1603] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:24.430867 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb45cc9-6692-4b54-9de3-3a7f82be0860 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:24.443136 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb45cc9-6692-4b54-9de3-3a7f82be0860 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:24.454556 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a9ded-11a4-4356-a003-de92aa831179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:24.454556 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a9ded-11a4-4356-a003-de92aa831179 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:24.454556 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a9ded-11a4-4356-a003-de92aa831179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:24.454556 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a9ded-11a4-4356-a003-de92aa831179 admin admin] PATH_INFO: `/v3/projects/c112d8befb5f4b8d93ddeae4b73c0e74/users/7d3ad8b023e7429e868f22bae14e1f26/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.466569 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a9ded-11a4-4356-a003-de92aa831179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c112d8befb5f4b8d93ddeae4b73c0e74, user_id=7d3ad8b023e7429e868f22bae14e1f26, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:24.469792 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a9ded-11a4-4356-a003-de92aa831179 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:24.483865 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 811/1604] 10.222.0.43 () {58 vars in 1057 bytes} [Tue Mar 29 20:20:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:24.484453 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed98bc-180e-4a04-af4a-a4ba823745bf None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:24.494838 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed98bc-180e-4a04-af4a-a4ba823745bf None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:24.499903 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97083116-9e78-4df2-a29c-d9752e1e6c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:24.500836 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97083116-9e78-4df2-a29c-d9752e1e6c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:24.501120 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97083116-9e78-4df2-a29c-d9752e1e6c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:24.501424 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97083116-9e78-4df2-a29c-d9752e1e6c48 admin admin] PATH_INFO: `/v3/projects/331c9c75e5db410a8aab2a0dedf24117/users/9aab530a2811437a99d54a61d9d53af9/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.516083 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97083116-9e78-4df2-a29c-d9752e1e6c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=331c9c75e5db410a8aab2a0dedf24117, user_id=9aab530a2811437a99d54a61d9d53af9, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:24.519440 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97083116-9e78-4df2-a29c-d9752e1e6c48 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:24.562932 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 794/1605] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:24 2022] PUT /identity/v3/projects/c112d8befb5f4b8d93ddeae4b73c0e74/users/7d3ad8b023e7429e868f22bae14e1f26/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:24.564031 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a9ded-11a4-4356-a003-de92aa831179 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:24.591928 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 812/1606] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:24 2022] PUT /identity/v3/projects/331c9c75e5db410a8aab2a0dedf24117/users/9aab530a2811437a99d54a61d9d53af9/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:24.599886 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97083116-9e78-4df2-a29c-d9752e1e6c48 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:24.632485 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a9ded-11a4-4356-a003-de92aa831179 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:24.678985 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97083116-9e78-4df2-a29c-d9752e1e6c48 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:24.690100 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40019ead-fced-4043-aac8-332f0eecea16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:24.693875 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40019ead-fced-4043-aac8-332f0eecea16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:24.693875 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40019ead-fced-4043-aac8-332f0eecea16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:24.693875 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40019ead-fced-4043-aac8-332f0eecea16 admin admin] PATH_INFO: `/v3/projects/262026840f1142bcb842c61c9498a766/users/db790558cb784e7cbc64bdb7a19e9857/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.708796 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40019ead-fced-4043-aac8-332f0eecea16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=262026840f1142bcb842c61c9498a766, user_id=db790558cb784e7cbc64bdb7a19e9857, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:24.711482 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40019ead-fced-4043-aac8-332f0eecea16 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:24.712682 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430f020-3228-4768-ab9c-158a49a39fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:24.713893 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430f020-3228-4768-ab9c-158a49a39fbc admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:24.714121 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430f020-3228-4768-ab9c-158a49a39fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:24.714214 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430f020-3228-4768-ab9c-158a49a39fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.714934 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430f020-3228-4768-ab9c-158a49a39fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:24.716642 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430f020-3228-4768-ab9c-158a49a39fbc admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:24.727733 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 795/1607] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:24.728543 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430f020-3228-4768-ab9c-158a49a39fbc admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:24.744025 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430f020-3228-4768-ab9c-158a49a39fbc admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:24.744025 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fb550-b4d4-48f0-8495-f796bc5b00c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:24.744758 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fb550-b4d4-48f0-8495-f796bc5b00c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:24.745050 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fb550-b4d4-48f0-8495-f796bc5b00c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:24.745365 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fb550-b4d4-48f0-8495-f796bc5b00c4 admin admin] PATH_INFO: `/v3/projects/9c76faf7526c403b941d459dc6e6676c/users/d10fdf31f7a84a0aadef5dedd7c2abb3/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.761199 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9fb550-b4d4-48f0-8495-f796bc5b00c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c76faf7526c403b941d459dc6e6676c, user_id=d10fdf31f7a84a0aadef5dedd7c2abb3, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:24.764104 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9fb550-b4d4-48f0-8495-f796bc5b00c4 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:24.815057 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 813/1608] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:24 2022] PUT /identity/v3/projects/262026840f1142bcb842c61c9498a766/users/db790558cb784e7cbc64bdb7a19e9857/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:24.825369 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40019ead-fced-4043-aac8-332f0eecea16 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:24.865911 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 796/1609] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:24 2022] PUT /identity/v3/projects/9c76faf7526c403b941d459dc6e6676c/users/d10fdf31f7a84a0aadef5dedd7c2abb3/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:24.867348 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53d201-1848-4ae9-a058-44cba488121f None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:24.867642 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53d201-1848-4ae9-a058-44cba488121f None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:24.867923 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53d201-1848-4ae9-a058-44cba488121f None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.869621 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 797/1610] 10.222.0.43 () {54 vars in 912 bytes} [Tue Mar 29 20:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:20:24.870836 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169486e5-2060-4970-93de-1e40fd5bb4a3 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:24.876108 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169486e5-2060-4970-93de-1e40fd5bb4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:24.876108 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169486e5-2060-4970-93de-1e40fd5bb4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.892791 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40019ead-fced-4043-aac8-332f0eecea16 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:24.901116 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-169486e5-2060-4970-93de-1e40fd5bb4a3 None None] MFA Rules not processed for user `7d3ad8b023e7429e868f22bae14e1f26`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:24.902397 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-169486e5-2060-4970-93de-1e40fd5bb4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:24.955025 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0923e1-45dc-4ca7-b50f-c56f5e730c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:24.956075 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0923e1-45dc-4ca7-b50f-c56f5e730c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:24.956476 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0923e1-45dc-4ca7-b50f-c56f5e730c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:24.956776 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0923e1-45dc-4ca7-b50f-c56f5e730c97 admin admin] PATH_INFO: `/v3/projects/249ba837300b4e59a05f6c432c2d47b7/users/b608c6b9c7ef48c2abe8ec8ebb61d75c/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.972856 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0923e1-45dc-4ca7-b50f-c56f5e730c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=249ba837300b4e59a05f6c432c2d47b7, user_id=b608c6b9c7ef48c2abe8ec8ebb61d75c, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:24.975534 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0923e1-45dc-4ca7-b50f-c56f5e730c97 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:24.981072 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 798/1611] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:24.981072 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8130e-9f93-456e-a2e3-aaf57ad11ce4 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:24.981072 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8130e-9f93-456e-a2e3-aaf57ad11ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:24.981072 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8130e-9f93-456e-a2e3-aaf57ad11ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:24.999752 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-31b8130e-9f93-456e-a2e3-aaf57ad11ce4 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:25.000953 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-31b8130e-9f93-456e-a2e3-aaf57ad11ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:25.017883 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 799/1612] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:25.020764 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8130e-9f93-456e-a2e3-aaf57ad11ce4 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:25.038442 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8130e-9f93-456e-a2e3-aaf57ad11ce4 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:25.042811 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 814/1613] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:24 2022] PUT /identity/v3/projects/249ba837300b4e59a05f6c432c2d47b7/users/b608c6b9c7ef48c2abe8ec8ebb61d75c/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:25.044427 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69be413-2459-4778-bf13-d61b90ee08bf None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:25.044722 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69be413-2459-4778-bf13-d61b90ee08bf None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:25.045007 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69be413-2459-4778-bf13-d61b90ee08bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:25.075213 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-e69be413-2459-4778-bf13-d61b90ee08bf None None] MFA Rules not processed for user `db790558cb784e7cbc64bdb7a19e9857`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:25.076517 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e69be413-2459-4778-bf13-d61b90ee08bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:25.098870 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5757c2-9789-4633-a686-7ec7ce6e1b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:25.099808 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5757c2-9789-4633-a686-7ec7ce6e1b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:25.100073 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5757c2-9789-4633-a686-7ec7ce6e1b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:25.100349 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5757c2-9789-4633-a686-7ec7ce6e1b92 admin admin] PATH_INFO: `/v3/projects/4dd80d1f5dd744e8bd5cea87c84f184b/users/1c4e8920f33a4ae1a68811d68dd5d58f/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:25.114703 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5757c2-9789-4633-a686-7ec7ce6e1b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd80d1f5dd744e8bd5cea87c84f184b, user_id=1c4e8920f33a4ae1a68811d68dd5d58f, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:25.117439 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5757c2-9789-4633-a686-7ec7ce6e1b92 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:25.142781 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 815/1614] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:25 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:25.144636 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fc8f7-5dff-4506-8ff1-6a7c8b97eb3c None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:25.144930 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fc8f7-5dff-4506-8ff1-6a7c8b97eb3c None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:25.145209 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fc8f7-5dff-4506-8ff1-6a7c8b97eb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:25.165793 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-de8fc8f7-5dff-4506-8ff1-6a7c8b97eb3c None None] MFA Rules not processed for user `b797e15939694c9abf1f2b8e9aee4d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:25.167074 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-de8fc8f7-5dff-4506-8ff1-6a7c8b97eb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:25.203898 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 800/1615] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:25 2022] PUT /identity/v3/projects/4dd80d1f5dd744e8bd5cea87c84f184b/users/1c4e8920f33a4ae1a68811d68dd5d58f/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:25.205575 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150746d-70be-495b-b990-f526aab81158 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:25.206509 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150746d-70be-495b-b990-f526aab81158 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:25.207122 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150746d-70be-495b-b990-f526aab81158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:25.235677 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-7150746d-70be-495b-b990-f526aab81158 None None] MFA Rules not processed for user `d10fdf31f7a84a0aadef5dedd7c2abb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:25.236990 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-7150746d-70be-495b-b990-f526aab81158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:25.243157 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 816/1616] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Mar 29 20:20:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:25.244290 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fc8f7-5dff-4506-8ff1-6a7c8b97eb3c None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:25.256150 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fc8f7-5dff-4506-8ff1-6a7c8b97eb3c None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:25.310485 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 801/1617] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:25.311334 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150746d-70be-495b-b990-f526aab81158 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:25.328504 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3b649-282f-488b-a4e2-3ac6b848cbfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:25.329163 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3b649-282f-488b-a4e2-3ac6b848cbfb service nova] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:25.329487 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3b649-282f-488b-a4e2-3ac6b848cbfb service nova] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:25.329770 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3b649-282f-488b-a4e2-3ac6b848cbfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:25.370907 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150746d-70be-495b-b990-f526aab81158 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:25.374789 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a9aed-bc4a-45a8-9060-60e55373d0b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:25.375437 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a9aed-bc4a-45a8-9060-60e55373d0b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:25.375721 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a9aed-bc4a-45a8-9060-60e55373d0b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:25.376028 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a9aed-bc4a-45a8-9060-60e55373d0b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:25.387712 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3b649-282f-488b-a4e2-3ac6b848cbfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:25.389418 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3b649-282f-488b-a4e2-3ac6b848cbfb service nova] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:25.399624 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 817/1618] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:25.400888 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57818e28-f267-4ac7-bc39-3fa6805ac2be None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:25.401233 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57818e28-f267-4ac7-bc39-3fa6805ac2be None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:25.401505 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57818e28-f267-4ac7-bc39-3fa6805ac2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:25.418823 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-57818e28-f267-4ac7-bc39-3fa6805ac2be None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:25.420134 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-57818e28-f267-4ac7-bc39-3fa6805ac2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:25.465400 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a9aed-bc4a-45a8-9060-60e55373d0b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:25.466822 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a9aed-bc4a-45a8-9060-60e55373d0b3 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:25.477281 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 802/1619] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:25.478130 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a9aed-bc4a-45a8-9060-60e55373d0b3 service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:25.487351 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 818/1620] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:25.492047 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a9aed-bc4a-45a8-9060-60e55373d0b3 service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:25.492285 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb1b81-4042-48af-aa62-8445e1dbce94 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:25.492285 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb1b81-4042-48af-aa62-8445e1dbce94 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:25.492285 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb1b81-4042-48af-aa62-8445e1dbce94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:25.497225 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b05116-2e2a-4f82-8a2b-c5aef294e990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:25.497907 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b05116-2e2a-4f82-8a2b-c5aef294e990 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:25.498784 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b05116-2e2a-4f82-8a2b-c5aef294e990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:25.499085 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b05116-2e2a-4f82-8a2b-c5aef294e990 admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:25.499800 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b05116-2e2a-4f82-8a2b-c5aef294e990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:25.501849 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b05116-2e2a-4f82-8a2b-c5aef294e990 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:25.509821 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-0dbb1b81-4042-48af-aa62-8445e1dbce94 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:25.514897 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-0dbb1b81-4042-48af-aa62-8445e1dbce94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:25.519720 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 819/1621] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:25.520538 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb1b81-4042-48af-aa62-8445e1dbce94 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:25.575370 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb1b81-4042-48af-aa62-8445e1dbce94 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:25.579040 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce2c99-67cf-41dd-81aa-c632d30f11f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:25.579686 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce2c99-67cf-41dd-81aa-c632d30f11f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:25.579962 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce2c99-67cf-41dd-81aa-c632d30f11f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:25.580238 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce2c99-67cf-41dd-81aa-c632d30f11f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:25.590922 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce2c99-67cf-41dd-81aa-c632d30f11f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:25.592343 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce2c99-67cf-41dd-81aa-c632d30f11f7 service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:25.604492 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 820/1622] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:25.605402 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce2c99-67cf-41dd-81aa-c632d30f11f7 service cinder] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:25.619536 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce2c99-67cf-41dd-81aa-c632d30f11f7 service cinder] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:25.626161 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634f86e-3e27-4dcb-8aa3-e7e5470bad9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:25.627666 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634f86e-3e27-4dcb-8aa3-e7e5470bad9f admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:25.628273 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634f86e-3e27-4dcb-8aa3-e7e5470bad9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:25.628985 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634f86e-3e27-4dcb-8aa3-e7e5470bad9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:25.629965 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634f86e-3e27-4dcb-8aa3-e7e5470bad9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:25.631866 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634f86e-3e27-4dcb-8aa3-e7e5470bad9f admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:25.637501 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 803/1623] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:20:25 2022] POST /identity/v3/projects => generated 363 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:25.637501 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d627d-7891-425c-baef-e9246873638f None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:25.637501 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d627d-7891-425c-baef-e9246873638f None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:25.637965 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d627d-7891-425c-baef-e9246873638f None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:25.640188 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 804/1624] 10.222.0.43 () {54 vars in 912 bytes} [Tue Mar 29 20:20:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:20:25.641584 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d627d-7891-425c-baef-e9246873638f None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:25.643443 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-818d627d-7891-425c-baef-e9246873638f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:25.742804 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d627d-7891-425c-baef-e9246873638f None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:25.744625 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 821/1625] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:20:25 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:25.745608 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634f86e-3e27-4dcb-8aa3-e7e5470bad9f admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:25.807989 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634f86e-3e27-4dcb-8aa3-e7e5470bad9f admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:25.812502 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17417bfd-bfb3-4d3d-afea-6aca3803a0f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:25.813742 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17417bfd-bfb3-4d3d-afea-6aca3803a0f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:25.814071 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17417bfd-bfb3-4d3d-afea-6aca3803a0f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:25.814321 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17417bfd-bfb3-4d3d-afea-6aca3803a0f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:25.834007 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead6c76-3414-4461-9402-cb710db5b656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:25.842119 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead6c76-3414-4461-9402-cb710db5b656 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:25.842625 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead6c76-3414-4461-9402-cb710db5b656 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:25.854898 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead6c76-3414-4461-9402-cb710db5b656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:25.891249 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17417bfd-bfb3-4d3d-afea-6aca3803a0f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:25.892877 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17417bfd-bfb3-4d3d-afea-6aca3803a0f2 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:25.909954 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 822/1626] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:25.909954 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17417bfd-bfb3-4d3d-afea-6aca3803a0f2 service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:25.919840 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17417bfd-bfb3-4d3d-afea-6aca3803a0f2 service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:25.927398 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3d045-2df1-44cb-9d12-cd49039200e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:25.934365 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3d045-2df1-44cb-9d12-cd49039200e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:25.934713 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3d045-2df1-44cb-9d12-cd49039200e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:25.935019 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3d045-2df1-44cb-9d12-cd49039200e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:25.935742 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3d045-2df1-44cb-9d12-cd49039200e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:25.938200 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3d045-2df1-44cb-9d12-cd49039200e5 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:25.976557 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead6c76-3414-4461-9402-cb710db5b656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:25.978253 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead6c76-3414-4461-9402-cb710db5b656 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:25.989836 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 805/1627] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:25.996972 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51374e5d-0db2-493d-bd96-90f332c991d0 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:25.997273 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51374e5d-0db2-493d-bd96-90f332c991d0 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:26.002315 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51374e5d-0db2-493d-bd96-90f332c991d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:26.023741 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-51374e5d-0db2-493d-bd96-90f332c991d0 None None] MFA Rules not processed for user `b797e15939694c9abf1f2b8e9aee4d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:26.025035 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-51374e5d-0db2-493d-bd96-90f332c991d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:26.072739 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 823/1628] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:20:25 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:26.076714 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3d045-2df1-44cb-9d12-cd49039200e5 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:26.087502 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3d045-2df1-44cb-9d12-cd49039200e5 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:26.093896 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcb64d-20f0-4e5e-bcc0-3a9e34cc8682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:26.094580 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcb64d-20f0-4e5e-bcc0-3a9e34cc8682 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:26.094835 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcb64d-20f0-4e5e-bcc0-3a9e34cc8682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:26.095119 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcb64d-20f0-4e5e-bcc0-3a9e34cc8682 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:26.095822 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcb64d-20f0-4e5e-bcc0-3a9e34cc8682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:26.099751 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcb64d-20f0-4e5e-bcc0-3a9e34cc8682 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:26.125071 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 806/1629] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Mar 29 20:20:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:26.125866 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51374e5d-0db2-493d-bd96-90f332c991d0 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:26.141018 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51374e5d-0db2-493d-bd96-90f332c991d0 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:26.146398 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e446472-b6a4-461a-b1e0-315d08d48b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:26.147307 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e446472-b6a4-461a-b1e0-315d08d48b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:26.147921 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e446472-b6a4-461a-b1e0-315d08d48b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:26.147921 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e446472-b6a4-461a-b1e0-315d08d48b1d admin admin] PATH_INFO: `/v3/users/cf8218ac35b5436bab50a7259894212c` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:26.149227 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e446472-b6a4-461a-b1e0-315d08d48b1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf8218ac35b5436bab50a7259894212c)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:26.151414 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e446472-b6a4-461a-b1e0-315d08d48b1d admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:26.216121 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 824/1630] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:20:26 2022] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:26.216909 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcb64d-20f0-4e5e-bcc0-3a9e34cc8682 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:26.232788 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcb64d-20f0-4e5e-bcc0-3a9e34cc8682 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:26.240186 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166af0c-6f9d-401f-b630-d5478ffb7348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:26.240881 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166af0c-6f9d-401f-b630-d5478ffb7348 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:26.241171 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166af0c-6f9d-401f-b630-d5478ffb7348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:26.241519 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166af0c-6f9d-401f-b630-d5478ffb7348 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:26.242596 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166af0c-6f9d-401f-b630-d5478ffb7348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:26.244254 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166af0c-6f9d-401f-b630-d5478ffb7348 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:26.256199 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 825/1631] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:26.258112 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166af0c-6f9d-401f-b630-d5478ffb7348 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:26.374818 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-9e446472-b6a4-461a-b1e0-315d08d48b1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf8218ac35b5436bab50a7259894212c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:26.382302 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166af0c-6f9d-401f-b630-d5478ffb7348 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:26.387062 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71d4fc-387e-4fbd-b80c-2793ea6395ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:26.388085 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71d4fc-387e-4fbd-b80c-2793ea6395ff service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:26.388486 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71d4fc-387e-4fbd-b80c-2793ea6395ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:26.388775 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71d4fc-387e-4fbd-b80c-2793ea6395ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:26.412142 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71d4fc-387e-4fbd-b80c-2793ea6395ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:26.414399 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71d4fc-387e-4fbd-b80c-2793ea6395ff service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:26.444453 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-9e446472-b6a4-461a-b1e0-315d08d48b1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf8218ac35b5436bab50a7259894212c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:26.445079 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-9e446472-b6a4-461a-b1e0-315d08d48b1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf8218ac35b5436bab50a7259894212c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:26.456516 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-9e446472-b6a4-461a-b1e0-315d08d48b1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf8218ac35b5436bab50a7259894212c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:26.468225 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 826/1632] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:26.479122 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71d4fc-387e-4fbd-b80c-2793ea6395ff service cinder] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:26.484897 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-9e446472-b6a4-461a-b1e0-315d08d48b1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf8218ac35b5436bab50a7259894212c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:26.495930 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 807/1633] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:20:26 2022] DELETE /identity/v3/users/cf8218ac35b5436bab50a7259894212c => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:26.496845 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e446472-b6a4-461a-b1e0-315d08d48b1d admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:26.501251 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9e446472-b6a4-461a-b1e0-315d08d48b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:26.524501 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71d4fc-387e-4fbd-b80c-2793ea6395ff service cinder] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:26.658567 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16a410-4bf2-46a6-8cf7-4df0e74de252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:26.662330 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16a410-4bf2-46a6-8cf7-4df0e74de252 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:26.662330 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16a410-4bf2-46a6-8cf7-4df0e74de252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:26.662330 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16a410-4bf2-46a6-8cf7-4df0e74de252 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:26.662330 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da16a410-4bf2-46a6-8cf7-4df0e74de252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:26.662863 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da16a410-4bf2-46a6-8cf7-4df0e74de252 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:26.680183 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e446472-b6a4-461a-b1e0-315d08d48b1d admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:26.684136 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 827/1634] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:26.685783 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77556b86-eeff-412c-8325-edfae65ceda3 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:26.686016 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77556b86-eeff-412c-8325-edfae65ceda3 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:26.686305 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77556b86-eeff-412c-8325-edfae65ceda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:26.693444 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84349686-8856-45ff-945e-8987b3b16a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:26.696342 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84349686-8856-45ff-945e-8987b3b16a01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:26.697222 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84349686-8856-45ff-945e-8987b3b16a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:26.697222 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84349686-8856-45ff-945e-8987b3b16a01 admin admin] PATH_INFO: `/v3/projects/e8abd2ddc26644b983446522399da027/users/a399194927fc4f9db106eebb33d12981/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:26.732845 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84349686-8856-45ff-945e-8987b3b16a01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8abd2ddc26644b983446522399da027, user_id=a399194927fc4f9db106eebb33d12981, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:26.734542 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-77556b86-eeff-412c-8325-edfae65ceda3 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:26.744123 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-77556b86-eeff-412c-8325-edfae65ceda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:26.755792 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84349686-8856-45ff-945e-8987b3b16a01 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:26.766010 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 828/1635] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:26.768390 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77556b86-eeff-412c-8325-edfae65ceda3 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:26.771740 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-77556b86-eeff-412c-8325-edfae65ceda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:26.804187 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77556b86-eeff-412c-8325-edfae65ceda3 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:26.818973 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca1891-7b69-4f8c-84d3-df5c8775aca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:26.819897 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca1891-7b69-4f8c-84d3-df5c8775aca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:26.820238 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca1891-7b69-4f8c-84d3-df5c8775aca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:26.820521 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca1891-7b69-4f8c-84d3-df5c8775aca5 admin admin] PATH_INFO: `/v3/projects/9567cc77935a4c0fa752ed81691bd9d5/users/a0c07ac0fd824288bbad75eb194c3843/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:26.845842 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca1891-7b69-4f8c-84d3-df5c8775aca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9567cc77935a4c0fa752ed81691bd9d5, user_id=a0c07ac0fd824288bbad75eb194c3843, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:26.849517 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca1891-7b69-4f8c-84d3-df5c8775aca5 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:26.851160 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 808/1636] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:26 2022] PUT /identity/v3/projects/e8abd2ddc26644b983446522399da027/users/a399194927fc4f9db106eebb33d12981/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:26.852236 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84349686-8856-45ff-945e-8987b3b16a01 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:26.861612 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-84349686-8856-45ff-945e-8987b3b16a01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:26.969102 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 829/1637] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:26 2022] PUT /identity/v3/projects/9567cc77935a4c0fa752ed81691bd9d5/users/a0c07ac0fd824288bbad75eb194c3843/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:26.973044 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca1891-7b69-4f8c-84d3-df5c8775aca5 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:26.978907 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84349686-8856-45ff-945e-8987b3b16a01 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:27.035543 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1f8ff-ea64-4efc-a850-c9c022ad1ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:27.036623 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1f8ff-ea64-4efc-a850-c9c022ad1ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:27.036982 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1f8ff-ea64-4efc-a850-c9c022ad1ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:27.037400 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1f8ff-ea64-4efc-a850-c9c022ad1ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:27.114416 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca1891-7b69-4f8c-84d3-df5c8775aca5 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:27.165174 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9f195-e6fa-4c12-9563-67bd98291125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:27.165174 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9f195-e6fa-4c12-9563-67bd98291125 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:27.165174 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9f195-e6fa-4c12-9563-67bd98291125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:27.165174 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9f195-e6fa-4c12-9563-67bd98291125 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:27.168336 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9f195-e6fa-4c12-9563-67bd98291125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:27.168336 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9f195-e6fa-4c12-9563-67bd98291125 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:27.185792 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 830/1638] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:27.185792 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9f195-e6fa-4c12-9563-67bd98291125 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:27.194363 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1f8ff-ea64-4efc-a850-c9c022ad1ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:27.195826 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1f8ff-ea64-4efc-a850-c9c022ad1ee2 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:27.200866 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9f195-e6fa-4c12-9563-67bd98291125 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:27.211552 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260477d-230f-4093-bbc0-124500fd261f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:27.212254 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260477d-230f-4093-bbc0-124500fd261f admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:27.213786 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260477d-230f-4093-bbc0-124500fd261f admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:27.214208 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260477d-230f-4093-bbc0-124500fd261f admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:27.215495 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 809/1639] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:27.216208 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1f8ff-ea64-4efc-a850-c9c022ad1ee2 service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:27.216931 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260477d-230f-4093-bbc0-124500fd261f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:27.218757 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260477d-230f-4093-bbc0-124500fd261f admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:27.229102 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1f8ff-ea64-4efc-a850-c9c022ad1ee2 service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:27.230724 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 831/1640] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:27.234822 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260477d-230f-4093-bbc0-124500fd261f admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:27.246710 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260477d-230f-4093-bbc0-124500fd261f admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:27.247013 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfb1c8-18d9-4f52-9fb8-342b30fa46d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:27.251460 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfb1c8-18d9-4f52-9fb8-342b30fa46d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:27.251460 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfb1c8-18d9-4f52-9fb8-342b30fa46d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:27.251460 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfb1c8-18d9-4f52-9fb8-342b30fa46d0 admin admin] PATH_INFO: `/v3/projects/e8abd2ddc26644b983446522399da027/users/a399194927fc4f9db106eebb33d12981/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:27.253990 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfb1c8-18d9-4f52-9fb8-342b30fa46d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8abd2ddc26644b983446522399da027, user_id=a399194927fc4f9db106eebb33d12981, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:27.259335 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfb1c8-18d9-4f52-9fb8-342b30fa46d0 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:27.259498 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca799d-d4f1-4ce6-853d-ec923092d7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:27.260366 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca799d-d4f1-4ce6-853d-ec923092d7bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:27.260659 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca799d-d4f1-4ce6-853d-ec923092d7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:27.260943 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca799d-d4f1-4ce6-853d-ec923092d7bc admin admin] PATH_INFO: `/v3/projects/9567cc77935a4c0fa752ed81691bd9d5/users/a0c07ac0fd824288bbad75eb194c3843/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:27.266471 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca799d-d4f1-4ce6-853d-ec923092d7bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9567cc77935a4c0fa752ed81691bd9d5, user_id=a0c07ac0fd824288bbad75eb194c3843, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:27.269328 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca799d-d4f1-4ce6-853d-ec923092d7bc admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:27.291886 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 810/1641] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:27 2022] PUT /identity/v3/projects/e8abd2ddc26644b983446522399da027/users/a399194927fc4f9db106eebb33d12981/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:27.312761 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b747a-745f-4a63-a05d-af61b71748dc None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:27.316376 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 832/1642] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:27 2022] PUT /identity/v3/projects/9567cc77935a4c0fa752ed81691bd9d5/users/a0c07ac0fd824288bbad75eb194c3843/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:27.318257 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8f4c6-f6e5-4e1e-b020-185a13daaf31 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:27.321543 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8f4c6-f6e5-4e1e-b020-185a13daaf31 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:27.321543 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8f4c6-f6e5-4e1e-b020-185a13daaf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:27.331233 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b747a-745f-4a63-a05d-af61b71748dc None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:27.334174 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b747a-745f-4a63-a05d-af61b71748dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:27.381582 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-803b747a-745f-4a63-a05d-af61b71748dc None None] MFA Rules not processed for user `a399194927fc4f9db106eebb33d12981`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:27.385120 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-803b747a-745f-4a63-a05d-af61b71748dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:27.391860 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-dec8f4c6-f6e5-4e1e-b020-185a13daaf31 None None] MFA Rules not processed for user `a0c07ac0fd824288bbad75eb194c3843`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:27.393749 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-dec8f4c6-f6e5-4e1e-b020-185a13daaf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:27.553388 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 833/1643] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:27 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:27.553873 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035642e5-a5d8-435e-a52b-2bca6d04b5c5 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:27.554169 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035642e5-a5d8-435e-a52b-2bca6d04b5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:27.555965 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035642e5-a5d8-435e-a52b-2bca6d04b5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:27.600866 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 811/1644] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:27 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:27.602655 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b747a-745f-4a63-a05d-af61b71748dc None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:27.606163 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-803b747a-745f-4a63-a05d-af61b71748dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:27.634375 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-035642e5-a5d8-435e-a52b-2bca6d04b5c5 None None] MFA Rules not processed for user `9aab530a2811437a99d54a61d9d53af9`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:27.635913 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-035642e5-a5d8-435e-a52b-2bca6d04b5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:27.732949 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b747a-745f-4a63-a05d-af61b71748dc None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:27.737872 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec65627-51d5-4115-83ec-520920377bfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:27.738560 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec65627-51d5-4115-83ec-520920377bfe service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:27.738812 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec65627-51d5-4115-83ec-520920377bfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:27.739114 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec65627-51d5-4115-83ec-520920377bfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:27.748870 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 834/1645] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:27.758750 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec65627-51d5-4115-83ec-520920377bfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:27.760304 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec65627-51d5-4115-83ec-520920377bfe service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:27.764092 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37db414-3f2f-4f95-a2ce-18fa06cae071 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:27.766123 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37db414-3f2f-4f95-a2ce-18fa06cae071 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:27.766438 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37db414-3f2f-4f95-a2ce-18fa06cae071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:27.773921 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 812/1646] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:27 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:27.797985 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-f37db414-3f2f-4f95-a2ce-18fa06cae071 None None] MFA Rules not processed for user `9aab530a2811437a99d54a61d9d53af9`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:27.799715 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-f37db414-3f2f-4f95-a2ce-18fa06cae071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:27.820285 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 835/1647] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:27.831959 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec65627-51d5-4115-83ec-520920377bfe service cinder] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:27.833938 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-4ec65627-51d5-4115-83ec-520920377bfe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:27.870176 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37db414-3f2f-4f95-a2ce-18fa06cae071 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:27.873592 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-f37db414-3f2f-4f95-a2ce-18fa06cae071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:27.903603 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37db414-3f2f-4f95-a2ce-18fa06cae071 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:27.911321 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c3731-0001-4ffb-a6a0-db5ea6422516 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:27.911996 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c3731-0001-4ffb-a6a0-db5ea6422516 service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:27.912339 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c3731-0001-4ffb-a6a0-db5ea6422516 service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:27.912622 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c3731-0001-4ffb-a6a0-db5ea6422516 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:27.925328 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c3731-0001-4ffb-a6a0-db5ea6422516 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:27.927484 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c3731-0001-4ffb-a6a0-db5ea6422516 service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:27.962652 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 836/1648] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:27 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:20:27.988461 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec65627-51d5-4115-83ec-520920377bfe service cinder] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:27.992253 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625f2d2-653e-4a6c-b0a5-68a93c1e4373 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:27.992982 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625f2d2-653e-4a6c-b0a5-68a93c1e4373 service nova] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:27.993275 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625f2d2-653e-4a6c-b0a5-68a93c1e4373 service nova] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:27.993619 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625f2d2-653e-4a6c-b0a5-68a93c1e4373 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:28.004494 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8625f2d2-653e-4a6c-b0a5-68a93c1e4373 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:28.006470 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8625f2d2-653e-4a6c-b0a5-68a93c1e4373 service nova] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:28.043731 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 813/1649] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:28.251685 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c3731-0001-4ffb-a6a0-db5ea6422516 service cinder] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:28.261533 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c3731-0001-4ffb-a6a0-db5ea6422516 service cinder] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:28.279734 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97540350-e135-47ff-9e57-852b883e7201 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:28.281680 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97540350-e135-47ff-9e57-852b883e7201 service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:28.281976 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97540350-e135-47ff-9e57-852b883e7201 service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:28.282325 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97540350-e135-47ff-9e57-852b883e7201 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:28.288530 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-97540350-e135-47ff-9e57-852b883e7201 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:28.398767 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625f2d2-653e-4a6c-b0a5-68a93c1e4373 service nova] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:28.415223 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625f2d2-653e-4a6c-b0a5-68a93c1e4373 service nova] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:28.428936 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6fa6a-205c-41fb-819f-cbab30da6cc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:28.431922 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6fa6a-205c-41fb-819f-cbab30da6cc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:28.432836 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6fa6a-205c-41fb-819f-cbab30da6cc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:28.433164 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6fa6a-205c-41fb-819f-cbab30da6cc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:28.436514 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-92f6fa6a-205c-41fb-819f-cbab30da6cc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:28.472214 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97540350-e135-47ff-9e57-852b883e7201 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:28.473894 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97540350-e135-47ff-9e57-852b883e7201 service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:28.514567 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 837/1650] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:28 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:28.590819 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6fa6a-205c-41fb-819f-cbab30da6cc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:28.592588 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6fa6a-205c-41fb-819f-cbab30da6cc1 service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:28.622316 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 814/1651] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:20:28.695785 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97540350-e135-47ff-9e57-852b883e7201 service cinder] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:28.695785 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-97540350-e135-47ff-9e57-852b883e7201 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:28.801229 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d5ef0-29c7-42a4-acf2-e705fe2178d5 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:28.801820 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d5ef0-29c7-42a4-acf2-e705fe2178d5 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:28.802408 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d5ef0-29c7-42a4-acf2-e705fe2178d5 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:28.805030 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 815/1652] 10.222.0.43 () {54 vars in 912 bytes} [Tue Mar 29 20:20:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:20:28.811714 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9a405-45b5-4a72-9bb9-9ad56724b01b None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:28.812335 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9a405-45b5-4a72-9bb9-9ad56724b01b None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:28.819103 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9a405-45b5-4a72-9bb9-9ad56724b01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:28.871032 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97540350-e135-47ff-9e57-852b883e7201 service cinder] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:28.879286 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18315da5-6555-44b3-a9c1-4f432ebf6c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:28.880376 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18315da5-6555-44b3-a9c1-4f432ebf6c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:28.880985 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18315da5-6555-44b3-a9c1-4f432ebf6c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:28.881622 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18315da5-6555-44b3-a9c1-4f432ebf6c93 admin admin] PATH_INFO: `/v3/projects/0950e898966240728e8398e186c48baf` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:28.883239 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18315da5-6555-44b3-a9c1-4f432ebf6c93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0950e898966240728e8398e186c48baf)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:28.885600 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18315da5-6555-44b3-a9c1-4f432ebf6c93 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:28.890823 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-95b9a405-45b5-4a72-9bb9-9ad56724b01b None None] MFA Rules not processed for user `22bdaa02b1b14be3837b337fbf6e0eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:28.892441 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-95b9a405-45b5-4a72-9bb9-9ad56724b01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:28.974886 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 816/1653] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Mar 29 20:20:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:29.027861 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9a405-45b5-4a72-9bb9-9ad56724b01b None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:29.038180 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9a405-45b5-4a72-9bb9-9ad56724b01b None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:29.042126 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f1380-f694-4f90-a318-85df6bff5dd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:29.042943 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f1380-f694-4f90-a318-85df6bff5dd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:29.043325 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f1380-f694-4f90-a318-85df6bff5dd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:29.043714 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f1380-f694-4f90-a318-85df6bff5dd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:29.052509 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f1380-f694-4f90-a318-85df6bff5dd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:29.062644 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f1380-f694-4f90-a318-85df6bff5dd3 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:29.093207 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 817/1654] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:20:29.155125 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-18315da5-6555-44b3-a9c1-4f432ebf6c93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0950e898966240728e8398e186c48baf', 'request_id': 'req-18315da5-6555-44b3-a9c1-4f432ebf6c93'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:29.188086 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-18315da5-6555-44b3-a9c1-4f432ebf6c93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0950e898966240728e8398e186c48baf', 'request_id': 'req-18315da5-6555-44b3-a9c1-4f432ebf6c93'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:29.209027 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-18315da5-6555-44b3-a9c1-4f432ebf6c93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0950e898966240728e8398e186c48baf', 'request_id': 'req-18315da5-6555-44b3-a9c1-4f432ebf6c93'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:29.286582 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-18315da5-6555-44b3-a9c1-4f432ebf6c93 admin admin] The token cache is being invalidate because project 0950e898966240728e8398e186c48baf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:20:29.287898 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-18315da5-6555-44b3-a9c1-4f432ebf6c93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:29.288918 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-18315da5-6555-44b3-a9c1-4f432ebf6c93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:29.292095 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 838/1655] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:20:28 2022] DELETE /identity/v3/projects/0950e898966240728e8398e186c48baf => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:20:29.301916 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d156b0-68b3-4087-8ba6-35eb2036975e None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:29.301916 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d156b0-68b3-4087-8ba6-35eb2036975e None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:29.301916 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d156b0-68b3-4087-8ba6-35eb2036975e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:29.345525 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-26d156b0-68b3-4087-8ba6-35eb2036975e None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:29.347344 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-26d156b0-68b3-4087-8ba6-35eb2036975e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:29.518202 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 818/1656] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:29.526510 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796830f-28e0-4b0d-8d9b-24d6f8310d44 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:29.526510 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796830f-28e0-4b0d-8d9b-24d6f8310d44 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:29.526747 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796830f-28e0-4b0d-8d9b-24d6f8310d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:29.553575 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-4796830f-28e0-4b0d-8d9b-24d6f8310d44 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:29.556958 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-4796830f-28e0-4b0d-8d9b-24d6f8310d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:29.570895 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 839/1657] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:29.572224 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d156b0-68b3-4087-8ba6-35eb2036975e None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:29.585200 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d156b0-68b3-4087-8ba6-35eb2036975e None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:29.598843 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b101304-a69f-440b-8ca8-ed9badffce9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:29.599439 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b101304-a69f-440b-8ca8-ed9badffce9e admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:29.600002 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b101304-a69f-440b-8ca8-ed9badffce9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:29.600193 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b101304-a69f-440b-8ca8-ed9badffce9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:29.601042 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b101304-a69f-440b-8ca8-ed9badffce9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:20:29.601720 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b101304-a69f-440b-8ca8-ed9badffce9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:29.603386 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b101304-a69f-440b-8ca8-ed9badffce9e admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:29.635912 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 819/1658] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:20:29.637221 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796830f-28e0-4b0d-8d9b-24d6f8310d44 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:29.654420 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796830f-28e0-4b0d-8d9b-24d6f8310d44 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:29.661799 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e897f88-2d81-42d2-bff6-5903f0f6f93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:29.662627 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e897f88-2d81-42d2-bff6-5903f0f6f93e admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:29.662920 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e897f88-2d81-42d2-bff6-5903f0f6f93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:29.663200 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e897f88-2d81-42d2-bff6-5903f0f6f93e admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:29.663901 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e897f88-2d81-42d2-bff6-5903f0f6f93e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:29.668205 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e897f88-2d81-42d2-bff6-5903f0f6f93e admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:29.795038 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 840/1659] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:20:29 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:29.799149 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b101304-a69f-440b-8ca8-ed9badffce9e admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:29.811446 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b101304-a69f-440b-8ca8-ed9badffce9e admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:29.907745 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c2d61-59d2-4383-8469-4e5ceb9613ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:29.909011 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c2d61-59d2-4383-8469-4e5ceb9613ac admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:29.913626 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c2d61-59d2-4383-8469-4e5ceb9613ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:29.917477 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c2d61-59d2-4383-8469-4e5ceb9613ac admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:29.918624 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c2d61-59d2-4383-8469-4e5ceb9613ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:29.921878 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c2d61-59d2-4383-8469-4e5ceb9613ac admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:30.038620 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 820/1660] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:20:29 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:30.042321 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e897f88-2d81-42d2-bff6-5903f0f6f93e admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:30.067324 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e897f88-2d81-42d2-bff6-5903f0f6f93e admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:30.081546 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a8cc7-6b78-40fa-ab04-254e1efc6ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:30.086308 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a8cc7-6b78-40fa-ab04-254e1efc6ebd admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:30.086308 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a8cc7-6b78-40fa-ab04-254e1efc6ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:30.086308 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a8cc7-6b78-40fa-ab04-254e1efc6ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:30.086308 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a8cc7-6b78-40fa-ab04-254e1efc6ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:30.086308 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a8cc7-6b78-40fa-ab04-254e1efc6ebd admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:30.102806 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 841/1661] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:30.106348 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c2d61-59d2-4383-8469-4e5ceb9613ac admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:30.119127 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c2d61-59d2-4383-8469-4e5ceb9613ac admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:30.127908 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624f463-115e-49fe-b392-5b2c5cacea9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:30.129012 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624f463-115e-49fe-b392-5b2c5cacea9a admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:30.129581 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624f463-115e-49fe-b392-5b2c5cacea9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:30.130069 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624f463-115e-49fe-b392-5b2c5cacea9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:30.131252 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624f463-115e-49fe-b392-5b2c5cacea9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:30.133679 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624f463-115e-49fe-b392-5b2c5cacea9a admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:30.149936 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc75a92-fdf1-4ce2-96f4-05156aaaeb19 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:30.150520 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc75a92-fdf1-4ce2-96f4-05156aaaeb19 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:30.150952 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc75a92-fdf1-4ce2-96f4-05156aaaeb19 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:30.153990 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 842/1662] 10.222.0.43 () {54 vars in 960 bytes} [Tue Mar 29 20:20:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:20:30.159943 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 821/1663] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:20:30.161527 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5b212-973a-4708-8201-42aaf4146b2e None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:30.161987 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5b212-973a-4708-8201-42aaf4146b2e None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:30.162416 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5b212-973a-4708-8201-42aaf4146b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:30.164001 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624f463-115e-49fe-b392-5b2c5cacea9a admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:30.186483 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-14a5b212-973a-4708-8201-42aaf4146b2e None None] MFA Rules not processed for user `5ef0001e91524a13a9ca601a601de66b`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:30.186811 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624f463-115e-49fe-b392-5b2c5cacea9a admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:30.188136 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-14a5b212-973a-4708-8201-42aaf4146b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:30.206835 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cc47f-b2b5-4d65-94f3-1a4975325263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:30.207905 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cc47f-b2b5-4d65-94f3-1a4975325263 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:30.208614 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cc47f-b2b5-4d65-94f3-1a4975325263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:30.208999 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cc47f-b2b5-4d65-94f3-1a4975325263 admin admin] PATH_INFO: `/v3/projects/e3185395d1d349228a63a162258aacb1/users/6591bc37385f4433bcff32db539529df/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:30.235334 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6cc47f-b2b5-4d65-94f3-1a4975325263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3185395d1d349228a63a162258aacb1, user_id=6591bc37385f4433bcff32db539529df, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:30.239353 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6cc47f-b2b5-4d65-94f3-1a4975325263 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:30.275081 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 843/1664] 10.222.0.43 () {58 vars in 1057 bytes} [Tue Mar 29 20:20:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:20:30.282965 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5b212-973a-4708-8201-42aaf4146b2e None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:30.306713 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5b212-973a-4708-8201-42aaf4146b2e None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:30.338754 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 822/1665] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:30 2022] PUT /identity/v3/projects/e3185395d1d349228a63a162258aacb1/users/6591bc37385f4433bcff32db539529df/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:30.350691 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1497826-c1c7-4122-ba01-f4d8da909fa6 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:30.351031 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1497826-c1c7-4122-ba01-f4d8da909fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:30.357849 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1497826-c1c7-4122-ba01-f4d8da909fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:30.361270 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd40e0e-1a87-4503-b269-0d8656ced9f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef0001e91524a13a9ca601a601de66b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:30.364729 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd40e0e-1a87-4503-b269-0d8656ced9f7 service placement] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:30.366150 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd40e0e-1a87-4503-b269-0d8656ced9f7 service placement] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:30.369429 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd40e0e-1a87-4503-b269-0d8656ced9f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:30.374552 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-fcd40e0e-1a87-4503-b269-0d8656ced9f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:30.407755 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd40e0e-1a87-4503-b269-0d8656ced9f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:30.410441 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd40e0e-1a87-4503-b269-0d8656ced9f7 service placement] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:30.431066 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 844/1666] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:30.440406 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-d1497826-c1c7-4122-ba01-f4d8da909fa6 None None] MFA Rules not processed for user `6591bc37385f4433bcff32db539529df`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:30.444664 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-d1497826-c1c7-4122-ba01-f4d8da909fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:30.539698 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 823/1667] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:30.543980 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd40e0e-1a87-4503-b269-0d8656ced9f7 service placement] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:30.578199 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd40e0e-1a87-4503-b269-0d8656ced9f7 service placement] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:30.708964 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfba5b7-dbe7-4fdf-8ff8-7f8c4e7eb1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:30.709948 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfba5b7-dbe7-4fdf-8ff8-7f8c4e7eb1da admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:30.710449 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfba5b7-dbe7-4fdf-8ff8-7f8c4e7eb1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:30.710909 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfba5b7-dbe7-4fdf-8ff8-7f8c4e7eb1da admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:30.711782 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfba5b7-dbe7-4fdf-8ff8-7f8c4e7eb1da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:30.719879 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfba5b7-dbe7-4fdf-8ff8-7f8c4e7eb1da admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:30.872177 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 845/1668] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:20:30 2022] POST /identity/v3/projects => generated 373 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:20:30.873218 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1497826-c1c7-4122-ba01-f4d8da909fa6 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:30.888062 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1497826-c1c7-4122-ba01-f4d8da909fa6 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:31.062191 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12dee7-4791-428c-a797-c1c034229fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:31.064003 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12dee7-4791-428c-a797-c1c034229fca admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:31.068179 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12dee7-4791-428c-a797-c1c034229fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:31.068514 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12dee7-4791-428c-a797-c1c034229fca admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:31.071540 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12dee7-4791-428c-a797-c1c034229fca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:31.080337 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12dee7-4791-428c-a797-c1c034229fca admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:31.385264 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfba5b7-dbe7-4fdf-8ff8-7f8c4e7eb1da admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:31.385264 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-9cfba5b7-dbe7-4fdf-8ff8-7f8c4e7eb1da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:31.392596 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 824/1669] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:20:30 2022] POST /identity/v3/users => generated 293 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:20:31.392596 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12dee7-4791-428c-a797-c1c034229fca admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:31.392596 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12dee7-4791-428c-a797-c1c034229fca admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:31.392596 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816b27b-5d87-4f7f-8345-674f34006126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:31.395935 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816b27b-5d87-4f7f-8345-674f34006126 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:31.395935 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816b27b-5d87-4f7f-8345-674f34006126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:31.395935 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816b27b-5d87-4f7f-8345-674f34006126 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:31.396890 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfba5b7-dbe7-4fdf-8ff8-7f8c4e7eb1da admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:31.398072 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816b27b-5d87-4f7f-8345-674f34006126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:31.398072 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816b27b-5d87-4f7f-8345-674f34006126 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:31.400980 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269672c-bd4a-4214-9d1c-eef6d52cd01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:31.400980 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269672c-bd4a-4214-9d1c-eef6d52cd01a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:31.400980 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269672c-bd4a-4214-9d1c-eef6d52cd01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:31.401939 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 825/1670] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:20:31.401939 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816b27b-5d87-4f7f-8345-674f34006126 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:31.402409 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269672c-bd4a-4214-9d1c-eef6d52cd01a admin admin] PATH_INFO: `/v3/users/7d3ad8b023e7429e868f22bae14e1f26` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:31.402409 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269672c-bd4a-4214-9d1c-eef6d52cd01a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d3ad8b023e7429e868f22bae14e1f26)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:31.402409 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: WARNING py.warnings [None req-5269672c-bd4a-4214-9d1c-eef6d52cd01a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 29 20:20:31.402409 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: warnings.warn(msg) Mar 29 20:20:31.402409 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: Mar 29 20:20:31.402409 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269672c-bd4a-4214-9d1c-eef6d52cd01a admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:31.404710 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816b27b-5d87-4f7f-8345-674f34006126 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:31.404710 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39116d3c-8b19-41f8-afc1-958e030adde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:31.404710 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39116d3c-8b19-41f8-afc1-958e030adde4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:31.404710 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39116d3c-8b19-41f8-afc1-958e030adde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:31.405267 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39116d3c-8b19-41f8-afc1-958e030adde4 admin admin] PATH_INFO: `/v3/projects/81fb0284515a46b4a9a6d73e2ec55424/users/f5661e69302e4276a4be161a46695a4d/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:31.405267 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39116d3c-8b19-41f8-afc1-958e030adde4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81fb0284515a46b4a9a6d73e2ec55424, user_id=f5661e69302e4276a4be161a46695a4d, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:31.405267 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39116d3c-8b19-41f8-afc1-958e030adde4 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:31.524562 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 826/1671] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:31 2022] PUT /identity/v3/projects/81fb0284515a46b4a9a6d73e2ec55424/users/f5661e69302e4276a4be161a46695a4d/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:20:31.528381 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39116d3c-8b19-41f8-afc1-958e030adde4 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:31.668411 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-5269672c-bd4a-4214-9d1c-eef6d52cd01a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d3ad8b023e7429e868f22bae14e1f26'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:31.734175 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-5269672c-bd4a-4214-9d1c-eef6d52cd01a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d3ad8b023e7429e868f22bae14e1f26'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:31.734814 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-5269672c-bd4a-4214-9d1c-eef6d52cd01a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d3ad8b023e7429e868f22bae14e1f26'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:31.735445 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-5269672c-bd4a-4214-9d1c-eef6d52cd01a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d3ad8b023e7429e868f22bae14e1f26'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:31.765502 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39116d3c-8b19-41f8-afc1-958e030adde4 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:31.777053 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd7bb7-f741-48c9-9142-6f3e2c8d7ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:31.777779 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd7bb7-f741-48c9-9142-6f3e2c8d7ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:31.778075 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd7bb7-f741-48c9-9142-6f3e2c8d7ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:31.778355 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd7bb7-f741-48c9-9142-6f3e2c8d7ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:31.783171 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd7bb7-f741-48c9-9142-6f3e2c8d7ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:31.785003 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd7bb7-f741-48c9-9142-6f3e2c8d7ec1 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:31.787392 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-5269672c-bd4a-4214-9d1c-eef6d52cd01a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d3ad8b023e7429e868f22bae14e1f26'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:31.813066 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 827/1672] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:31.816433 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd7bb7-f741-48c9-9142-6f3e2c8d7ec1 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:31.818611 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-afbd7bb7-f741-48c9-9142-6f3e2c8d7ec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:31.834251 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd7bb7-f741-48c9-9142-6f3e2c8d7ec1 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:31.840216 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a9dc3-7831-4a87-ac35-380a338ab8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:31.841479 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a9dc3-7831-4a87-ac35-380a338ab8c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:31.841821 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a9dc3-7831-4a87-ac35-380a338ab8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:31.842113 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a9dc3-7831-4a87-ac35-380a338ab8c4 admin admin] PATH_INFO: `/v3/projects/81fb0284515a46b4a9a6d73e2ec55424/users/f5661e69302e4276a4be161a46695a4d/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:31.844249 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a9dc3-7831-4a87-ac35-380a338ab8c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81fb0284515a46b4a9a6d73e2ec55424, user_id=f5661e69302e4276a4be161a46695a4d, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:31.849365 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a9dc3-7831-4a87-ac35-380a338ab8c4 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:31.886486 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 828/1673] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:31 2022] PUT /identity/v3/projects/81fb0284515a46b4a9a6d73e2ec55424/users/f5661e69302e4276a4be161a46695a4d/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:31.892600 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 846/1674] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:20:31 2022] DELETE /identity/v3/users/7d3ad8b023e7429e868f22bae14e1f26 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:20:31.896643 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a6c80-3c21-414f-b280-52fa776b89cd None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:31.897953 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a6c80-3c21-414f-b280-52fa776b89cd None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:31.898240 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a6c80-3c21-414f-b280-52fa776b89cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:31.898497 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a2d26-bfda-41c3-8b50-3ac1e366b734 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:31.898849 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a2d26-bfda-41c3-8b50-3ac1e366b734 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:31.901666 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a2d26-bfda-41c3-8b50-3ac1e366b734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:31.961284 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-074a2d26-bfda-41c3-8b50-3ac1e366b734 None None] MFA Rules not processed for user `f5661e69302e4276a4be161a46695a4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:31.970963 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-074a2d26-bfda-41c3-8b50-3ac1e366b734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:31.986492 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-0e6a6c80-3c21-414f-b280-52fa776b89cd None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:31.990216 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-0e6a6c80-3c21-414f-b280-52fa776b89cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:32.202422 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 829/1675] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:32.210692 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a2d26-bfda-41c3-8b50-3ac1e366b734 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:32.212755 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-074a2d26-bfda-41c3-8b50-3ac1e366b734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:32.240856 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 847/1676] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:32.275169 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a6c80-3c21-414f-b280-52fa776b89cd None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:32.277580 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-0e6a6c80-3c21-414f-b280-52fa776b89cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:32.312618 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a2d26-bfda-41c3-8b50-3ac1e366b734 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:32.317221 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355a136-47c8-4ee1-b74d-84991c45d05c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:32.317938 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355a136-47c8-4ee1-b74d-84991c45d05c service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:32.318282 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355a136-47c8-4ee1-b74d-84991c45d05c service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:32.318569 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355a136-47c8-4ee1-b74d-84991c45d05c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:32.329318 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355a136-47c8-4ee1-b74d-84991c45d05c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:32.330915 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355a136-47c8-4ee1-b74d-84991c45d05c service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:32.341993 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 830/1677] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:32.419766 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a6c80-3c21-414f-b280-52fa776b89cd None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:32.425706 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e9161-5d0c-43dc-b07e-a9bbb6179d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:32.427602 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e9161-5d0c-43dc-b07e-a9bbb6179d1e service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:32.427602 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e9161-5d0c-43dc-b07e-a9bbb6179d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:32.427602 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e9161-5d0c-43dc-b07e-a9bbb6179d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:32.446470 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e9161-5d0c-43dc-b07e-a9bbb6179d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:32.448622 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e9161-5d0c-43dc-b07e-a9bbb6179d1e service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:32.463369 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 848/1678] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:33.671768 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355a136-47c8-4ee1-b74d-84991c45d05c service cinder] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:33.673345 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9355a136-47c8-4ee1-b74d-84991c45d05c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:33.692899 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355a136-47c8-4ee1-b74d-84991c45d05c service cinder] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:33.698046 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8c38b-56c1-46f2-b73d-123438207ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:33.698905 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8c38b-56c1-46f2-b73d-123438207ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:33.699964 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8c38b-56c1-46f2-b73d-123438207ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:33.700239 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8c38b-56c1-46f2-b73d-123438207ffa admin admin] PATH_INFO: `/v3/users/d10fdf31f7a84a0aadef5dedd7c2abb3` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:33.701533 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8c38b-56c1-46f2-b73d-123438207ffa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d10fdf31f7a84a0aadef5dedd7c2abb3)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:33.706429 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8c38b-56c1-46f2-b73d-123438207ffa admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:33.964937 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e9161-5d0c-43dc-b07e-a9bbb6179d1e service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:33.971658 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e9161-5d0c-43dc-b07e-a9bbb6179d1e service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:33.981638 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74a6fe-220b-4509-a0ab-a29f3c54bf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:33.982538 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74a6fe-220b-4509-a0ab-a29f3c54bf96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:33.982829 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74a6fe-220b-4509-a0ab-a29f3c54bf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:33.999046 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74a6fe-220b-4509-a0ab-a29f3c54bf96 admin admin] PATH_INFO: `/v3/users/6591bc37385f4433bcff32db539529df` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:34.001913 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74a6fe-220b-4509-a0ab-a29f3c54bf96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6591bc37385f4433bcff32db539529df)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:34.004068 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74a6fe-220b-4509-a0ab-a29f3c54bf96 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:34.014472 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-97d8c38b-56c1-46f2-b73d-123438207ffa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd10fdf31f7a84a0aadef5dedd7c2abb3'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:34.112035 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-97d8c38b-56c1-46f2-b73d-123438207ffa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd10fdf31f7a84a0aadef5dedd7c2abb3'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:34.112811 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-97d8c38b-56c1-46f2-b73d-123438207ffa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd10fdf31f7a84a0aadef5dedd7c2abb3'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:34.123704 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-97d8c38b-56c1-46f2-b73d-123438207ffa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd10fdf31f7a84a0aadef5dedd7c2abb3'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:34.156265 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-97d8c38b-56c1-46f2-b73d-123438207ffa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd10fdf31f7a84a0aadef5dedd7c2abb3'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:34.168559 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 831/1679] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:20:33 2022] DELETE /identity/v3/users/d10fdf31f7a84a0aadef5dedd7c2abb3 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:34.172131 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8c38b-56c1-46f2-b73d-123438207ffa admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:34.172131 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-97d8c38b-56c1-46f2-b73d-123438207ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:34.280441 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fd74a6fe-220b-4509-a0ab-a29f3c54bf96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6591bc37385f4433bcff32db539529df'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:34.325993 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8c38b-56c1-46f2-b73d-123438207ffa admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:34.332080 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ed672-3e1a-4b55-9aa8-57e4b5a283a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:34.333558 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ed672-3e1a-4b55-9aa8-57e4b5a283a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:34.333558 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ed672-3e1a-4b55-9aa8-57e4b5a283a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:34.339341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ed672-3e1a-4b55-9aa8-57e4b5a283a0 admin admin] PATH_INFO: `/v3/projects/c112d8befb5f4b8d93ddeae4b73c0e74` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:34.339341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ed672-3e1a-4b55-9aa8-57e4b5a283a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c112d8befb5f4b8d93ddeae4b73c0e74)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:34.339341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: WARNING py.warnings [None req-262ed672-3e1a-4b55-9aa8-57e4b5a283a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 29 20:20:34.339341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: warnings.warn(msg) Mar 29 20:20:34.339341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: Mar 29 20:20:34.339341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ed672-3e1a-4b55-9aa8-57e4b5a283a0 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:34.409850 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fd74a6fe-220b-4509-a0ab-a29f3c54bf96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6591bc37385f4433bcff32db539529df'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:34.423946 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fd74a6fe-220b-4509-a0ab-a29f3c54bf96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6591bc37385f4433bcff32db539529df'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:34.423946 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fd74a6fe-220b-4509-a0ab-a29f3c54bf96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6591bc37385f4433bcff32db539529df'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:34.433124 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fd74a6fe-220b-4509-a0ab-a29f3c54bf96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6591bc37385f4433bcff32db539529df'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:34.510797 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 849/1680] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:20:33 2022] DELETE /identity/v3/users/6591bc37385f4433bcff32db539529df => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:20:34.514345 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554d025-24aa-4bb8-b684-857453e56a96 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:34.516652 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554d025-24aa-4bb8-b684-857453e56a96 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:34.517109 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554d025-24aa-4bb8-b684-857453e56a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:34.543752 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-262ed672-3e1a-4b55-9aa8-57e4b5a283a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c112d8befb5f4b8d93ddeae4b73c0e74', 'request_id': 'req-262ed672-3e1a-4b55-9aa8-57e4b5a283a0'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:34.600410 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-1554d025-24aa-4bb8-b684-857453e56a96 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:34.606560 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-1554d025-24aa-4bb8-b684-857453e56a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:34.627056 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-262ed672-3e1a-4b55-9aa8-57e4b5a283a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c112d8befb5f4b8d93ddeae4b73c0e74', 'request_id': 'req-262ed672-3e1a-4b55-9aa8-57e4b5a283a0'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:34.641862 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-262ed672-3e1a-4b55-9aa8-57e4b5a283a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c112d8befb5f4b8d93ddeae4b73c0e74', 'request_id': 'req-262ed672-3e1a-4b55-9aa8-57e4b5a283a0'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:34.710100 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-262ed672-3e1a-4b55-9aa8-57e4b5a283a0 admin admin] The token cache is being invalidate because project c112d8befb5f4b8d93ddeae4b73c0e74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:20:34.710771 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-262ed672-3e1a-4b55-9aa8-57e4b5a283a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:34.711142 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-262ed672-3e1a-4b55-9aa8-57e4b5a283a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:34.713948 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 832/1681] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:20:34 2022] DELETE /identity/v3/projects/c112d8befb5f4b8d93ddeae4b73c0e74 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:34.715915 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb9c29-7b9a-4b5d-be0a-1574af3455bf None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:34.716344 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb9c29-7b9a-4b5d-be0a-1574af3455bf None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:34.719787 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb9c29-7b9a-4b5d-be0a-1574af3455bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:34.745507 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-d9eb9c29-7b9a-4b5d-be0a-1574af3455bf None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:34.748514 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-d9eb9c29-7b9a-4b5d-be0a-1574af3455bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:34.848893 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 850/1682] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:34.850431 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04979d46-045c-4857-bd79-0efd27f63c19 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:34.850722 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04979d46-045c-4857-bd79-0efd27f63c19 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:34.851002 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04979d46-045c-4857-bd79-0efd27f63c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:34.898637 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-04979d46-045c-4857-bd79-0efd27f63c19 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:34.903064 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-04979d46-045c-4857-bd79-0efd27f63c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:34.934171 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 851/1683] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:34.946763 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639fa7b-3f9b-47c5-b9f9-bfa68deeff81 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:34.946763 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639fa7b-3f9b-47c5-b9f9-bfa68deeff81 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:34.946763 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639fa7b-3f9b-47c5-b9f9-bfa68deeff81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:34.975978 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 833/1684] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:35.003057 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-a639fa7b-3f9b-47c5-b9f9-bfa68deeff81 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:35.003766 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a639fa7b-3f9b-47c5-b9f9-bfa68deeff81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:35.015833 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 852/1685] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:35.017038 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb9c29-7b9a-4b5d-be0a-1574af3455bf None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:35.035381 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb9c29-7b9a-4b5d-be0a-1574af3455bf None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:35.040811 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e0845-7c27-436f-848e-2ed9008b77c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:35.041866 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e0845-7c27-436f-848e-2ed9008b77c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:35.041866 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e0845-7c27-436f-848e-2ed9008b77c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:35.042152 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e0845-7c27-436f-848e-2ed9008b77c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:35.043229 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e0845-7c27-436f-848e-2ed9008b77c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:20:35.043347 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e0845-7c27-436f-848e-2ed9008b77c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:35.044965 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e0845-7c27-436f-848e-2ed9008b77c8 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:35.062412 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 834/1686] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:20:35.067996 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639fa7b-3f9b-47c5-b9f9-bfa68deeff81 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:35.082729 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639fa7b-3f9b-47c5-b9f9-bfa68deeff81 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:35.091798 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb988af-ff90-45cf-a7dd-74da472823a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:35.092753 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb988af-ff90-45cf-a7dd-74da472823a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:35.093172 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb988af-ff90-45cf-a7dd-74da472823a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:35.093660 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb988af-ff90-45cf-a7dd-74da472823a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:35.094580 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb988af-ff90-45cf-a7dd-74da472823a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:35.100050 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb988af-ff90-45cf-a7dd-74da472823a8 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:35.101826 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e0845-7c27-436f-848e-2ed9008b77c8 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:35.104082 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-319e0845-7c27-436f-848e-2ed9008b77c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:35.241979 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 853/1687] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:20:35 2022] POST /identity/v3/projects => generated 403 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:35.243353 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb988af-ff90-45cf-a7dd-74da472823a8 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:35.247664 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e0845-7c27-436f-848e-2ed9008b77c8 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:35.396745 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb988af-ff90-45cf-a7dd-74da472823a8 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:35.416212 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e788e7b-e9bb-4b3f-8905-ab1dffe66506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:35.423411 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e788e7b-e9bb-4b3f-8905-ab1dffe66506 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:35.423411 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e788e7b-e9bb-4b3f-8905-ab1dffe66506 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:35.423411 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e788e7b-e9bb-4b3f-8905-ab1dffe66506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:35.440023 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbaf53-7483-4aee-98bf-5ef184f8f7f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:35.441766 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbaf53-7483-4aee-98bf-5ef184f8f7f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:35.442060 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbaf53-7483-4aee-98bf-5ef184f8f7f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:35.442346 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbaf53-7483-4aee-98bf-5ef184f8f7f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:35.581972 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e788e7b-e9bb-4b3f-8905-ab1dffe66506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:35.583379 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e788e7b-e9bb-4b3f-8905-ab1dffe66506 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:35.583616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbaf53-7483-4aee-98bf-5ef184f8f7f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:35.585089 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbaf53-7483-4aee-98bf-5ef184f8f7f6 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:35.607741 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 835/1688] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:20:35.608268 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbaf53-7483-4aee-98bf-5ef184f8f7f6 service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:35.608787 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 854/1689] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:35.626119 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbaf53-7483-4aee-98bf-5ef184f8f7f6 service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:35.635460 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f6fbf-9b73-4a09-bcc8-5c3bf3bc58b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:35.636978 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f6fbf-9b73-4a09-bcc8-5c3bf3bc58b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:35.644017 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f6fbf-9b73-4a09-bcc8-5c3bf3bc58b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:35.644929 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f6fbf-9b73-4a09-bcc8-5c3bf3bc58b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:35.645914 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f6fbf-9b73-4a09-bcc8-5c3bf3bc58b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:35.648401 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f6fbf-9b73-4a09-bcc8-5c3bf3bc58b5 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:35.704875 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b2d2c-01db-4b03-b2e8-e8336cc5eb7a None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:35.705170 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b2d2c-01db-4b03-b2e8-e8336cc5eb7a None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:35.706365 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b2d2c-01db-4b03-b2e8-e8336cc5eb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:35.740955 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 836/1690] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:20:35 2022] POST /identity/v3/users => generated 302 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:35.742021 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f6fbf-9b73-4a09-bcc8-5c3bf3bc58b5 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:35.754294 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-a10b2d2c-01db-4b03-b2e8-e8336cc5eb7a None None] MFA Rules not processed for user `f752a7bea22542009cbf86e7b36c8e83`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:35.755794 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f6fbf-9b73-4a09-bcc8-5c3bf3bc58b5 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:35.755906 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a10b2d2c-01db-4b03-b2e8-e8336cc5eb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:35.763710 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9942ec-965b-4925-94e8-dbe1fb409a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:35.764482 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9942ec-965b-4925-94e8-dbe1fb409a23 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:35.764906 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9942ec-965b-4925-94e8-dbe1fb409a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:35.765200 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9942ec-965b-4925-94e8-dbe1fb409a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:35.767058 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9942ec-965b-4925-94e8-dbe1fb409a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:35.769596 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9942ec-965b-4925-94e8-dbe1fb409a23 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:35.793631 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 837/1691] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:35.796843 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9942ec-965b-4925-94e8-dbe1fb409a23 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:35.815566 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9942ec-965b-4925-94e8-dbe1fb409a23 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:35.822903 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3802da6-3c5c-484c-a931-ff1b1fef88dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:35.825008 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3802da6-3c5c-484c-a931-ff1b1fef88dd admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:35.825411 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3802da6-3c5c-484c-a931-ff1b1fef88dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:35.826034 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3802da6-3c5c-484c-a931-ff1b1fef88dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:35.827676 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3802da6-3c5c-484c-a931-ff1b1fef88dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:35.829689 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3802da6-3c5c-484c-a931-ff1b1fef88dd admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:35.863690 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 838/1692] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:35.864754 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3802da6-3c5c-484c-a931-ff1b1fef88dd admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:35.865474 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 855/1693] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:35.870651 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc7384-a5ab-4a90-9185-65cc21df5f07 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:35.873725 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc7384-a5ab-4a90-9185-65cc21df5f07 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:35.873976 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc7384-a5ab-4a90-9185-65cc21df5f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:35.884584 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3802da6-3c5c-484c-a931-ff1b1fef88dd admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:35.896418 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89781fa-b359-4436-ba4f-7830c53f6056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:35.897482 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89781fa-b359-4436-ba4f-7830c53f6056 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:35.897774 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89781fa-b359-4436-ba4f-7830c53f6056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:35.898059 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89781fa-b359-4436-ba4f-7830c53f6056 admin admin] PATH_INFO: `/v3/projects/afd7466d00984c4e81b1e99a26063521/users/26ac39d577c4440088bd8cf08a245607/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:35.913891 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-3cdc7384-a5ab-4a90-9185-65cc21df5f07 None None] MFA Rules not processed for user `f752a7bea22542009cbf86e7b36c8e83`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:35.915132 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-3cdc7384-a5ab-4a90-9185-65cc21df5f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:35.928172 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89781fa-b359-4436-ba4f-7830c53f6056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afd7466d00984c4e81b1e99a26063521, user_id=26ac39d577c4440088bd8cf08a245607, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:35.937354 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 856/1694] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:35.937530 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89781fa-b359-4436-ba4f-7830c53f6056 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:35.948190 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc7384-a5ab-4a90-9185-65cc21df5f07 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:35.949109 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-3cdc7384-a5ab-4a90-9185-65cc21df5f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:36.047748 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc7384-a5ab-4a90-9185-65cc21df5f07 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:36.055596 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45618568-85af-46b1-b187-3e27ed43faee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:36.056573 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45618568-85af-46b1-b187-3e27ed43faee service nova] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:36.057051 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45618568-85af-46b1-b187-3e27ed43faee service nova] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:36.058093 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45618568-85af-46b1-b187-3e27ed43faee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:36.067436 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 839/1695] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:35 2022] PUT /identity/v3/projects/afd7466d00984c4e81b1e99a26063521/users/26ac39d577c4440088bd8cf08a245607/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:36.069205 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45618568-85af-46b1-b187-3e27ed43faee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:36.071854 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45618568-85af-46b1-b187-3e27ed43faee service nova] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:36.087170 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 857/1696] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:20:36.098357 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70166e-237f-4de7-ada6-197577521f7a None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:36.098482 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70166e-237f-4de7-ada6-197577521f7a None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:36.098736 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70166e-237f-4de7-ada6-197577521f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:36.153391 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-cf70166e-237f-4de7-ada6-197577521f7a None None] MFA Rules not processed for user `26ac39d577c4440088bd8cf08a245607`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:36.154694 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-cf70166e-237f-4de7-ada6-197577521f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:36.325987 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 840/1697] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:36.327124 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45618568-85af-46b1-b187-3e27ed43faee service nova] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:36.347446 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45618568-85af-46b1-b187-3e27ed43faee service nova] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:36.490704 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1953bd-157f-48db-b22d-2fa6df424ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:36.491340 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1953bd-157f-48db-b22d-2fa6df424ecb admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:36.491629 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1953bd-157f-48db-b22d-2fa6df424ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:36.491908 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1953bd-157f-48db-b22d-2fa6df424ecb admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:36.492660 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1953bd-157f-48db-b22d-2fa6df424ecb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:36.495035 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1953bd-157f-48db-b22d-2fa6df424ecb admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:36.630580 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70166e-237f-4de7-ada6-197577521f7a None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:36.630745 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 858/1698] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:20:36 2022] POST /identity/v3/projects => generated 405 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:36.653444 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70166e-237f-4de7-ada6-197577521f7a None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:36.814232 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfa536-8dc0-4fea-8877-1eb22e085c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:36.816784 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfa536-8dc0-4fea-8877-1eb22e085c89 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:36.818628 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfa536-8dc0-4fea-8877-1eb22e085c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:36.819052 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfa536-8dc0-4fea-8877-1eb22e085c89 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:36.821925 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bfa536-8dc0-4fea-8877-1eb22e085c89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:36.830027 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bfa536-8dc0-4fea-8877-1eb22e085c89 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:36.964018 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 841/1699] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:20:36 2022] POST /identity/v3/users => generated 309 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:36.968637 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1953bd-157f-48db-b22d-2fa6df424ecb admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:37.010974 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1953bd-157f-48db-b22d-2fa6df424ecb admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:37.028969 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7951c8b-bc44-4934-8ffb-cce5e8625365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:37.030444 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7951c8b-bc44-4934-8ffb-cce5e8625365 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:37.030903 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7951c8b-bc44-4934-8ffb-cce5e8625365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:37.031328 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7951c8b-bc44-4934-8ffb-cce5e8625365 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:37.032206 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7951c8b-bc44-4934-8ffb-cce5e8625365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:37.035546 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7951c8b-bc44-4934-8ffb-cce5e8625365 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:37.076884 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfa536-8dc0-4fea-8877-1eb22e085c89 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:37.080818 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 859/1700] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:37.094470 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfa536-8dc0-4fea-8877-1eb22e085c89 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:37.109487 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933b562-1a06-4d21-99fa-2a78aa582392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:37.110663 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933b562-1a06-4d21-99fa-2a78aa582392 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:37.110959 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933b562-1a06-4d21-99fa-2a78aa582392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:37.111950 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933b562-1a06-4d21-99fa-2a78aa582392 admin admin] PATH_INFO: `/v3/projects/5df6824e53124134a2b3b454152865d3/users/9c23b13b05654d809678759fcdbc5fb9/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:37.139583 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933b562-1a06-4d21-99fa-2a78aa582392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df6824e53124134a2b3b454152865d3, user_id=9c23b13b05654d809678759fcdbc5fb9, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:37.143137 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933b562-1a06-4d21-99fa-2a78aa582392 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:37.184356 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7951c8b-bc44-4934-8ffb-cce5e8625365 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:37.186974 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-c7951c8b-bc44-4934-8ffb-cce5e8625365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:37.216669 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7951c8b-bc44-4934-8ffb-cce5e8625365 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:37.235410 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 842/1701] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:37 2022] PUT /identity/v3/projects/5df6824e53124134a2b3b454152865d3/users/9c23b13b05654d809678759fcdbc5fb9/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:20:37.239089 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e2c8b-4947-4762-91f6-52c66c90608b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:37.239787 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933b562-1a06-4d21-99fa-2a78aa582392 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:37.240004 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e2c8b-4947-4762-91f6-52c66c90608b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:37.241508 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e2c8b-4947-4762-91f6-52c66c90608b admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:37.241508 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e2c8b-4947-4762-91f6-52c66c90608b admin admin] PATH_INFO: `/v3/projects/e3185395d1d349228a63a162258aacb1` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:37.245533 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e2c8b-4947-4762-91f6-52c66c90608b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3185395d1d349228a63a162258aacb1)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:37.251877 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e2c8b-4947-4762-91f6-52c66c90608b admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:37.393564 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933b562-1a06-4d21-99fa-2a78aa582392 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:37.398843 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e33d8-d692-4164-a54b-c6cfd9b68714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:37.399583 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e33d8-d692-4164-a54b-c6cfd9b68714 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:37.399881 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e33d8-d692-4164-a54b-c6cfd9b68714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:37.400165 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e33d8-d692-4164-a54b-c6cfd9b68714 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:37.401174 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e33d8-d692-4164-a54b-c6cfd9b68714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:37.402863 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e33d8-d692-4164-a54b-c6cfd9b68714 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:37.417341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 843/1702] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:20:37.422402 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e33d8-d692-4164-a54b-c6cfd9b68714 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:37.434671 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e33d8-d692-4164-a54b-c6cfd9b68714 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:37.441782 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b00a7-7dd3-4436-83bc-eeb7774ea8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:37.442812 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b00a7-7dd3-4436-83bc-eeb7774ea8f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:37.443107 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b00a7-7dd3-4436-83bc-eeb7774ea8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:37.443436 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b00a7-7dd3-4436-83bc-eeb7774ea8f7 admin admin] PATH_INFO: `/v3/projects/5df6824e53124134a2b3b454152865d3/users/9c23b13b05654d809678759fcdbc5fb9/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:37.445821 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b00a7-7dd3-4436-83bc-eeb7774ea8f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df6824e53124134a2b3b454152865d3, user_id=9c23b13b05654d809678759fcdbc5fb9, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:37.460645 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b00a7-7dd3-4436-83bc-eeb7774ea8f7 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:37.494029 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9d4e2c8b-4947-4762-91f6-52c66c90608b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3185395d1d349228a63a162258aacb1', 'request_id': 'req-9d4e2c8b-4947-4762-91f6-52c66c90608b'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:37.497382 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 844/1703] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:37 2022] PUT /identity/v3/projects/5df6824e53124134a2b3b454152865d3/users/9c23b13b05654d809678759fcdbc5fb9/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:37.500444 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b00a7-7dd3-4436-83bc-eeb7774ea8f7 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:37.505866 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-269b00a7-7dd3-4436-83bc-eeb7774ea8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:37.508403 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9d4e2c8b-4947-4762-91f6-52c66c90608b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3185395d1d349228a63a162258aacb1', 'request_id': 'req-9d4e2c8b-4947-4762-91f6-52c66c90608b'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:37.524486 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9d4e2c8b-4947-4762-91f6-52c66c90608b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3185395d1d349228a63a162258aacb1', 'request_id': 'req-9d4e2c8b-4947-4762-91f6-52c66c90608b'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:37.603128 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9d4e2c8b-4947-4762-91f6-52c66c90608b admin admin] The token cache is being invalidate because project e3185395d1d349228a63a162258aacb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:20:37.603431 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9d4e2c8b-4947-4762-91f6-52c66c90608b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:37.604275 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9d4e2c8b-4947-4762-91f6-52c66c90608b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:37.606939 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 860/1704] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:20:37 2022] DELETE /identity/v3/projects/e3185395d1d349228a63a162258aacb1 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:37.608714 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3c0a8-0098-48c3-9499-0fbb30caa75e None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:37.609000 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3c0a8-0098-48c3-9499-0fbb30caa75e None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:37.613859 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3c0a8-0098-48c3-9499-0fbb30caa75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:37.687347 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-4cd3c0a8-0098-48c3-9499-0fbb30caa75e None None] MFA Rules not processed for user `9c23b13b05654d809678759fcdbc5fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:37.688848 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-4cd3c0a8-0098-48c3-9499-0fbb30caa75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:37.700373 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b00a7-7dd3-4436-83bc-eeb7774ea8f7 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:37.720052 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebcaa2-9934-4948-b606-1c848505cbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:37.721242 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebcaa2-9934-4948-b606-1c848505cbfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:37.721571 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebcaa2-9934-4948-b606-1c848505cbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:37.721857 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebcaa2-9934-4948-b606-1c848505cbfb admin admin] PATH_INFO: `/v3/projects/9c76faf7526c403b941d459dc6e6676c` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:37.728357 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aebcaa2-9934-4948-b606-1c848505cbfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c76faf7526c403b941d459dc6e6676c)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:37.732317 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aebcaa2-9934-4948-b606-1c848505cbfb admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:37.853777 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 861/1705] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:37 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:37.854973 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3c0a8-0098-48c3-9499-0fbb30caa75e None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:37.861108 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-4cd3c0a8-0098-48c3-9499-0fbb30caa75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:37.878957 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3c0a8-0098-48c3-9499-0fbb30caa75e None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:37.888565 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0dd4d-9f7a-4fe8-a108-1508a415294e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:37.889561 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0dd4d-9f7a-4fe8-a108-1508a415294e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:37.889847 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0dd4d-9f7a-4fe8-a108-1508a415294e admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:37.890125 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0dd4d-9f7a-4fe8-a108-1508a415294e admin admin] PATH_INFO: `/v3/users/f5661e69302e4276a4be161a46695a4d` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:37.891380 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0dd4d-9f7a-4fe8-a108-1508a415294e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5661e69302e4276a4be161a46695a4d)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:37.894456 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0dd4d-9f7a-4fe8-a108-1508a415294e admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:37.942438 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-4aebcaa2-9934-4948-b606-1c848505cbfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c76faf7526c403b941d459dc6e6676c', 'request_id': 'req-4aebcaa2-9934-4948-b606-1c848505cbfb'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:38.049589 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-4aebcaa2-9934-4948-b606-1c848505cbfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c76faf7526c403b941d459dc6e6676c', 'request_id': 'req-4aebcaa2-9934-4948-b606-1c848505cbfb'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:38.085034 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-4aebcaa2-9934-4948-b606-1c848505cbfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c76faf7526c403b941d459dc6e6676c', 'request_id': 'req-4aebcaa2-9934-4948-b606-1c848505cbfb'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:38.169457 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-4aebcaa2-9934-4948-b606-1c848505cbfb admin admin] The token cache is being invalidate because project 9c76faf7526c403b941d459dc6e6676c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:20:38.169696 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-4aebcaa2-9934-4948-b606-1c848505cbfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:38.174274 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-4aebcaa2-9934-4948-b606-1c848505cbfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:38.184147 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 845/1706] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:20:37 2022] DELETE /identity/v3/projects/9c76faf7526c403b941d459dc6e6676c => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:38.187215 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebcaa2-9934-4948-b606-1c848505cbfb admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:38.191891 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-4aebcaa2-9934-4948-b606-1c848505cbfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:38.218922 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a4a0dd4d-9f7a-4fe8-a108-1508a415294e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5661e69302e4276a4be161a46695a4d'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:38.305853 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a4a0dd4d-9f7a-4fe8-a108-1508a415294e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5661e69302e4276a4be161a46695a4d'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:38.306786 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a4a0dd4d-9f7a-4fe8-a108-1508a415294e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5661e69302e4276a4be161a46695a4d'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:38.307597 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a4a0dd4d-9f7a-4fe8-a108-1508a415294e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5661e69302e4276a4be161a46695a4d'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:38.319215 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a4a0dd4d-9f7a-4fe8-a108-1508a415294e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5661e69302e4276a4be161a46695a4d'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:38.383519 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebcaa2-9934-4948-b606-1c848505cbfb admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:38.400767 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8be50-42a7-4146-9b8e-51b52464dbd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:38.401724 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8be50-42a7-4146-9b8e-51b52464dbd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:38.402124 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8be50-42a7-4146-9b8e-51b52464dbd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:38.402417 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8be50-42a7-4146-9b8e-51b52464dbd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:38.409271 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 862/1707] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:20:37 2022] DELETE /identity/v3/users/f5661e69302e4276a4be161a46695a4d => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:38.410139 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-37f8be50-42a7-4146-9b8e-51b52464dbd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:38.413710 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0dd4d-9f7a-4fe8-a108-1508a415294e admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:38.416243 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a4a0dd4d-9f7a-4fe8-a108-1508a415294e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:38.584886 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8be50-42a7-4146-9b8e-51b52464dbd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:38.586384 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8be50-42a7-4146-9b8e-51b52464dbd2 service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:38.622837 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 846/1708] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:38 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:38.624673 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b13e47-4f6a-4b5e-979f-9ab03f579c9a None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:38.624985 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b13e47-4f6a-4b5e-979f-9ab03f579c9a None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:38.625266 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b13e47-4f6a-4b5e-979f-9ab03f579c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:38.657219 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0dd4d-9f7a-4fe8-a108-1508a415294e admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:38.682389 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-90b13e47-4f6a-4b5e-979f-9ab03f579c9a None None] MFA Rules not processed for user `f752a7bea22542009cbf86e7b36c8e83`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:38.683710 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f668e8-10d7-4f16-9344-a4f1c3386676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:38.684196 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-90b13e47-4f6a-4b5e-979f-9ab03f579c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:38.684954 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f668e8-10d7-4f16-9344-a4f1c3386676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:38.685521 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f668e8-10d7-4f16-9344-a4f1c3386676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:38.685951 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f668e8-10d7-4f16-9344-a4f1c3386676 admin admin] PATH_INFO: `/v3/users/a0c07ac0fd824288bbad75eb194c3843` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:38.687670 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f668e8-10d7-4f16-9344-a4f1c3386676 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0c07ac0fd824288bbad75eb194c3843)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:38.692287 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f668e8-10d7-4f16-9344-a4f1c3386676 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:38.862015 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 847/1709] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:38.863568 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c683997-89e3-44a6-b010-31fc4126d5ff None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:38.863930 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c683997-89e3-44a6-b010-31fc4126d5ff None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:38.864221 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c683997-89e3-44a6-b010-31fc4126d5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:38.910040 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-9c683997-89e3-44a6-b010-31fc4126d5ff None None] MFA Rules not processed for user `a706b6d0163549bc80285c4158331b94`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:38.912035 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9c683997-89e3-44a6-b010-31fc4126d5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:38.939154 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-e7f668e8-10d7-4f16-9344-a4f1c3386676 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0c07ac0fd824288bbad75eb194c3843'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:39.031966 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-e7f668e8-10d7-4f16-9344-a4f1c3386676 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0c07ac0fd824288bbad75eb194c3843'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:39.032484 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-e7f668e8-10d7-4f16-9344-a4f1c3386676 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0c07ac0fd824288bbad75eb194c3843'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:39.034479 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-e7f668e8-10d7-4f16-9344-a4f1c3386676 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0c07ac0fd824288bbad75eb194c3843'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:39.045082 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 848/1710] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Mar 29 20:20:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:39.048394 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c683997-89e3-44a6-b010-31fc4126d5ff None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:39.048394 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9c683997-89e3-44a6-b010-31fc4126d5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:39.056858 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-e7f668e8-10d7-4f16-9344-a4f1c3386676 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0c07ac0fd824288bbad75eb194c3843'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:39.068838 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c683997-89e3-44a6-b010-31fc4126d5ff None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:39.075225 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4c3f5-e6de-405a-b3a7-b469390c7868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:39.084310 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4c3f5-e6de-405a-b3a7-b469390c7868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:39.084310 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4c3f5-e6de-405a-b3a7-b469390c7868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:39.084310 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4c3f5-e6de-405a-b3a7-b469390c7868 admin admin] PATH_INFO: `/v3/users/26ac39d577c4440088bd8cf08a245607` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:39.085854 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4c3f5-e6de-405a-b3a7-b469390c7868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26ac39d577c4440088bd8cf08a245607)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:39.089241 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4c3f5-e6de-405a-b3a7-b469390c7868 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:39.138163 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 863/1711] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:20:38 2022] DELETE /identity/v3/users/a0c07ac0fd824288bbad75eb194c3843 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:39.313853 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-0ee4c3f5-e6de-405a-b3a7-b469390c7868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26ac39d577c4440088bd8cf08a245607'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:39.471879 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-0ee4c3f5-e6de-405a-b3a7-b469390c7868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26ac39d577c4440088bd8cf08a245607'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:39.473453 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-0ee4c3f5-e6de-405a-b3a7-b469390c7868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26ac39d577c4440088bd8cf08a245607'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:39.488823 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-0ee4c3f5-e6de-405a-b3a7-b469390c7868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26ac39d577c4440088bd8cf08a245607'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:39.551417 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-0ee4c3f5-e6de-405a-b3a7-b469390c7868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26ac39d577c4440088bd8cf08a245607'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:39.576742 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 849/1712] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:20:39 2022] DELETE /identity/v3/users/26ac39d577c4440088bd8cf08a245607 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:39.577888 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff98c68-79ed-4087-8bfc-50909b02f005 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:39.578394 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff98c68-79ed-4087-8bfc-50909b02f005 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:39.578466 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff98c68-79ed-4087-8bfc-50909b02f005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:39.598300 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4c3f5-e6de-405a-b3a7-b469390c7868 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:39.599754 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-0ee4c3f5-e6de-405a-b3a7-b469390c7868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:39.630827 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-2ff98c68-79ed-4087-8bfc-50909b02f005 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:39.633655 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-2ff98c68-79ed-4087-8bfc-50909b02f005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:39.810647 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4c3f5-e6de-405a-b3a7-b469390c7868 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:39.822204 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 864/1713] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:39.832095 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b3fc6-9e2c-4dd0-b9f3-93c6eff02c71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d6d8e7788494f2c92ad5c183c8fa283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:39.834736 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b3fc6-9e2c-4dd0-b9f3-93c6eff02c71 service swift] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:39.835101 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b3fc6-9e2c-4dd0-b9f3-93c6eff02c71 service swift] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:39.835390 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b3fc6-9e2c-4dd0-b9f3-93c6eff02c71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:39.841906 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-783b3fc6-9e2c-4dd0-b9f3-93c6eff02c71 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:39.916233 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff98c68-79ed-4087-8bfc-50909b02f005 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:39.916817 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-2ff98c68-79ed-4087-8bfc-50909b02f005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:39.991047 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b3fc6-9e2c-4dd0-b9f3-93c6eff02c71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:39.996389 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b3fc6-9e2c-4dd0-b9f3-93c6eff02c71 service swift] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:40.029989 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 850/1714] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Mar 29 20:20:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 29 20:20:40.122795 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff98c68-79ed-4087-8bfc-50909b02f005 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:40.140111 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e48340-e908-40fb-a134-a37d59d317a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:40.140860 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e48340-e908-40fb-a134-a37d59d317a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:40.148503 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e48340-e908-40fb-a134-a37d59d317a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:40.149018 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e48340-e908-40fb-a134-a37d59d317a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:40.223223 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e48340-e908-40fb-a134-a37d59d317a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:40.226848 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e48340-e908-40fb-a134-a37d59d317a8 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:40.262660 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 865/1715] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:40.913636 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b3fc6-9e2c-4dd0-b9f3-93c6eff02c71 service swift] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:40.915302 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-783b3fc6-9e2c-4dd0-b9f3-93c6eff02c71 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:40.954729 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b3fc6-9e2c-4dd0-b9f3-93c6eff02c71 service swift] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:40.963616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc75a4e-e919-424f-a68e-6d27febe6568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:40.964866 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc75a4e-e919-424f-a68e-6d27febe6568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:40.965530 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc75a4e-e919-424f-a68e-6d27febe6568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:40.966025 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc75a4e-e919-424f-a68e-6d27febe6568 admin admin] PATH_INFO: `/v3/projects/81fb0284515a46b4a9a6d73e2ec55424` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:40.967515 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc75a4e-e919-424f-a68e-6d27febe6568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81fb0284515a46b4a9a6d73e2ec55424)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:40.969952 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc75a4e-e919-424f-a68e-6d27febe6568 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:41.156064 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-bbc75a4e-e919-424f-a68e-6d27febe6568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81fb0284515a46b4a9a6d73e2ec55424', 'request_id': 'req-bbc75a4e-e919-424f-a68e-6d27febe6568'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:41.248168 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-bbc75a4e-e919-424f-a68e-6d27febe6568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81fb0284515a46b4a9a6d73e2ec55424', 'request_id': 'req-bbc75a4e-e919-424f-a68e-6d27febe6568'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:41.270502 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-bbc75a4e-e919-424f-a68e-6d27febe6568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81fb0284515a46b4a9a6d73e2ec55424', 'request_id': 'req-bbc75a4e-e919-424f-a68e-6d27febe6568'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:41.295471 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-bbc75a4e-e919-424f-a68e-6d27febe6568 admin admin] The token cache is being invalidate because project 81fb0284515a46b4a9a6d73e2ec55424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:20:41.295933 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-bbc75a4e-e919-424f-a68e-6d27febe6568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:41.296691 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-bbc75a4e-e919-424f-a68e-6d27febe6568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:41.322493 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 851/1716] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:20:40 2022] DELETE /identity/v3/projects/81fb0284515a46b4a9a6d73e2ec55424 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:41.324389 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ff6be-d9dc-4157-8897-2aca61aaaca4 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:41.324875 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ff6be-d9dc-4157-8897-2aca61aaaca4 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:41.324958 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ff6be-d9dc-4157-8897-2aca61aaaca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:41.406226 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-797ff6be-d9dc-4157-8897-2aca61aaaca4 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:41.407828 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-797ff6be-d9dc-4157-8897-2aca61aaaca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:41.474169 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebb2c5-baec-4c99-ba43-23b0e59af72c None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:41.474591 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebb2c5-baec-4c99-ba43-23b0e59af72c None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:41.475323 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebb2c5-baec-4c99-ba43-23b0e59af72c None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:41.477894 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 852/1717] 10.222.0.43 () {54 vars in 912 bytes} [Tue Mar 29 20:20:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 20:20:41.489439 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779a5d4-5f86-4c88-b7bf-73d46efd052a None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:41.489907 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779a5d4-5f86-4c88-b7bf-73d46efd052a None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:41.490298 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779a5d4-5f86-4c88-b7bf-73d46efd052a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:41.527924 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 866/1718] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:41.532842 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-e779a5d4-5f86-4c88-b7bf-73d46efd052a None None] MFA Rules not processed for user `22bdaa02b1b14be3837b337fbf6e0eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:41.534859 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-e779a5d4-5f86-4c88-b7bf-73d46efd052a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:41.536816 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9c836-8974-4c64-8fbd-eb59bb8f54bf None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:41.539860 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9c836-8974-4c64-8fbd-eb59bb8f54bf None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:41.540680 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9c836-8974-4c64-8fbd-eb59bb8f54bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:41.608125 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-99c9c836-8974-4c64-8fbd-eb59bb8f54bf None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:41.617976 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-99c9c836-8974-4c64-8fbd-eb59bb8f54bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:41.685031 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 867/1719] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:41.686551 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9c836-8974-4c64-8fbd-eb59bb8f54bf None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:41.717136 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9c836-8974-4c64-8fbd-eb59bb8f54bf None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:41.730476 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f0168-d164-4394-8f9d-815de1dc23b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:41.730476 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f0168-d164-4394-8f9d-815de1dc23b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:41.739102 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f0168-d164-4394-8f9d-815de1dc23b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:41.740015 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f0168-d164-4394-8f9d-815de1dc23b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:41.740297 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f0168-d164-4394-8f9d-815de1dc23b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:20:41.740656 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f0168-d164-4394-8f9d-815de1dc23b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:41.758139 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f0168-d164-4394-8f9d-815de1dc23b3 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:41.890034 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 868/1720] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:20:41.890034 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f0168-d164-4394-8f9d-815de1dc23b3 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:41.891640 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 853/1721] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Mar 29 20:20:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:20:41.892516 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-9b9f0168-d164-4394-8f9d-815de1dc23b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:41.892807 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779a5d4-5f86-4c88-b7bf-73d46efd052a None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:41.892807 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-e779a5d4-5f86-4c88-b7bf-73d46efd052a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:41.892977 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f0168-d164-4394-8f9d-815de1dc23b3 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:41.893073 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779a5d4-5f86-4c88-b7bf-73d46efd052a None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:41.893214 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6189e9b-db69-408a-b9d9-c7f635a27838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:41.893214 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6189e9b-db69-408a-b9d9-c7f635a27838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:41.893214 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6189e9b-db69-408a-b9d9-c7f635a27838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:41.893214 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6189e9b-db69-408a-b9d9-c7f635a27838 admin admin] PATH_INFO: `/v3/projects/9567cc77935a4c0fa752ed81691bd9d5` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:41.893582 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ecb54c-c41a-4c64-b70d-96afc9e21d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:41.893582 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecb54c-c41a-4c64-b70d-96afc9e21d35 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:41.893582 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecb54c-c41a-4c64-b70d-96afc9e21d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:41.893582 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecb54c-c41a-4c64-b70d-96afc9e21d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:41.893891 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6189e9b-db69-408a-b9d9-c7f635a27838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9567cc77935a4c0fa752ed81691bd9d5)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:41.893891 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6189e9b-db69-408a-b9d9-c7f635a27838 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:41.936146 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ecb54c-c41a-4c64-b70d-96afc9e21d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:41.941435 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ecb54c-c41a-4c64-b70d-96afc9e21d35 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:42.002847 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 854/1722] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:20:42.012321 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ecb54c-c41a-4c64-b70d-96afc9e21d35 service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:42.068901 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ecb54c-c41a-4c64-b70d-96afc9e21d35 service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:42.088849 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c9f9b-3948-45f3-9c93-7b41d8dc2f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:42.092474 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c9f9b-3948-45f3-9c93-7b41d8dc2f2d admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:42.093507 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c9f9b-3948-45f3-9c93-7b41d8dc2f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:42.094134 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c9f9b-3948-45f3-9c93-7b41d8dc2f2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:42.095936 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c9f9b-3948-45f3-9c93-7b41d8dc2f2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:42.100652 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c9f9b-3948-45f3-9c93-7b41d8dc2f2d admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:42.315945 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 855/1723] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:20:42 2022] POST /identity/v3/projects => generated 355 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:42.323235 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6b05e-d30d-4616-b088-cbf582779c60 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:42.323978 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6b05e-d30d-4616-b088-cbf582779c60 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:42.324333 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6b05e-d30d-4616-b088-cbf582779c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:42.353532 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a6189e9b-db69-408a-b9d9-c7f635a27838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9567cc77935a4c0fa752ed81691bd9d5', 'request_id': 'req-a6189e9b-db69-408a-b9d9-c7f635a27838'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:42.388417 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a6189e9b-db69-408a-b9d9-c7f635a27838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9567cc77935a4c0fa752ed81691bd9d5', 'request_id': 'req-a6189e9b-db69-408a-b9d9-c7f635a27838'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:42.436834 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a6189e9b-db69-408a-b9d9-c7f635a27838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9567cc77935a4c0fa752ed81691bd9d5', 'request_id': 'req-a6189e9b-db69-408a-b9d9-c7f635a27838'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:42.484792 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-b7f6b05e-d30d-4616-b088-cbf582779c60 None None] MFA Rules not processed for user `b608c6b9c7ef48c2abe8ec8ebb61d75c`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:42.487217 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-b7f6b05e-d30d-4616-b088-cbf582779c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:42.644378 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 856/1724] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:42.645697 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6b05e-d30d-4616-b088-cbf582779c60 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:42.650017 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a6189e9b-db69-408a-b9d9-c7f635a27838 admin admin] The token cache is being invalidate because project 9567cc77935a4c0fa752ed81691bd9d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:20:42.652631 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a6189e9b-db69-408a-b9d9-c7f635a27838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:42.656065 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a6189e9b-db69-408a-b9d9-c7f635a27838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:42.667469 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 869/1725] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:20:41 2022] DELETE /identity/v3/projects/9567cc77935a4c0fa752ed81691bd9d5 => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:42.680426 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f908972-43f7-40a4-afcc-d9ebe6067cfa None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:42.681954 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f908972-43f7-40a4-afcc-d9ebe6067cfa None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:42.684661 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f908972-43f7-40a4-afcc-d9ebe6067cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:42.743926 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-2f908972-43f7-40a4-afcc-d9ebe6067cfa None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:42.745161 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-2f908972-43f7-40a4-afcc-d9ebe6067cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:42.826777 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6b05e-d30d-4616-b088-cbf582779c60 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:42.832994 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7411087-7d46-48a5-bfe0-75c68687ce3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:42.836559 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7411087-7d46-48a5-bfe0-75c68687ce3c admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:42.836559 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7411087-7d46-48a5-bfe0-75c68687ce3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:42.836559 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7411087-7d46-48a5-bfe0-75c68687ce3c admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:42.836559 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7411087-7d46-48a5-bfe0-75c68687ce3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:42.838716 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7411087-7d46-48a5-bfe0-75c68687ce3c admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:42.941190 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 857/1726] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:20:42 2022] POST /identity/v3/users => generated 278 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:42.942143 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7411087-7d46-48a5-bfe0-75c68687ce3c admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:42.949595 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-b7411087-7d46-48a5-bfe0-75c68687ce3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:42.982794 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 870/1727] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:42.983706 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f908972-43f7-40a4-afcc-d9ebe6067cfa None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:42.985104 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-2f908972-43f7-40a4-afcc-d9ebe6067cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:43.014936 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f908972-43f7-40a4-afcc-d9ebe6067cfa None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:43.023898 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e289c12-e8ed-4281-b2dd-e205a587d4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:43.024598 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e289c12-e8ed-4281-b2dd-e205a587d4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:43.024887 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e289c12-e8ed-4281-b2dd-e205a587d4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:43.025183 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e289c12-e8ed-4281-b2dd-e205a587d4b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:43.025947 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e289c12-e8ed-4281-b2dd-e205a587d4b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:43.027592 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e289c12-e8ed-4281-b2dd-e205a587d4b9 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:43.052610 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 871/1728] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:43.055053 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0517c96-d1f5-45df-8175-1be7e39c865d None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:43.055053 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0517c96-d1f5-45df-8175-1be7e39c865d None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:43.055053 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0517c96-d1f5-45df-8175-1be7e39c865d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:43.118519 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-e0517c96-d1f5-45df-8175-1be7e39c865d None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:43.119956 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e0517c96-d1f5-45df-8175-1be7e39c865d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:43.144452 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 872/1729] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:43.145513 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0517c96-d1f5-45df-8175-1be7e39c865d None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:43.165182 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0517c96-d1f5-45df-8175-1be7e39c865d None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:43.191806 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253be74-675b-4db9-9b2e-a6e6e3522884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:43.192668 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253be74-675b-4db9-9b2e-a6e6e3522884 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:43.192960 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253be74-675b-4db9-9b2e-a6e6e3522884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:43.193243 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253be74-675b-4db9-9b2e-a6e6e3522884 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:43.194009 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253be74-675b-4db9-9b2e-a6e6e3522884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:43.195674 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253be74-675b-4db9-9b2e-a6e6e3522884 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:43.241231 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 873/1730] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:43.242326 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253be74-675b-4db9-9b2e-a6e6e3522884 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:43.299182 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253be74-675b-4db9-9b2e-a6e6e3522884 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:43.328288 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c15e2e-8e9b-41d5-b94c-5ef4174678cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:43.329178 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c15e2e-8e9b-41d5-b94c-5ef4174678cc admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:43.329651 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c15e2e-8e9b-41d5-b94c-5ef4174678cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:43.330706 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c15e2e-8e9b-41d5-b94c-5ef4174678cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:43.331590 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c15e2e-8e9b-41d5-b94c-5ef4174678cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:20:43.332121 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c15e2e-8e9b-41d5-b94c-5ef4174678cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:43.334686 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c15e2e-8e9b-41d5-b94c-5ef4174678cc admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:43.361384 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7411087-7d46-48a5-bfe0-75c68687ce3c admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:43.390079 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 874/1731] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:20:43.395978 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c15e2e-8e9b-41d5-b94c-5ef4174678cc admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:43.400818 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95db7d-194b-458c-b315-3bfa3a140262 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:43.404076 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95db7d-194b-458c-b315-3bfa3a140262 service nova] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:43.404838 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95db7d-194b-458c-b315-3bfa3a140262 service nova] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:43.409336 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95db7d-194b-458c-b315-3bfa3a140262 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:43.421238 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-bc95db7d-194b-458c-b315-3bfa3a140262 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:43.440469 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c15e2e-8e9b-41d5-b94c-5ef4174678cc admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:43.461452 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac88aa-a66b-434c-9dcf-f4171f77c2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:43.462815 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac88aa-a66b-434c-9dcf-f4171f77c2ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:43.463303 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac88aa-a66b-434c-9dcf-f4171f77c2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:43.463772 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac88aa-a66b-434c-9dcf-f4171f77c2ee admin admin] PATH_INFO: `/v3/projects/1d3531dd55fa48a29e992822e6384e3e/users/5a31a1b17add447a98309270b6d52f02/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:43.470841 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95db7d-194b-458c-b315-3bfa3a140262 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:43.475722 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95db7d-194b-458c-b315-3bfa3a140262 service nova] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:43.509172 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac88aa-a66b-434c-9dcf-f4171f77c2ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3531dd55fa48a29e992822e6384e3e, user_id=5a31a1b17add447a98309270b6d52f02, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:43.523581 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 858/1732] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:43.524740 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95db7d-194b-458c-b315-3bfa3a140262 service nova] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:43.526104 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac88aa-a66b-434c-9dcf-f4171f77c2ee admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:43.551143 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95db7d-194b-458c-b315-3bfa3a140262 service nova] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:43.561675 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98762b41-6fd4-47f6-b7be-aba0ce4c9ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:43.562338 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98762b41-6fd4-47f6-b7be-aba0ce4c9ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:43.562626 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98762b41-6fd4-47f6-b7be-aba0ce4c9ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:43.563207 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98762b41-6fd4-47f6-b7be-aba0ce4c9ad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:43.563976 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98762b41-6fd4-47f6-b7be-aba0ce4c9ad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:43.569532 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98762b41-6fd4-47f6-b7be-aba0ce4c9ad5 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:43.628842 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 875/1733] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:43 2022] PUT /identity/v3/projects/1d3531dd55fa48a29e992822e6384e3e/users/5a31a1b17add447a98309270b6d52f02/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:43.637977 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac88aa-a66b-434c-9dcf-f4171f77c2ee admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:43.640875 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-7cac88aa-a66b-434c-9dcf-f4171f77c2ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:43.784371 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 859/1734] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:20:43 2022] POST /identity/v3/projects => generated 387 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:43.797211 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9e141-08ac-4567-8ac4-c567023a9f04 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:43.802789 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9e141-08ac-4567-8ac4-c567023a9f04 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:43.804476 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9e141-08ac-4567-8ac4-c567023a9f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:43.911021 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-afe9e141-08ac-4567-8ac4-c567023a9f04 None None] MFA Rules not processed for user `5a31a1b17add447a98309270b6d52f02`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:43.912464 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-afe9e141-08ac-4567-8ac4-c567023a9f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:43.974467 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac88aa-a66b-434c-9dcf-f4171f77c2ee admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:44.108169 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 860/1735] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:43 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:44.113672 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9e141-08ac-4567-8ac4-c567023a9f04 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:44.151384 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674c5a7-2e7c-4937-ad42-02b24b216888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:44.151797 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674c5a7-2e7c-4937-ad42-02b24b216888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:44.152315 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674c5a7-2e7c-4937-ad42-02b24b216888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:44.152815 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674c5a7-2e7c-4937-ad42-02b24b216888 admin admin] PATH_INFO: `/v3/users/db790558cb784e7cbc64bdb7a19e9857` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:44.154566 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674c5a7-2e7c-4937-ad42-02b24b216888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db790558cb784e7cbc64bdb7a19e9857)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:44.157121 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674c5a7-2e7c-4937-ad42-02b24b216888 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:44.354646 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6674c5a7-2e7c-4937-ad42-02b24b216888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db790558cb784e7cbc64bdb7a19e9857'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:44.382232 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9e141-08ac-4567-8ac4-c567023a9f04 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:44.382232 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53081f8f-1182-4d3b-a445-c5aaf5d4cba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:44.382232 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53081f8f-1182-4d3b-a445-c5aaf5d4cba7 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:44.382232 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53081f8f-1182-4d3b-a445-c5aaf5d4cba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:44.391973 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53081f8f-1182-4d3b-a445-c5aaf5d4cba7 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:44.394603 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53081f8f-1182-4d3b-a445-c5aaf5d4cba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:44.400740 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53081f8f-1182-4d3b-a445-c5aaf5d4cba7 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:44.439740 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6674c5a7-2e7c-4937-ad42-02b24b216888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db790558cb784e7cbc64bdb7a19e9857'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:44.449203 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6674c5a7-2e7c-4937-ad42-02b24b216888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db790558cb784e7cbc64bdb7a19e9857'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:44.455842 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6674c5a7-2e7c-4937-ad42-02b24b216888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db790558cb784e7cbc64bdb7a19e9857'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:44.474869 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6674c5a7-2e7c-4937-ad42-02b24b216888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db790558cb784e7cbc64bdb7a19e9857'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:44.523737 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 861/1736] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:20:44 2022] POST /identity/v3/users => generated 294 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:44.536269 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53081f8f-1182-4d3b-a445-c5aaf5d4cba7 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:44.544063 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-53081f8f-1182-4d3b-a445-c5aaf5d4cba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:44.565095 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 876/1737] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:20:43 2022] DELETE /identity/v3/users/db790558cb784e7cbc64bdb7a19e9857 => generated 0 bytes in 924 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:44.568077 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b7d42-9f35-43e3-b2a8-c7b31934238f None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:44.571781 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b7d42-9f35-43e3-b2a8-c7b31934238f None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:44.575649 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b7d42-9f35-43e3-b2a8-c7b31934238f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:44.609782 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53081f8f-1182-4d3b-a445-c5aaf5d4cba7 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:44.622495 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-b39b7d42-9f35-43e3-b2a8-c7b31934238f None None] MFA Rules not processed for user `22bdaa02b1b14be3837b337fbf6e0eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:44.635784 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b39b7d42-9f35-43e3-b2a8-c7b31934238f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:44.763402 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 877/1738] 10.222.0.42 () {58 vars in 1015 bytes} [Tue Mar 29 20:20:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:44.766155 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b7d42-9f35-43e3-b2a8-c7b31934238f None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:44.770158 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b39b7d42-9f35-43e3-b2a8-c7b31934238f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:44.856931 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd4265-1a83-45f2-8f02-da75f836ccef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:44.862475 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd4265-1a83-45f2-8f02-da75f836ccef admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:44.862897 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd4265-1a83-45f2-8f02-da75f836ccef admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:44.863243 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd4265-1a83-45f2-8f02-da75f836ccef admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:44.881231 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd4265-1a83-45f2-8f02-da75f836ccef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:44.897090 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd4265-1a83-45f2-8f02-da75f836ccef admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:44.978557 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b7d42-9f35-43e3-b2a8-c7b31934238f None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:45.000015 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861c5cb-fb63-485e-b964-c0b5135c9277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:45.000719 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861c5cb-fb63-485e-b964-c0b5135c9277 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:45.001007 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861c5cb-fb63-485e-b964-c0b5135c9277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:45.001307 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861c5cb-fb63-485e-b964-c0b5135c9277 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:45.002609 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861c5cb-fb63-485e-b964-c0b5135c9277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:45.004236 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861c5cb-fb63-485e-b964-c0b5135c9277 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:45.038373 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 878/1739] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:45.055548 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 862/1740] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:20:44 2022] POST /identity/v3/projects => generated 357 bytes in 525 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:45.057204 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee1b32-bec2-4bad-9234-50a8eb6dcff8 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:45.058135 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd4265-1a83-45f2-8f02-da75f836ccef admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:45.059618 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee1b32-bec2-4bad-9234-50a8eb6dcff8 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:45.100437 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee1b32-bec2-4bad-9234-50a8eb6dcff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:45.104370 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-d3bd4265-1a83-45f2-8f02-da75f836ccef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:45.171798 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-f5ee1b32-bec2-4bad-9234-50a8eb6dcff8 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:45.176166 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-f5ee1b32-bec2-4bad-9234-50a8eb6dcff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:45.299805 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd4265-1a83-45f2-8f02-da75f836ccef admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:45.309193 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ad217-6eb5-49c6-a656-b4e21c3a240c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:45.309193 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ad217-6eb5-49c6-a656-b4e21c3a240c service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:45.309193 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ad217-6eb5-49c6-a656-b4e21c3a240c service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:45.309193 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ad217-6eb5-49c6-a656-b4e21c3a240c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:45.320504 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 879/1741] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:45.322601 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee1b32-bec2-4bad-9234-50a8eb6dcff8 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:45.324622 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-f5ee1b32-bec2-4bad-9234-50a8eb6dcff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:45.336314 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ad217-6eb5-49c6-a656-b4e21c3a240c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:45.337684 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee1b32-bec2-4bad-9234-50a8eb6dcff8 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:45.344606 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14141006-ccb2-43ee-817f-b355e361399e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:45.344796 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ad217-6eb5-49c6-a656-b4e21c3a240c service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:45.346311 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14141006-ccb2-43ee-817f-b355e361399e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:45.346890 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14141006-ccb2-43ee-817f-b355e361399e admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:45.347389 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14141006-ccb2-43ee-817f-b355e361399e admin admin] PATH_INFO: `/v3/projects/afd7466d00984c4e81b1e99a26063521` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:45.348907 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14141006-ccb2-43ee-817f-b355e361399e admin admin] RBAC: Authorizing `identity:delete_project(project_id=afd7466d00984c4e81b1e99a26063521)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:45.352120 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14141006-ccb2-43ee-817f-b355e361399e admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:45.378436 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 863/1742] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:45.379986 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a187da-dfdb-46ff-8656-2036e9afb2e2 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:45.380266 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a187da-dfdb-46ff-8656-2036e9afb2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:45.380551 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a187da-dfdb-46ff-8656-2036e9afb2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:45.466513 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-c6a187da-dfdb-46ff-8656-2036e9afb2e2 None None] MFA Rules not processed for user `1c4e8920f33a4ae1a68811d68dd5d58f`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:45.467759 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-c6a187da-dfdb-46ff-8656-2036e9afb2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:45.530463 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-14141006-ccb2-43ee-817f-b355e361399e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afd7466d00984c4e81b1e99a26063521', 'request_id': 'req-14141006-ccb2-43ee-817f-b355e361399e'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:45.555262 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-14141006-ccb2-43ee-817f-b355e361399e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afd7466d00984c4e81b1e99a26063521', 'request_id': 'req-14141006-ccb2-43ee-817f-b355e361399e'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:45.571760 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-14141006-ccb2-43ee-817f-b355e361399e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afd7466d00984c4e81b1e99a26063521', 'request_id': 'req-14141006-ccb2-43ee-817f-b355e361399e'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:45.656660 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 864/1743] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:45.668121 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a187da-dfdb-46ff-8656-2036e9afb2e2 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:45.682570 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-14141006-ccb2-43ee-817f-b355e361399e admin admin] The token cache is being invalidate because project afd7466d00984c4e81b1e99a26063521 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:20:45.689435 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-14141006-ccb2-43ee-817f-b355e361399e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:45.689435 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-14141006-ccb2-43ee-817f-b355e361399e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:45.689435 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 880/1744] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:20:45 2022] DELETE /identity/v3/projects/afd7466d00984c4e81b1e99a26063521 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:45.689435 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14141006-ccb2-43ee-817f-b355e361399e admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:45.692284 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-14141006-ccb2-43ee-817f-b355e361399e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:45.694308 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a187da-dfdb-46ff-8656-2036e9afb2e2 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:45.882010 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ae0b7-2872-46a4-8d6f-3f99f3e355d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:45.884156 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ae0b7-2872-46a4-8d6f-3f99f3e355d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:45.885665 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ae0b7-2872-46a4-8d6f-3f99f3e355d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:45.886206 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ae0b7-2872-46a4-8d6f-3f99f3e355d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:45.888168 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ae0b7-2872-46a4-8d6f-3f99f3e355d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:45.890903 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ae0b7-2872-46a4-8d6f-3f99f3e355d2 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:45.912647 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 865/1745] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:45.914649 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ae0b7-2872-46a4-8d6f-3f99f3e355d2 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:45.916780 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-787ae0b7-2872-46a4-8d6f-3f99f3e355d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:45.975375 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14141006-ccb2-43ee-817f-b355e361399e admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:45.991988 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66974915-782a-4892-a96a-56f847fcbf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:45.994166 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66974915-782a-4892-a96a-56f847fcbf53 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:45.995231 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66974915-782a-4892-a96a-56f847fcbf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:45.995697 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66974915-782a-4892-a96a-56f847fcbf53 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:45.996470 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66974915-782a-4892-a96a-56f847fcbf53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:46.014632 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66974915-782a-4892-a96a-56f847fcbf53 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:46.034557 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ae0b7-2872-46a4-8d6f-3f99f3e355d2 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:46.042239 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d990b13-e3f1-4b3b-9cb1-90f18efc6256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:46.043712 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d990b13-e3f1-4b3b-9cb1-90f18efc6256 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:46.044277 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d990b13-e3f1-4b3b-9cb1-90f18efc6256 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:46.044733 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d990b13-e3f1-4b3b-9cb1-90f18efc6256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:46.047051 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-4d990b13-e3f1-4b3b-9cb1-90f18efc6256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:46.062501 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d990b13-e3f1-4b3b-9cb1-90f18efc6256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:46.064835 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d990b13-e3f1-4b3b-9cb1-90f18efc6256 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:46.084444 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 866/1746] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:46.087956 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d990b13-e3f1-4b3b-9cb1-90f18efc6256 service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:46.091930 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-4d990b13-e3f1-4b3b-9cb1-90f18efc6256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:46.151760 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 881/1747] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:20:45 2022] POST /identity/v3/users => generated 285 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:46.152540 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66974915-782a-4892-a96a-56f847fcbf53 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:46.156512 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-66974915-782a-4892-a96a-56f847fcbf53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:46.209599 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66974915-782a-4892-a96a-56f847fcbf53 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:46.228265 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495d1a9-0e64-494c-9297-74bd79b0881f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:46.229169 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495d1a9-0e64-494c-9297-74bd79b0881f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:46.234018 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495d1a9-0e64-494c-9297-74bd79b0881f admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:46.234431 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495d1a9-0e64-494c-9297-74bd79b0881f admin admin] PATH_INFO: `/v3/users/9c23b13b05654d809678759fcdbc5fb9` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:46.238323 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495d1a9-0e64-494c-9297-74bd79b0881f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c23b13b05654d809678759fcdbc5fb9)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:46.240379 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495d1a9-0e64-494c-9297-74bd79b0881f admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:46.332512 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d990b13-e3f1-4b3b-9cb1-90f18efc6256 service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:46.356166 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8957ce-dbd1-447c-97f4-bb692e9c25ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:46.357240 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8957ce-dbd1-447c-97f4-bb692e9c25ca service nova] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:46.359271 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8957ce-dbd1-447c-97f4-bb692e9c25ca service nova] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:46.360020 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8957ce-dbd1-447c-97f4-bb692e9c25ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:46.364143 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-1d8957ce-dbd1-447c-97f4-bb692e9c25ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:46.588234 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6495d1a9-0e64-494c-9297-74bd79b0881f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c23b13b05654d809678759fcdbc5fb9'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:46.681432 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8957ce-dbd1-447c-97f4-bb692e9c25ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:46.683869 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8957ce-dbd1-447c-97f4-bb692e9c25ca service nova] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:46.718251 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6495d1a9-0e64-494c-9297-74bd79b0881f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c23b13b05654d809678759fcdbc5fb9'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:46.723339 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6495d1a9-0e64-494c-9297-74bd79b0881f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c23b13b05654d809678759fcdbc5fb9'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:46.734372 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6495d1a9-0e64-494c-9297-74bd79b0881f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c23b13b05654d809678759fcdbc5fb9'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:46.771278 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 867/1748] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:46.773376 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8957ce-dbd1-447c-97f4-bb692e9c25ca service nova] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:46.780216 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-1d8957ce-dbd1-447c-97f4-bb692e9c25ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:46.798134 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6495d1a9-0e64-494c-9297-74bd79b0881f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c23b13b05654d809678759fcdbc5fb9'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:46.837414 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8957ce-dbd1-447c-97f4-bb692e9c25ca service nova] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:46.854477 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d93489-ee8b-480c-b4ec-0afc6f0e7ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:46.860613 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d93489-ee8b-480c-b4ec-0afc6f0e7ea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:46.865823 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d93489-ee8b-480c-b4ec-0afc6f0e7ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:46.865823 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d93489-ee8b-480c-b4ec-0afc6f0e7ea4 admin admin] PATH_INFO: `/v3/projects/1f94dd3b9a3942f3bb53b33b9b2cf3b3/users/e7ead14590d74386aa14a8b41a8afc58/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:46.903624 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 882/1749] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:20:46 2022] DELETE /identity/v3/users/9c23b13b05654d809678759fcdbc5fb9 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:46.909807 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495d1a9-0e64-494c-9297-74bd79b0881f admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:46.913915 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-6495d1a9-0e64-494c-9297-74bd79b0881f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:46.958541 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d93489-ee8b-480c-b4ec-0afc6f0e7ea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f94dd3b9a3942f3bb53b33b9b2cf3b3, user_id=e7ead14590d74386aa14a8b41a8afc58, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:46.961507 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d93489-ee8b-480c-b4ec-0afc6f0e7ea4 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:47.077991 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 868/1750] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:46 2022] PUT /identity/v3/projects/1f94dd3b9a3942f3bb53b33b9b2cf3b3/users/e7ead14590d74386aa14a8b41a8afc58/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:47.090234 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742fd02-2c8d-43d2-ac51-0e465387140a None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:47.090646 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742fd02-2c8d-43d2-ac51-0e465387140a None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:47.091035 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742fd02-2c8d-43d2-ac51-0e465387140a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:47.247338 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-b742fd02-2c8d-43d2-ac51-0e465387140a None None] MFA Rules not processed for user `e7ead14590d74386aa14a8b41a8afc58`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:47.255459 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-b742fd02-2c8d-43d2-ac51-0e465387140a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:47.289053 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495d1a9-0e64-494c-9297-74bd79b0881f admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:47.531884 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 869/1751] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:47.537335 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742fd02-2c8d-43d2-ac51-0e465387140a None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:47.539380 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-b742fd02-2c8d-43d2-ac51-0e465387140a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:47.607314 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c296cbf-5f8a-44fa-b77e-de9433065513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:47.616454 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c296cbf-5f8a-44fa-b77e-de9433065513 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:47.627467 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c296cbf-5f8a-44fa-b77e-de9433065513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:47.627977 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c296cbf-5f8a-44fa-b77e-de9433065513 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:47.628770 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c296cbf-5f8a-44fa-b77e-de9433065513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:47.640106 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c296cbf-5f8a-44fa-b77e-de9433065513 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:47.718408 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 883/1752] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 814 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:47.726951 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c296cbf-5f8a-44fa-b77e-de9433065513 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:47.768283 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c296cbf-5f8a-44fa-b77e-de9433065513 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:47.819856 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb13a92-2f12-4baf-a221-b55659b0079d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:47.821656 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb13a92-2f12-4baf-a221-b55659b0079d admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:47.824885 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb13a92-2f12-4baf-a221-b55659b0079d admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:47.825327 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb13a92-2f12-4baf-a221-b55659b0079d admin admin] PATH_INFO: `/v3/projects/c70dad81a0d24620be115cc43e2342a5/users/cc72db46e95545feb682fcdcb9393a02/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:47.827476 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742fd02-2c8d-43d2-ac51-0e465387140a None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:47.848635 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba98bc5-3c20-40e9-a704-19d1fdd4addd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:47.849477 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba98bc5-3c20-40e9-a704-19d1fdd4addd admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:47.849877 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba98bc5-3c20-40e9-a704-19d1fdd4addd admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:47.850273 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba98bc5-3c20-40e9-a704-19d1fdd4addd admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:47.851111 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba98bc5-3c20-40e9-a704-19d1fdd4addd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:47.854685 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba98bc5-3c20-40e9-a704-19d1fdd4addd admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:47.873394 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb13a92-2f12-4baf-a221-b55659b0079d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70dad81a0d24620be115cc43e2342a5, user_id=cc72db46e95545feb682fcdcb9393a02, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:47.884168 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb13a92-2f12-4baf-a221-b55659b0079d admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:48.027372 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 884/1753] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:47 2022] PUT /identity/v3/projects/c70dad81a0d24620be115cc43e2342a5/users/cc72db46e95545feb682fcdcb9393a02/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:48.031847 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb13a92-2f12-4baf-a221-b55659b0079d admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:48.034166 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 870/1754] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:20:47 2022] POST /identity/v3/projects => generated 387 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:48.039162 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba98bc5-3c20-40e9-a704-19d1fdd4addd admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:48.258779 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb13a92-2f12-4baf-a221-b55659b0079d admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:48.264022 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba98bc5-3c20-40e9-a704-19d1fdd4addd admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:48.270672 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c830b-aa70-429c-87df-94f84e51b205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:48.272293 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c830b-aa70-429c-87df-94f84e51b205 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:48.273308 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c830b-aa70-429c-87df-94f84e51b205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:48.275283 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c830b-aa70-429c-87df-94f84e51b205 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:48.276382 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925febc-28f0-4016-9be9-730176ba3977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:48.278495 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925febc-28f0-4016-9be9-730176ba3977 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:48.279611 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c830b-aa70-429c-87df-94f84e51b205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:48.281472 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c830b-aa70-429c-87df-94f84e51b205 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:48.281997 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925febc-28f0-4016-9be9-730176ba3977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:48.282447 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925febc-28f0-4016-9be9-730176ba3977 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:48.284988 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925febc-28f0-4016-9be9-730176ba3977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:48.290809 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925febc-28f0-4016-9be9-730176ba3977 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:48.304660 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 885/1755] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:48.310694 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c830b-aa70-429c-87df-94f84e51b205 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:48.326287 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c830b-aa70-429c-87df-94f84e51b205 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:48.331812 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bdb6a-474d-4af8-bcb5-64302c09d9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:48.333092 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bdb6a-474d-4af8-bcb5-64302c09d9a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:48.333665 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bdb6a-474d-4af8-bcb5-64302c09d9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:48.334234 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bdb6a-474d-4af8-bcb5-64302c09d9a0 admin admin] PATH_INFO: `/v3/projects/c70dad81a0d24620be115cc43e2342a5/users/cc72db46e95545feb682fcdcb9393a02/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:48.337163 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bdb6a-474d-4af8-bcb5-64302c09d9a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70dad81a0d24620be115cc43e2342a5, user_id=cc72db46e95545feb682fcdcb9393a02, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:48.342477 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bdb6a-474d-4af8-bcb5-64302c09d9a0 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:48.354356 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 886/1756] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:48 2022] PUT /identity/v3/projects/c70dad81a0d24620be115cc43e2342a5/users/cc72db46e95545feb682fcdcb9393a02/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:48.366810 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf533ba-d129-499e-ab7e-d332c871eb01 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:48.367106 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf533ba-d129-499e-ab7e-d332c871eb01 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:48.367584 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf533ba-d129-499e-ab7e-d332c871eb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:48.429782 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 871/1757] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:20:48 2022] POST /identity/v3/users => generated 294 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:48.434620 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925febc-28f0-4016-9be9-730176ba3977 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:48.449671 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925febc-28f0-4016-9be9-730176ba3977 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:48.467323 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-0bf533ba-d129-499e-ab7e-d332c871eb01 None None] MFA Rules not processed for user `cc72db46e95545feb682fcdcb9393a02`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:48.468577 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-0bf533ba-d129-499e-ab7e-d332c871eb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:48.586803 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e5a3c-f621-4afa-aacb-2b1ddcfcc50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:48.588990 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e5a3c-f621-4afa-aacb-2b1ddcfcc50c admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:48.589785 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e5a3c-f621-4afa-aacb-2b1ddcfcc50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:48.590369 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e5a3c-f621-4afa-aacb-2b1ddcfcc50c admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:48.591907 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e5a3c-f621-4afa-aacb-2b1ddcfcc50c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:48.594638 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e5a3c-f621-4afa-aacb-2b1ddcfcc50c admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:48.632728 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 872/1758] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:48.637083 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e5a3c-f621-4afa-aacb-2b1ddcfcc50c admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:48.663802 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e5a3c-f621-4afa-aacb-2b1ddcfcc50c admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:48.685527 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 887/1759] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:48 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:20:48.686791 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836dfbae-bffb-4680-8ea4-d1aca38c7372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:48.687691 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836dfbae-bffb-4680-8ea4-d1aca38c7372 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:48.688249 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836dfbae-bffb-4680-8ea4-d1aca38c7372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:48.688530 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836dfbae-bffb-4680-8ea4-d1aca38c7372 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:48.695341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836dfbae-bffb-4680-8ea4-d1aca38c7372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:48.699454 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836dfbae-bffb-4680-8ea4-d1aca38c7372 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:48.701856 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf533ba-d129-499e-ab7e-d332c871eb01 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:48.708121 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-0bf533ba-d129-499e-ab7e-d332c871eb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:48.748460 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 873/1760] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:48.751703 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836dfbae-bffb-4680-8ea4-d1aca38c7372 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:48.789586 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836dfbae-bffb-4680-8ea4-d1aca38c7372 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:48.802103 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956d70a-66e2-4d41-810c-9f213283d6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:48.803427 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956d70a-66e2-4d41-810c-9f213283d6c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:48.803829 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956d70a-66e2-4d41-810c-9f213283d6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:48.804275 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956d70a-66e2-4d41-810c-9f213283d6c7 admin admin] PATH_INFO: `/v3/projects/41bfb86970864001bd75d4d39eabeff4/users/b2d71e340b34417783d77a447e85aed5/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:48.810149 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf533ba-d129-499e-ab7e-d332c871eb01 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:48.820757 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7adbe8e-69eb-45a7-965d-1ff3ae5114c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:48.824056 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adbe8e-69eb-45a7-965d-1ff3ae5114c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:48.824056 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adbe8e-69eb-45a7-965d-1ff3ae5114c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:48.824056 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adbe8e-69eb-45a7-965d-1ff3ae5114c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:48.842580 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956d70a-66e2-4d41-810c-9f213283d6c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41bfb86970864001bd75d4d39eabeff4, user_id=b2d71e340b34417783d77a447e85aed5, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:48.843299 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7adbe8e-69eb-45a7-965d-1ff3ae5114c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:48.844958 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7adbe8e-69eb-45a7-965d-1ff3ae5114c7 service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:48.851222 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956d70a-66e2-4d41-810c-9f213283d6c7 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:48.868384 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 888/1761] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:48 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:48.938939 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 874/1762] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:48 2022] PUT /identity/v3/projects/41bfb86970864001bd75d4d39eabeff4/users/b2d71e340b34417783d77a447e85aed5/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:48.950912 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b2f28-ff64-4cef-8a52-6b4aacaf27ab None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:48.951223 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b2f28-ff64-4cef-8a52-6b4aacaf27ab None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:48.951483 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b2f28-ff64-4cef-8a52-6b4aacaf27ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:49.006261 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfab60-7113-4f2a-ae80-535469828603 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:49.006261 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfab60-7113-4f2a-ae80-535469828603 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:49.006261 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfab60-7113-4f2a-ae80-535469828603 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:49.019326 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 875/1763] 10.222.0.43 () {54 vars in 921 bytes} [Tue Mar 29 20:20:48 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:20:49.024134 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130f6c5-cb49-4d3a-822c-c27d03c0c96a None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:49.028563 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130f6c5-cb49-4d3a-822c-c27d03c0c96a None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:49.028563 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130f6c5-cb49-4d3a-822c-c27d03c0c96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:49.095387 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-c41b2f28-ff64-4cef-8a52-6b4aacaf27ab None None] MFA Rules not processed for user `b2d71e340b34417783d77a447e85aed5`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:49.096751 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-e130f6c5-cb49-4d3a-822c-c27d03c0c96a None None] MFA Rules not processed for user `b797e15939694c9abf1f2b8e9aee4d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:49.097577 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-c41b2f28-ff64-4cef-8a52-6b4aacaf27ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:49.098514 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-e130f6c5-cb49-4d3a-822c-c27d03c0c96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:49.257475 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 876/1764] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Mar 29 20:20:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:49.260518 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130f6c5-cb49-4d3a-822c-c27d03c0c96a None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:49.288486 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 889/1765] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:49.295758 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b2f28-ff64-4cef-8a52-6b4aacaf27ab None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:49.414182 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130f6c5-cb49-4d3a-822c-c27d03c0c96a None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:49.424713 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94356af-58e3-4390-8134-acbfcbd02735 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:49.426866 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94356af-58e3-4390-8134-acbfcbd02735 service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:49.428985 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94356af-58e3-4390-8134-acbfcbd02735 service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:49.429562 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94356af-58e3-4390-8134-acbfcbd02735 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:49.435571 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-b94356af-58e3-4390-8134-acbfcbd02735 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:49.471410 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b2f28-ff64-4cef-8a52-6b4aacaf27ab None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:49.482701 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cda57-01f6-4b92-81a7-241e6b12812b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:49.486989 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cda57-01f6-4b92-81a7-241e6b12812b admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:49.487483 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cda57-01f6-4b92-81a7-241e6b12812b admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:49.490465 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cda57-01f6-4b92-81a7-241e6b12812b admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:49.492128 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091cda57-01f6-4b92-81a7-241e6b12812b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:49.497432 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091cda57-01f6-4b92-81a7-241e6b12812b admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:49.586246 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94356af-58e3-4390-8134-acbfcbd02735 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:49.587830 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94356af-58e3-4390-8134-acbfcbd02735 service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:49.614403 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 877/1766] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:49 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:49.641215 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 890/1767] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:20:49 2022] POST /identity/v3/projects => generated 387 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:49.646443 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94356af-58e3-4390-8134-acbfcbd02735 service cinder] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:49.663735 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94356af-58e3-4390-8134-acbfcbd02735 service cinder] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:49.788638 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fac90-c629-4a23-b108-a8c13ea407cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:49.796254 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fac90-c629-4a23-b108-a8c13ea407cb admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:49.796254 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fac90-c629-4a23-b108-a8c13ea407cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:49.796254 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fac90-c629-4a23-b108-a8c13ea407cb admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:49.796254 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fac90-c629-4a23-b108-a8c13ea407cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:49.796254 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fac90-c629-4a23-b108-a8c13ea407cb admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:49.826939 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cda57-01f6-4b92-81a7-241e6b12812b admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:49.829171 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-091cda57-01f6-4b92-81a7-241e6b12812b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:49.891221 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 878/1768] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:20:49 2022] POST /identity/v3/users => generated 300 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:49.893776 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fac90-c629-4a23-b108-a8c13ea407cb admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:49.909031 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fac90-c629-4a23-b108-a8c13ea407cb admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:49.921545 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766eeca-2218-4825-84e6-ac6cea07a346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:49.921545 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766eeca-2218-4825-84e6-ac6cea07a346 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:49.922202 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766eeca-2218-4825-84e6-ac6cea07a346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:49.923696 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766eeca-2218-4825-84e6-ac6cea07a346 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:49.927822 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766eeca-2218-4825-84e6-ac6cea07a346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:49.931628 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766eeca-2218-4825-84e6-ac6cea07a346 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:49.959888 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 879/1769] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:49.963280 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766eeca-2218-4825-84e6-ac6cea07a346 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:49.994778 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766eeca-2218-4825-84e6-ac6cea07a346 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:50.026194 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbed96-211f-4bd8-a4fe-120fda75fc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:50.028539 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbed96-211f-4bd8-a4fe-120fda75fc9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:50.028836 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbed96-211f-4bd8-a4fe-120fda75fc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:50.030642 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbed96-211f-4bd8-a4fe-120fda75fc9f admin admin] PATH_INFO: `/v3/projects/de64370b47544757b8ef53ad395f723d/users/d54b095982834ef6891ff8ac26d9448e/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:50.074341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbed96-211f-4bd8-a4fe-120fda75fc9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=de64370b47544757b8ef53ad395f723d, user_id=d54b095982834ef6891ff8ac26d9448e, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:50.081211 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbed96-211f-4bd8-a4fe-120fda75fc9f admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:50.088609 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cda57-01f6-4b92-81a7-241e6b12812b admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:50.176380 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 880/1770] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:49 2022] PUT /identity/v3/projects/de64370b47544757b8ef53ad395f723d/users/d54b095982834ef6891ff8ac26d9448e/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:50.180560 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbeef97-25db-4649-a02d-fb1c23bb625e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:50.183842 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbed96-211f-4bd8-a4fe-120fda75fc9f admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:50.184758 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbeef97-25db-4649-a02d-fb1c23bb625e service nova] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:50.188449 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbeef97-25db-4649-a02d-fb1c23bb625e service nova] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:50.190089 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbeef97-25db-4649-a02d-fb1c23bb625e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:50.226252 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbeef97-25db-4649-a02d-fb1c23bb625e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:50.227665 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbeef97-25db-4649-a02d-fb1c23bb625e service nova] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:50.258901 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 891/1771] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:20:50.497112 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbed96-211f-4bd8-a4fe-120fda75fc9f admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:50.522687 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9bb233-aeb2-4cf2-8dc0-ff63990a84b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:50.522687 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bb233-aeb2-4cf2-8dc0-ff63990a84b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:50.522687 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bb233-aeb2-4cf2-8dc0-ff63990a84b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:50.522687 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bb233-aeb2-4cf2-8dc0-ff63990a84b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:50.523099 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9bb233-aeb2-4cf2-8dc0-ff63990a84b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:50.523099 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9bb233-aeb2-4cf2-8dc0-ff63990a84b7 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:50.578081 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 881/1772] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:50.582820 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbeef97-25db-4649-a02d-fb1c23bb625e service nova] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:50.604436 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbeef97-25db-4649-a02d-fb1c23bb625e service nova] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:50.618499 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcafe94-34df-4c4e-a961-daf4458114eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:50.621641 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcafe94-34df-4c4e-a961-daf4458114eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:50.622146 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcafe94-34df-4c4e-a961-daf4458114eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:50.624324 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcafe94-34df-4c4e-a961-daf4458114eb admin admin] PATH_INFO: `/v3/projects/de64370b47544757b8ef53ad395f723d/users/d54b095982834ef6891ff8ac26d9448e/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:50.628012 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcafe94-34df-4c4e-a961-daf4458114eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=de64370b47544757b8ef53ad395f723d, user_id=d54b095982834ef6891ff8ac26d9448e, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:50.636492 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcafe94-34df-4c4e-a961-daf4458114eb admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:50.666431 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 892/1773] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:50 2022] PUT /identity/v3/projects/de64370b47544757b8ef53ad395f723d/users/d54b095982834ef6891ff8ac26d9448e/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:50.677804 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d33b37-a410-48f7-bba8-755073313270 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:50.678818 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d33b37-a410-48f7-bba8-755073313270 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:50.679381 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d33b37-a410-48f7-bba8-755073313270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:50.761089 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-73d33b37-a410-48f7-bba8-755073313270 None None] MFA Rules not processed for user `d54b095982834ef6891ff8ac26d9448e`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:50.767363 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-73d33b37-a410-48f7-bba8-755073313270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:50.898178 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcafe94-34df-4c4e-a961-daf4458114eb admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:50.899953 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-6bcafe94-34df-4c4e-a961-daf4458114eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:50.980182 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 882/1774] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:20:50.984940 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d33b37-a410-48f7-bba8-755073313270 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:51.122712 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcafe94-34df-4c4e-a961-daf4458114eb admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:51.141810 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ba558-9d47-4a42-8f67-eb6fff422194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:51.142780 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ba558-9d47-4a42-8f67-eb6fff422194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:51.143116 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ba558-9d47-4a42-8f67-eb6fff422194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:51.143404 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ba558-9d47-4a42-8f67-eb6fff422194 admin admin] PATH_INFO: `/v3/projects/262026840f1142bcb842c61c9498a766` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:51.150940 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ba558-9d47-4a42-8f67-eb6fff422194 admin admin] RBAC: Authorizing `identity:delete_project(project_id=262026840f1142bcb842c61c9498a766)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:51.152936 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ba558-9d47-4a42-8f67-eb6fff422194 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:51.154684 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d33b37-a410-48f7-bba8-755073313270 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:51.170639 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd401b9-051e-44d3-8d6f-fc30f073b54f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:51.171417 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd401b9-051e-44d3-8d6f-fc30f073b54f service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:51.171785 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd401b9-051e-44d3-8d6f-fc30f073b54f service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:51.172180 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd401b9-051e-44d3-8d6f-fc30f073b54f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:51.187326 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd401b9-051e-44d3-8d6f-fc30f073b54f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:51.192055 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd401b9-051e-44d3-8d6f-fc30f073b54f service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:51.229756 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 883/1775] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:51.352316 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f19ba558-9d47-4a42-8f67-eb6fff422194 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '262026840f1142bcb842c61c9498a766', 'request_id': 'req-f19ba558-9d47-4a42-8f67-eb6fff422194'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:51.360310 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f19ba558-9d47-4a42-8f67-eb6fff422194 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '262026840f1142bcb842c61c9498a766', 'request_id': 'req-f19ba558-9d47-4a42-8f67-eb6fff422194'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:51.378981 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f19ba558-9d47-4a42-8f67-eb6fff422194 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '262026840f1142bcb842c61c9498a766', 'request_id': 'req-f19ba558-9d47-4a42-8f67-eb6fff422194'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:51.471511 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f19ba558-9d47-4a42-8f67-eb6fff422194 admin admin] The token cache is being invalidate because project 262026840f1142bcb842c61c9498a766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:20:51.474465 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f19ba558-9d47-4a42-8f67-eb6fff422194 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:51.474465 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f19ba558-9d47-4a42-8f67-eb6fff422194 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:51.477481 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 893/1776] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:20:50 2022] DELETE /identity/v3/projects/262026840f1142bcb842c61c9498a766 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:20:51.478385 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd401b9-051e-44d3-8d6f-fc30f073b54f service cinder] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:51.499038 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd401b9-051e-44d3-8d6f-fc30f073b54f service cinder] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:51.730330 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aef743-cc7e-4616-8350-e4cc62295474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:51.734778 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aef743-cc7e-4616-8350-e4cc62295474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:51.735126 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aef743-cc7e-4616-8350-e4cc62295474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:51.738072 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aef743-cc7e-4616-8350-e4cc62295474 admin admin] PATH_INFO: `/v3/users/a399194927fc4f9db106eebb33d12981` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:51.741644 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aef743-cc7e-4616-8350-e4cc62295474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a399194927fc4f9db106eebb33d12981)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:51.755185 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aef743-cc7e-4616-8350-e4cc62295474 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:52.007620 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-49aef743-cc7e-4616-8350-e4cc62295474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a399194927fc4f9db106eebb33d12981'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:52.142476 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-49aef743-cc7e-4616-8350-e4cc62295474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a399194927fc4f9db106eebb33d12981'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:52.145113 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-49aef743-cc7e-4616-8350-e4cc62295474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a399194927fc4f9db106eebb33d12981'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:52.178047 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-49aef743-cc7e-4616-8350-e4cc62295474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a399194927fc4f9db106eebb33d12981'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:52.246200 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-49aef743-cc7e-4616-8350-e4cc62295474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a399194927fc4f9db106eebb33d12981'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:52.269663 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 884/1777] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:20:51 2022] DELETE /identity/v3/users/a399194927fc4f9db106eebb33d12981 => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:20:52.561461 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a9325-6d8c-4f59-9f54-9241ccf0a12b None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:52.561461 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a9325-6d8c-4f59-9f54-9241ccf0a12b None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:52.561461 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a9325-6d8c-4f59-9f54-9241ccf0a12b None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:52.562735 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 894/1778] 10.222.0.43 () {54 vars in 921 bytes} [Tue Mar 29 20:20:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:20:52.601104 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aef743-cc7e-4616-8350-e4cc62295474 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:52.603271 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-49aef743-cc7e-4616-8350-e4cc62295474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:52.671100 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c73e21-44a2-4795-96a6-c0735ffc847f None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:52.671487 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c73e21-44a2-4795-96a6-c0735ffc847f None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:52.671840 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c73e21-44a2-4795-96a6-c0735ffc847f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:52.725824 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-58c73e21-44a2-4795-96a6-c0735ffc847f None None] MFA Rules not processed for user `b797e15939694c9abf1f2b8e9aee4d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:52.728620 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-58c73e21-44a2-4795-96a6-c0735ffc847f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:52.790237 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aef743-cc7e-4616-8350-e4cc62295474 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:52.820670 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed9222-81e2-468e-ae5e-679d1d869933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:52.826338 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed9222-81e2-468e-ae5e-679d1d869933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:52.827311 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed9222-81e2-468e-ae5e-679d1d869933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:52.827731 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed9222-81e2-468e-ae5e-679d1d869933 admin admin] PATH_INFO: `/v3/projects/5df6824e53124134a2b3b454152865d3` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:52.834495 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed9222-81e2-468e-ae5e-679d1d869933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5df6824e53124134a2b3b454152865d3)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:52.840281 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed9222-81e2-468e-ae5e-679d1d869933 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:53.000376 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 895/1779] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Mar 29 20:20:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:53.137253 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-35ed9222-81e2-468e-ae5e-679d1d869933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5df6824e53124134a2b3b454152865d3', 'request_id': 'req-35ed9222-81e2-468e-ae5e-679d1d869933'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:53.199329 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c73e21-44a2-4795-96a6-c0735ffc847f None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:53.201159 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-58c73e21-44a2-4795-96a6-c0735ffc847f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:53.218970 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-35ed9222-81e2-468e-ae5e-679d1d869933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5df6824e53124134a2b3b454152865d3', 'request_id': 'req-35ed9222-81e2-468e-ae5e-679d1d869933'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:53.229597 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-35ed9222-81e2-468e-ae5e-679d1d869933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5df6824e53124134a2b3b454152865d3', 'request_id': 'req-35ed9222-81e2-468e-ae5e-679d1d869933'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:53.260604 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-35ed9222-81e2-468e-ae5e-679d1d869933 admin admin] The token cache is being invalidate because project 5df6824e53124134a2b3b454152865d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:20:53.261134 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-35ed9222-81e2-468e-ae5e-679d1d869933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:53.262272 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-35ed9222-81e2-468e-ae5e-679d1d869933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:53.265453 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 885/1780] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:20:52 2022] DELETE /identity/v3/projects/5df6824e53124134a2b3b454152865d3 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:53.275871 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed9222-81e2-468e-ae5e-679d1d869933 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:53.275871 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-35ed9222-81e2-468e-ae5e-679d1d869933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:53.354097 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c73e21-44a2-4795-96a6-c0735ffc847f None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:53.459309 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed9222-81e2-468e-ae5e-679d1d869933 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:53.465061 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc38b5f-e83f-4c17-93b3-50610387580e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:53.466073 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc38b5f-e83f-4c17-93b3-50610387580e service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:53.466508 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc38b5f-e83f-4c17-93b3-50610387580e service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:53.466876 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc38b5f-e83f-4c17-93b3-50610387580e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:53.472351 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-2fc38b5f-e83f-4c17-93b3-50610387580e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:53.476500 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93f82d-41eb-49ff-8e48-ac1350e42f9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:53.477447 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93f82d-41eb-49ff-8e48-ac1350e42f9a service nova] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:53.478097 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93f82d-41eb-49ff-8e48-ac1350e42f9a service nova] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:53.479088 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93f82d-41eb-49ff-8e48-ac1350e42f9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:53.481664 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-1f93f82d-41eb-49ff-8e48-ac1350e42f9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:53.499239 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93f82d-41eb-49ff-8e48-ac1350e42f9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:53.505662 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93f82d-41eb-49ff-8e48-ac1350e42f9a service nova] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:53.522055 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 886/1781] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:53.526062 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900118b-abde-4b6a-8803-8047d95c7291 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:53.526481 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900118b-abde-4b6a-8803-8047d95c7291 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:53.527723 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900118b-abde-4b6a-8803-8047d95c7291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:53.578761 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-d900118b-abde-4b6a-8803-8047d95c7291 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:53.584391 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-d900118b-abde-4b6a-8803-8047d95c7291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:53.653455 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc38b5f-e83f-4c17-93b3-50610387580e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:53.660321 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc38b5f-e83f-4c17-93b3-50610387580e service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:53.704809 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 896/1782] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:20:53.785531 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 887/1783] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:53.793357 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fd732-17f9-4ba9-8139-de0318aa111c None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:53.793660 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fd732-17f9-4ba9-8139-de0318aa111c None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:53.793957 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fd732-17f9-4ba9-8139-de0318aa111c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:53.854909 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-924fd732-17f9-4ba9-8139-de0318aa111c None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:53.857168 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-924fd732-17f9-4ba9-8139-de0318aa111c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:53.887338 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 897/1784] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:53.894925 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900118b-abde-4b6a-8803-8047d95c7291 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:53.910556 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900118b-abde-4b6a-8803-8047d95c7291 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:53.952409 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba417c0d-f3e0-4fd0-9d8f-4e3fc428f091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:53.955092 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba417c0d-f3e0-4fd0-9d8f-4e3fc428f091 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:53.955821 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba417c0d-f3e0-4fd0-9d8f-4e3fc428f091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:53.956117 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba417c0d-f3e0-4fd0-9d8f-4e3fc428f091 admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:53.956881 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba417c0d-f3e0-4fd0-9d8f-4e3fc428f091 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:20:53.959799 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba417c0d-f3e0-4fd0-9d8f-4e3fc428f091 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:53.960173 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba417c0d-f3e0-4fd0-9d8f-4e3fc428f091 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:54.015217 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fd732-17f9-4ba9-8139-de0318aa111c None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:54.033532 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fd732-17f9-4ba9-8139-de0318aa111c None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:54.034633 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 888/1785] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:20:54.051107 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81a847-6765-40b3-8d9f-2a12491191bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:54.054379 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81a847-6765-40b3-8d9f-2a12491191bd admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:54.054675 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81a847-6765-40b3-8d9f-2a12491191bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:54.057633 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81a847-6765-40b3-8d9f-2a12491191bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:54.061612 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81a847-6765-40b3-8d9f-2a12491191bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:54.066787 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81a847-6765-40b3-8d9f-2a12491191bd admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:54.236701 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 898/1786] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:20:54 2022] POST /identity/v3/projects => generated 361 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:54.240942 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba417c0d-f3e0-4fd0-9d8f-4e3fc428f091 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:54.255772 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba417c0d-f3e0-4fd0-9d8f-4e3fc428f091 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:54.456422 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405860c7-5ba3-469b-a142-ab75c9960f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:54.460793 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405860c7-5ba3-469b-a142-ab75c9960f72 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:54.460793 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405860c7-5ba3-469b-a142-ab75c9960f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:54.460793 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405860c7-5ba3-469b-a142-ab75c9960f72 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:54.461810 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405860c7-5ba3-469b-a142-ab75c9960f72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:54.465027 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405860c7-5ba3-469b-a142-ab75c9960f72 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:54.648435 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 889/1787] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:20:54 2022] POST /identity/v3/users => generated 281 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:54.652808 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81a847-6765-40b3-8d9f-2a12491191bd admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:54.674175 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81a847-6765-40b3-8d9f-2a12491191bd admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:54.725679 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e28c76-5b71-4dfa-b4bc-c2677fb772b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:54.726430 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e28c76-5b71-4dfa-b4bc-c2677fb772b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:54.726716 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e28c76-5b71-4dfa-b4bc-c2677fb772b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:54.726997 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e28c76-5b71-4dfa-b4bc-c2677fb772b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:54.729133 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e28c76-5b71-4dfa-b4bc-c2677fb772b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:54.734741 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e28c76-5b71-4dfa-b4bc-c2677fb772b7 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:54.743371 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405860c7-5ba3-469b-a142-ab75c9960f72 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:54.745668 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-405860c7-5ba3-469b-a142-ab75c9960f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:54.773345 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405860c7-5ba3-469b-a142-ab75c9960f72 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:54.785411 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 899/1788] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:54.786401 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e28c76-5b71-4dfa-b4bc-c2677fb772b7 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:54.802340 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596499d9-d79f-4142-9da4-c148be68e815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:54.805523 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596499d9-d79f-4142-9da4-c148be68e815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:54.807213 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596499d9-d79f-4142-9da4-c148be68e815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:54.807989 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596499d9-d79f-4142-9da4-c148be68e815 admin admin] PATH_INFO: `/v3/projects/e8abd2ddc26644b983446522399da027` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:54.811320 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596499d9-d79f-4142-9da4-c148be68e815 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8abd2ddc26644b983446522399da027)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:54.817578 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596499d9-d79f-4142-9da4-c148be68e815 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:54.823331 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e28c76-5b71-4dfa-b4bc-c2677fb772b7 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:54.835573 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b64f1-d43b-4373-a838-27e1dbabbacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:54.836567 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b64f1-d43b-4373-a838-27e1dbabbacf admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:54.836567 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b64f1-d43b-4373-a838-27e1dbabbacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:54.836828 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b64f1-d43b-4373-a838-27e1dbabbacf admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:54.839334 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b64f1-d43b-4373-a838-27e1dbabbacf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:54.841901 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b64f1-d43b-4373-a838-27e1dbabbacf admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:54.873397 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 900/1789] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:54.879069 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b64f1-d43b-4373-a838-27e1dbabbacf admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:54.896335 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b64f1-d43b-4373-a838-27e1dbabbacf admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:54.913264 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75db92-ccef-48b3-a78c-8b97b9b5add7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:54.914204 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75db92-ccef-48b3-a78c-8b97b9b5add7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:54.914496 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75db92-ccef-48b3-a78c-8b97b9b5add7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:54.914781 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75db92-ccef-48b3-a78c-8b97b9b5add7 admin admin] PATH_INFO: `/v3/projects/e10ca96f063a456e840cd1245a4308e3/users/0a98f8e29d6a496e9333591f2824b786/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:54.957016 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75db92-ccef-48b3-a78c-8b97b9b5add7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e10ca96f063a456e840cd1245a4308e3, user_id=0a98f8e29d6a496e9333591f2824b786, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:54.959787 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75db92-ccef-48b3-a78c-8b97b9b5add7 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:54.970815 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-596499d9-d79f-4142-9da4-c148be68e815 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8abd2ddc26644b983446522399da027', 'request_id': 'req-596499d9-d79f-4142-9da4-c148be68e815'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:55.054749 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 901/1790] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:54 2022] PUT /identity/v3/projects/e10ca96f063a456e840cd1245a4308e3/users/0a98f8e29d6a496e9333591f2824b786/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:55.070634 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6e351-69a6-4b0e-b550-9936878a0a9a None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:55.071623 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6e351-69a6-4b0e-b550-9936878a0a9a None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:55.072219 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6e351-69a6-4b0e-b550-9936878a0a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:55.076174 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-596499d9-d79f-4142-9da4-c148be68e815 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8abd2ddc26644b983446522399da027', 'request_id': 'req-596499d9-d79f-4142-9da4-c148be68e815'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:55.083628 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-596499d9-d79f-4142-9da4-c148be68e815 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8abd2ddc26644b983446522399da027', 'request_id': 'req-596499d9-d79f-4142-9da4-c148be68e815'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:55.108666 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-596499d9-d79f-4142-9da4-c148be68e815 admin admin] The token cache is being invalidate because project e8abd2ddc26644b983446522399da027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:20:55.109067 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-596499d9-d79f-4142-9da4-c148be68e815 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:55.109864 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-596499d9-d79f-4142-9da4-c148be68e815 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:55.121944 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 890/1791] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:20:54 2022] DELETE /identity/v3/projects/e8abd2ddc26644b983446522399da027 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:55.123516 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0356e-2d4a-4e51-beb3-6358a5620e50 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:55.123891 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0356e-2d4a-4e51-beb3-6358a5620e50 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:55.124253 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0356e-2d4a-4e51-beb3-6358a5620e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:55.156918 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-e3c6e351-69a6-4b0e-b550-9936878a0a9a None None] MFA Rules not processed for user `0a98f8e29d6a496e9333591f2824b786`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:55.158811 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e3c6e351-69a6-4b0e-b550-9936878a0a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:55.165402 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-15b0356e-2d4a-4e51-beb3-6358a5620e50 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:55.166982 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-15b0356e-2d4a-4e51-beb3-6358a5620e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:55.301955 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 891/1792] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:55.315344 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca17ac-3ad4-4d5a-9e9f-a214bc162193 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:55.329336 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca17ac-3ad4-4d5a-9e9f-a214bc162193 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:55.329336 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca17ac-3ad4-4d5a-9e9f-a214bc162193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:55.357817 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 902/1793] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:20:55.359456 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6e351-69a6-4b0e-b550-9936878a0a9a None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:55.362001 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e3c6e351-69a6-4b0e-b550-9936878a0a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:55.392632 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-13ca17ac-3ad4-4d5a-9e9f-a214bc162193 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:55.394626 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6e351-69a6-4b0e-b550-9936878a0a9a None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:55.396683 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-13ca17ac-3ad4-4d5a-9e9f-a214bc162193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:55.427572 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 892/1794] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:55.432503 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca17ac-3ad4-4d5a-9e9f-a214bc162193 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:55.432791 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a101c4-6db0-4971-bfc1-5aa62dd065e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:55.436511 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a101c4-6db0-4971-bfc1-5aa62dd065e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:55.436878 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a101c4-6db0-4971-bfc1-5aa62dd065e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:55.437276 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a101c4-6db0-4971-bfc1-5aa62dd065e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:55.438355 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a101c4-6db0-4971-bfc1-5aa62dd065e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:55.444687 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a101c4-6db0-4971-bfc1-5aa62dd065e1 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:55.463335 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca17ac-3ad4-4d5a-9e9f-a214bc162193 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:55.482785 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58b340-86c4-41d6-ab3a-9d47aa56b1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:55.484558 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58b340-86c4-41d6-ab3a-9d47aa56b1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:55.484838 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58b340-86c4-41d6-ab3a-9d47aa56b1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:55.506658 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58b340-86c4-41d6-ab3a-9d47aa56b1e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:55.507665 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58b340-86c4-41d6-ab3a-9d47aa56b1e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:20:55.508761 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58b340-86c4-41d6-ab3a-9d47aa56b1e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:55.510571 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58b340-86c4-41d6-ab3a-9d47aa56b1e0 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:55.533783 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 893/1795] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:20:55.538090 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58b340-86c4-41d6-ab3a-9d47aa56b1e0 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:55.556298 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58b340-86c4-41d6-ab3a-9d47aa56b1e0 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:55.561834 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fe0be-843c-4f79-94cd-0f10c7b802e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:55.562686 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fe0be-843c-4f79-94cd-0f10c7b802e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:55.563356 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fe0be-843c-4f79-94cd-0f10c7b802e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:55.563766 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fe0be-843c-4f79-94cd-0f10c7b802e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:55.564647 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274fe0be-843c-4f79-94cd-0f10c7b802e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:55.566795 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274fe0be-843c-4f79-94cd-0f10c7b802e7 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:55.589169 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 903/1796] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:20:55 2022] POST /identity/v3/projects => generated 363 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:55.593948 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a101c4-6db0-4971-bfc1-5aa62dd065e1 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:55.678865 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 894/1797] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:20:55 2022] POST /identity/v3/projects => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:20:55.680753 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fe0be-843c-4f79-94cd-0f10c7b802e7 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:55.699807 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a101c4-6db0-4971-bfc1-5aa62dd065e1 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:55.781360 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466446fb-c789-453b-81a1-8de17a0179d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:55.781360 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466446fb-c789-453b-81a1-8de17a0179d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:55.790322 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466446fb-c789-453b-81a1-8de17a0179d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:55.793580 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466446fb-c789-453b-81a1-8de17a0179d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:55.793580 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466446fb-c789-453b-81a1-8de17a0179d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:55.794450 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466446fb-c789-453b-81a1-8de17a0179d4 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:55.895387 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 904/1798] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:20:55 2022] POST /identity/v3/users => generated 288 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:55.898200 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466446fb-c789-453b-81a1-8de17a0179d4 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:55.925541 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466446fb-c789-453b-81a1-8de17a0179d4 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:55.942965 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fe0be-843c-4f79-94cd-0f10c7b802e7 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:55.956734 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676e045-7b68-4887-89f4-53a3554546e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:55.957784 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676e045-7b68-4887-89f4-53a3554546e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:55.958002 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676e045-7b68-4887-89f4-53a3554546e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:55.958403 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676e045-7b68-4887-89f4-53a3554546e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:55.958486 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1d512-9eb3-44dc-aad6-e16bc0201e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:55.958895 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676e045-7b68-4887-89f4-53a3554546e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:55.964488 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676e045-7b68-4887-89f4-53a3554546e5 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:55.965025 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1d512-9eb3-44dc-aad6-e16bc0201e62 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:55.965521 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1d512-9eb3-44dc-aad6-e16bc0201e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:55.965877 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1d512-9eb3-44dc-aad6-e16bc0201e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:55.966977 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1d512-9eb3-44dc-aad6-e16bc0201e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:55.970404 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1d512-9eb3-44dc-aad6-e16bc0201e62 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:55.987013 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 905/1799] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:20:55.989109 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1d512-9eb3-44dc-aad6-e16bc0201e62 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:56.026212 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1d512-9eb3-44dc-aad6-e16bc0201e62 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:56.046816 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86f29a-f683-42d7-9247-1a2defb35e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:56.049443 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86f29a-f683-42d7-9247-1a2defb35e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:56.050609 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86f29a-f683-42d7-9247-1a2defb35e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:56.052297 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86f29a-f683-42d7-9247-1a2defb35e32 admin admin] PATH_INFO: `/v3/projects/2753288332784ccdb2094009424fb259/users/9680844043ef4d2db769acc6b222fe57/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:56.079996 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 895/1800] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:20:55 2022] POST /identity/v3/users => generated 284 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:56.084305 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676e045-7b68-4887-89f4-53a3554546e5 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:56.095987 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676e045-7b68-4887-89f4-53a3554546e5 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:56.102036 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed81a4-38a1-4372-9a99-f3d543c11f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:56.106619 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed81a4-38a1-4372-9a99-f3d543c11f26 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:56.106619 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed81a4-38a1-4372-9a99-f3d543c11f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:56.106619 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed81a4-38a1-4372-9a99-f3d543c11f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:56.106619 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed81a4-38a1-4372-9a99-f3d543c11f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:56.106619 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed81a4-38a1-4372-9a99-f3d543c11f26 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:56.114565 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86f29a-f683-42d7-9247-1a2defb35e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2753288332784ccdb2094009424fb259, user_id=9680844043ef4d2db769acc6b222fe57, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:56.125323 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86f29a-f683-42d7-9247-1a2defb35e32 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:56.142314 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 896/1801] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:56.143454 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed81a4-38a1-4372-9a99-f3d543c11f26 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:56.170711 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed81a4-38a1-4372-9a99-f3d543c11f26 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:56.180378 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d945e8-7f71-486a-afec-640688bb2bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:56.181511 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d945e8-7f71-486a-afec-640688bb2bdb admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:56.181969 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d945e8-7f71-486a-afec-640688bb2bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:56.182437 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d945e8-7f71-486a-afec-640688bb2bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:56.185082 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d945e8-7f71-486a-afec-640688bb2bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:56.187245 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d945e8-7f71-486a-afec-640688bb2bdb admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:56.217696 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 906/1802] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:55 2022] PUT /identity/v3/projects/2753288332784ccdb2094009424fb259/users/9680844043ef4d2db769acc6b222fe57/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:56.219169 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86f29a-f683-42d7-9247-1a2defb35e32 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:56.228189 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 897/1803] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:56.232330 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d945e8-7f71-486a-afec-640688bb2bdb admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:56.252324 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d945e8-7f71-486a-afec-640688bb2bdb admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:56.385727 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a0a5a-751d-4438-b342-b00e2fff6d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:56.386722 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a0a5a-751d-4438-b342-b00e2fff6d75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:56.391395 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a0a5a-751d-4438-b342-b00e2fff6d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:56.391395 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a0a5a-751d-4438-b342-b00e2fff6d75 admin admin] PATH_INFO: `/v3/projects/02a64bbc2ae349a6a3d76689cb7e8403/users/be5f3736a6ce4ef19d51b4e3c8b60e97/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:56.409972 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86f29a-f683-42d7-9247-1a2defb35e32 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:56.412777 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a0a5a-751d-4438-b342-b00e2fff6d75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02a64bbc2ae349a6a3d76689cb7e8403, user_id=be5f3736a6ce4ef19d51b4e3c8b60e97, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:56.415624 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a0a5a-751d-4438-b342-b00e2fff6d75 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:56.426093 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f25dc-5733-41c5-bc79-4e92eb045e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:56.426905 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f25dc-5733-41c5-bc79-4e92eb045e87 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:56.427368 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f25dc-5733-41c5-bc79-4e92eb045e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:56.427656 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f25dc-5733-41c5-bc79-4e92eb045e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:56.428437 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f25dc-5733-41c5-bc79-4e92eb045e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:56.430088 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f25dc-5733-41c5-bc79-4e92eb045e87 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:56.448452 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 907/1804] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:56.452387 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f25dc-5733-41c5-bc79-4e92eb045e87 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:56.465627 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f25dc-5733-41c5-bc79-4e92eb045e87 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:56.474174 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364c04a-d671-4ebc-af8d-757cfaae4dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:56.475212 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364c04a-d671-4ebc-af8d-757cfaae4dca admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:56.482873 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364c04a-d671-4ebc-af8d-757cfaae4dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:56.483363 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364c04a-d671-4ebc-af8d-757cfaae4dca admin admin] PATH_INFO: `/v3/projects/2753288332784ccdb2094009424fb259/users/9680844043ef4d2db769acc6b222fe57/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:56.491762 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364c04a-d671-4ebc-af8d-757cfaae4dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=2753288332784ccdb2094009424fb259, user_id=9680844043ef4d2db769acc6b222fe57, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:56.503469 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364c04a-d671-4ebc-af8d-757cfaae4dca admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:56.526203 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 908/1805] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:56 2022] PUT /identity/v3/projects/2753288332784ccdb2094009424fb259/users/9680844043ef4d2db769acc6b222fe57/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:20:56.538576 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecdbe3-726d-40b2-9bc6-583164aac9f2 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:56.542426 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecdbe3-726d-40b2-9bc6-583164aac9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:56.542426 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecdbe3-726d-40b2-9bc6-583164aac9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:56.545180 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 898/1806] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:56 2022] PUT /identity/v3/projects/02a64bbc2ae349a6a3d76689cb7e8403/users/be5f3736a6ce4ef19d51b4e3c8b60e97/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:56.558884 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f39426-dba7-4272-9e75-eb4aa7628cb5 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:56.559409 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f39426-dba7-4272-9e75-eb4aa7628cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:56.559837 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f39426-dba7-4272-9e75-eb4aa7628cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:56.599846 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-57ecdbe3-726d-40b2-9bc6-583164aac9f2 None None] MFA Rules not processed for user `9680844043ef4d2db769acc6b222fe57`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:56.601118 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-57ecdbe3-726d-40b2-9bc6-583164aac9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:56.632922 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-c0f39426-dba7-4272-9e75-eb4aa7628cb5 None None] MFA Rules not processed for user `be5f3736a6ce4ef19d51b4e3c8b60e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:56.635752 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-c0f39426-dba7-4272-9e75-eb4aa7628cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:56.757431 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 909/1807] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:56 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:56.770364 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecdbe3-726d-40b2-9bc6-583164aac9f2 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:56.773144 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-57ecdbe3-726d-40b2-9bc6-583164aac9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:56.872477 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 899/1808] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:56.874354 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f39426-dba7-4272-9e75-eb4aa7628cb5 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:56.890268 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecdbe3-726d-40b2-9bc6-583164aac9f2 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:56.903430 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee7215-35c3-4186-89b5-d519fa9c9517 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:56.904395 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee7215-35c3-4186-89b5-d519fa9c9517 service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:56.904917 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee7215-35c3-4186-89b5-d519fa9c9517 service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:56.905431 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee7215-35c3-4186-89b5-d519fa9c9517 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:56.925261 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee7215-35c3-4186-89b5-d519fa9c9517 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:56.929408 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee7215-35c3-4186-89b5-d519fa9c9517 service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:56.955629 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 910/1809] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:56 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:57.059363 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f39426-dba7-4272-9e75-eb4aa7628cb5 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:57.068116 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a73ab1-160c-4a0a-95a9-d5d2db74a217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:57.070648 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a73ab1-160c-4a0a-95a9-d5d2db74a217 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:57.071501 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a73ab1-160c-4a0a-95a9-d5d2db74a217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:57.072239 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a73ab1-160c-4a0a-95a9-d5d2db74a217 admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:57.075758 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a73ab1-160c-4a0a-95a9-d5d2db74a217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:57.083950 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a73ab1-160c-4a0a-95a9-d5d2db74a217 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:57.479477 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 900/1810] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:20:56 2022] POST /identity/v3/projects => generated 369 bytes in 606 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:20:57.483441 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee7215-35c3-4186-89b5-d519fa9c9517 service cinder] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:57.504032 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee7215-35c3-4186-89b5-d519fa9c9517 service cinder] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:57.678054 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ace5a2-d3ae-474c-a1ec-0fe05f371c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:57.678954 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ace5a2-d3ae-474c-a1ec-0fe05f371c12 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:57.679578 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ace5a2-d3ae-474c-a1ec-0fe05f371c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:57.680012 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ace5a2-d3ae-474c-a1ec-0fe05f371c12 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:57.680879 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ace5a2-d3ae-474c-a1ec-0fe05f371c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:57.683137 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ace5a2-d3ae-474c-a1ec-0fe05f371c12 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:57.756591 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b73dd-b5b7-46da-92ac-62273710346c None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:57.756942 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b73dd-b5b7-46da-92ac-62273710346c None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:57.757943 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b73dd-b5b7-46da-92ac-62273710346c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:57.775063 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 911/1811] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:20:57 2022] POST /identity/v3/users => generated 291 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:20:57.775063 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ace5a2-d3ae-474c-a1ec-0fe05f371c12 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:57.797882 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ace5a2-d3ae-474c-a1ec-0fe05f371c12 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:57.797882 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba6ea0-9948-497a-988c-95911e7597e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:57.797882 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba6ea0-9948-497a-988c-95911e7597e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:57.797882 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba6ea0-9948-497a-988c-95911e7597e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:57.799077 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba6ea0-9948-497a-988c-95911e7597e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:57.799077 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba6ea0-9948-497a-988c-95911e7597e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:57.800132 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba6ea0-9948-497a-988c-95911e7597e9 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:57.800347 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-0d6b73dd-b5b7-46da-92ac-62273710346c None None] MFA Rules not processed for user `b608c6b9c7ef48c2abe8ec8ebb61d75c`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:57.812141 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-0d6b73dd-b5b7-46da-92ac-62273710346c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:57.828671 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 912/1812] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:57.829939 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba6ea0-9948-497a-988c-95911e7597e9 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:57.849924 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba6ea0-9948-497a-988c-95911e7597e9 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:57.861399 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143c458-25e0-48c9-9533-f2ee984b33fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:57.868360 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143c458-25e0-48c9-9533-f2ee984b33fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:57.868360 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143c458-25e0-48c9-9533-f2ee984b33fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:57.868360 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143c458-25e0-48c9-9533-f2ee984b33fb admin admin] PATH_INFO: `/v3/projects/89111444668e4bbfa55432ee421d36c0/users/e79b85171aa24c7ab752d98eb8dccc48/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:57.896965 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143c458-25e0-48c9-9533-f2ee984b33fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=89111444668e4bbfa55432ee421d36c0, user_id=e79b85171aa24c7ab752d98eb8dccc48, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:57.905488 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143c458-25e0-48c9-9533-f2ee984b33fb admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:57.950217 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 901/1813] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:57.951536 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a26f5-97ac-41e0-8031-b5f93bb66f46 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:57.951854 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a26f5-97ac-41e0-8031-b5f93bb66f46 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:57.952138 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a26f5-97ac-41e0-8031-b5f93bb66f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:57.978139 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-855a26f5-97ac-41e0-8031-b5f93bb66f46 None None] MFA Rules not processed for user `1c4e8920f33a4ae1a68811d68dd5d58f`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:57.979417 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-855a26f5-97ac-41e0-8031-b5f93bb66f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:58.003917 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 913/1814] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:57 2022] PUT /identity/v3/projects/89111444668e4bbfa55432ee421d36c0/users/e79b85171aa24c7ab752d98eb8dccc48/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:58.008752 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143c458-25e0-48c9-9533-f2ee984b33fb admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:58.116676 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 902/1815] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:58.126557 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143c458-25e0-48c9-9533-f2ee984b33fb admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:58.132485 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15eccaa-8c7f-4719-81c3-bd4d41705367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:58.133408 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15eccaa-8c7f-4719-81c3-bd4d41705367 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:58.133859 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15eccaa-8c7f-4719-81c3-bd4d41705367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:58.134266 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15eccaa-8c7f-4719-81c3-bd4d41705367 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:58.136789 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15eccaa-8c7f-4719-81c3-bd4d41705367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:58.138734 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15eccaa-8c7f-4719-81c3-bd4d41705367 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:58.153336 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 914/1816] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:20:58.159120 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a26f5-97ac-41e0-8031-b5f93bb66f46 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:58.174505 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a26f5-97ac-41e0-8031-b5f93bb66f46 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:58.187642 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d91443-7463-46f1-8a7e-135aa92613ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:58.189310 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d91443-7463-46f1-8a7e-135aa92613ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:58.189668 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d91443-7463-46f1-8a7e-135aa92613ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:58.190109 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d91443-7463-46f1-8a7e-135aa92613ea admin admin] PATH_INFO: `/v3/projects/89111444668e4bbfa55432ee421d36c0/users/e79b85171aa24c7ab752d98eb8dccc48/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:58.192534 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d91443-7463-46f1-8a7e-135aa92613ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=89111444668e4bbfa55432ee421d36c0, user_id=e79b85171aa24c7ab752d98eb8dccc48, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:58.225742 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d91443-7463-46f1-8a7e-135aa92613ea admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:58.257996 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 903/1817] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:20:58 2022] PUT /identity/v3/projects/89111444668e4bbfa55432ee421d36c0/users/e79b85171aa24c7ab752d98eb8dccc48/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:58.273459 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e8752-80ce-4692-bf79-bd56c0e0a148 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:58.275353 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e8752-80ce-4692-bf79-bd56c0e0a148 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:58.275353 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e8752-80ce-4692-bf79-bd56c0e0a148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:58.332868 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-f21e8752-80ce-4692-bf79-bd56c0e0a148 None None] MFA Rules not processed for user `e79b85171aa24c7ab752d98eb8dccc48`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:58.332868 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-f21e8752-80ce-4692-bf79-bd56c0e0a148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:58.461506 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 915/1818] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:58 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:20:58.474836 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d91443-7463-46f1-8a7e-135aa92613ea admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:58.578254 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d91443-7463-46f1-8a7e-135aa92613ea admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:58.583296 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6bf9c-a6e1-45c3-a3f6-e0deaae64c3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:58.583960 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6bf9c-a6e1-45c3-a3f6-e0deaae64c3d service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:58.584433 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6bf9c-a6e1-45c3-a3f6-e0deaae64c3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:58.584877 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6bf9c-a6e1-45c3-a3f6-e0deaae64c3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:58.596107 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6bf9c-a6e1-45c3-a3f6-e0deaae64c3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:58.600870 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6bf9c-a6e1-45c3-a3f6-e0deaae64c3d service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:58.609465 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 904/1819] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:58 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:58.656289 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e8752-80ce-4692-bf79-bd56c0e0a148 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:58.726412 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e8752-80ce-4692-bf79-bd56c0e0a148 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:58.744120 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26db4cd-ae21-4e48-a4dd-34b4f67ab40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:58.744120 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26db4cd-ae21-4e48-a4dd-34b4f67ab40c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:58.744120 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26db4cd-ae21-4e48-a4dd-34b4f67ab40c admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:58.744120 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26db4cd-ae21-4e48-a4dd-34b4f67ab40c admin admin] PATH_INFO: `/v3/users/0a98f8e29d6a496e9333591f2824b786` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:58.744821 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26db4cd-ae21-4e48-a4dd-34b4f67ab40c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a98f8e29d6a496e9333591f2824b786)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:58.746818 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26db4cd-ae21-4e48-a4dd-34b4f67ab40c admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:58.751971 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6bf9c-a6e1-45c3-a3f6-e0deaae64c3d service cinder] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:58.753944 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-82c6bf9c-a6e1-45c3-a3f6-e0deaae64c3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:58.765203 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6bf9c-a6e1-45c3-a3f6-e0deaae64c3d service cinder] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:58.770662 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ef1fe-ecc4-4430-b434-5b10d4407bc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:58.772713 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ef1fe-ecc4-4430-b434-5b10d4407bc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:58.772713 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ef1fe-ecc4-4430-b434-5b10d4407bc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:58.772713 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ef1fe-ecc4-4430-b434-5b10d4407bc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:58.854225 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ef1fe-ecc4-4430-b434-5b10d4407bc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:58.855769 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ef1fe-ecc4-4430-b434-5b10d4407bc7 service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:58.866467 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 905/1820] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:20:58.963231 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a26db4cd-ae21-4e48-a4dd-34b4f67ab40c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a98f8e29d6a496e9333591f2824b786'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:59.053059 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a26db4cd-ae21-4e48-a4dd-34b4f67ab40c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a98f8e29d6a496e9333591f2824b786'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:59.053694 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a26db4cd-ae21-4e48-a4dd-34b4f67ab40c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a98f8e29d6a496e9333591f2824b786'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:59.054296 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a26db4cd-ae21-4e48-a4dd-34b4f67ab40c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a98f8e29d6a496e9333591f2824b786'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:59.062066 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a26db4cd-ae21-4e48-a4dd-34b4f67ab40c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a98f8e29d6a496e9333591f2824b786'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:20:59.080133 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 916/1821] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:20:58 2022] DELETE /identity/v3/users/0a98f8e29d6a496e9333591f2824b786 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:20:59.084588 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d470871-979c-44a1-8629-47d7cb353244 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:59.084885 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d470871-979c-44a1-8629-47d7cb353244 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:59.085190 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d470871-979c-44a1-8629-47d7cb353244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:59.102210 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-2d470871-979c-44a1-8629-47d7cb353244 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:20:59.103402 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-2d470871-979c-44a1-8629-47d7cb353244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:59.166744 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 906/1822] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:20:59.174127 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26db4cd-ae21-4e48-a4dd-34b4f67ab40c admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:59.175786 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a26db4cd-ae21-4e48-a4dd-34b4f67ab40c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:59.311130 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26db4cd-ae21-4e48-a4dd-34b4f67ab40c admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:59.317169 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794941d-5b5b-4a37-baed-59a7123e6d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:59.317992 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794941d-5b5b-4a37-baed-59a7123e6d2e service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:59.318286 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794941d-5b5b-4a37-baed-59a7123e6d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:59.318570 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794941d-5b5b-4a37-baed-59a7123e6d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:59.331447 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794941d-5b5b-4a37-baed-59a7123e6d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:59.333460 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794941d-5b5b-4a37-baed-59a7123e6d2e service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:59.348124 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 917/1823] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:20:59.725170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d470871-979c-44a1-8629-47d7cb353244 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:20:59.726906 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-2d470871-979c-44a1-8629-47d7cb353244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:59.810311 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d470871-979c-44a1-8629-47d7cb353244 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:20:59.818607 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef39cc-5b05-44b9-87db-2dc6d08eb670 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:20:59.819350 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef39cc-5b05-44b9-87db-2dc6d08eb670 service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:20:59.819660 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef39cc-5b05-44b9-87db-2dc6d08eb670 service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:20:59.819925 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef39cc-5b05-44b9-87db-2dc6d08eb670 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:20:59.822260 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-12ef39cc-5b05-44b9-87db-2dc6d08eb670 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:20:59.919583 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef39cc-5b05-44b9-87db-2dc6d08eb670 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:20:59.921041 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef39cc-5b05-44b9-87db-2dc6d08eb670 service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:20:59.932312 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 907/1824] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:20:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:21:00.046169 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794941d-5b5b-4a37-baed-59a7123e6d2e service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:00.048295 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-4794941d-5b5b-4a37-baed-59a7123e6d2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:00.063069 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794941d-5b5b-4a37-baed-59a7123e6d2e service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:00.069259 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcd390-764d-48da-829a-e340157b72bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:00.070348 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcd390-764d-48da-829a-e340157b72bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:00.070810 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcd390-764d-48da-829a-e340157b72bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:00.071321 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcd390-764d-48da-829a-e340157b72bb admin admin] PATH_INFO: `/v3/projects/e10ca96f063a456e840cd1245a4308e3` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:00.072781 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcd390-764d-48da-829a-e340157b72bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e10ca96f063a456e840cd1245a4308e3)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:00.074893 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcd390-764d-48da-829a-e340157b72bb admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:00.168114 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fcdcd390-764d-48da-829a-e340157b72bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e10ca96f063a456e840cd1245a4308e3', 'request_id': 'req-fcdcd390-764d-48da-829a-e340157b72bb'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:00.174286 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fcdcd390-764d-48da-829a-e340157b72bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e10ca96f063a456e840cd1245a4308e3', 'request_id': 'req-fcdcd390-764d-48da-829a-e340157b72bb'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:00.180703 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fcdcd390-764d-48da-829a-e340157b72bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e10ca96f063a456e840cd1245a4308e3', 'request_id': 'req-fcdcd390-764d-48da-829a-e340157b72bb'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:00.287343 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fcdcd390-764d-48da-829a-e340157b72bb admin admin] The token cache is being invalidate because project e10ca96f063a456e840cd1245a4308e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:00.287667 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fcdcd390-764d-48da-829a-e340157b72bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:00.288312 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fcdcd390-764d-48da-829a-e340157b72bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:00.289888 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 918/1825] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:00 2022] DELETE /identity/v3/projects/e10ca96f063a456e840cd1245a4308e3 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:00.293860 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef39cc-5b05-44b9-87db-2dc6d08eb670 service cinder] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:00.304901 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef39cc-5b05-44b9-87db-2dc6d08eb670 service cinder] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:00.368165 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389e47e-e67a-4436-be23-bce20a96fd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:00.369260 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389e47e-e67a-4436-be23-bce20a96fd4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:00.369646 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389e47e-e67a-4436-be23-bce20a96fd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:00.370005 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389e47e-e67a-4436-be23-bce20a96fd4e admin admin] PATH_INFO: `/v3/users/9680844043ef4d2db769acc6b222fe57` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:00.371375 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389e47e-e67a-4436-be23-bce20a96fd4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9680844043ef4d2db769acc6b222fe57)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:00.373283 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389e47e-e67a-4436-be23-bce20a96fd4e admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:00.620101 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-e389e47e-e67a-4436-be23-bce20a96fd4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9680844043ef4d2db769acc6b222fe57'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:00.670393 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-e389e47e-e67a-4436-be23-bce20a96fd4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9680844043ef4d2db769acc6b222fe57'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:00.671224 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-e389e47e-e67a-4436-be23-bce20a96fd4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9680844043ef4d2db769acc6b222fe57'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:00.685954 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-e389e47e-e67a-4436-be23-bce20a96fd4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9680844043ef4d2db769acc6b222fe57'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:00.701873 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-e389e47e-e67a-4436-be23-bce20a96fd4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9680844043ef4d2db769acc6b222fe57'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:00.708393 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 908/1826] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:00 2022] DELETE /identity/v3/users/9680844043ef4d2db769acc6b222fe57 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:01.186926 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcd390-764d-48da-829a-e340157b72bb admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:01.190532 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-fcdcd390-764d-48da-829a-e340157b72bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:01.205091 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcd390-764d-48da-829a-e340157b72bb admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:01.275106 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fe7fa-f340-46ca-8584-cf9d0a2807ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:01.276004 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fe7fa-f340-46ca-8584-cf9d0a2807ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:01.276291 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fe7fa-f340-46ca-8584-cf9d0a2807ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:01.276569 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fe7fa-f340-46ca-8584-cf9d0a2807ce admin admin] PATH_INFO: `/v3/projects/2753288332784ccdb2094009424fb259` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:01.283553 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fe7fa-f340-46ca-8584-cf9d0a2807ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=2753288332784ccdb2094009424fb259)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:01.285694 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fe7fa-f340-46ca-8584-cf9d0a2807ce admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:01.384180 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-352fe7fa-f340-46ca-8584-cf9d0a2807ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2753288332784ccdb2094009424fb259', 'request_id': 'req-352fe7fa-f340-46ca-8584-cf9d0a2807ce'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:01.389572 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-352fe7fa-f340-46ca-8584-cf9d0a2807ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2753288332784ccdb2094009424fb259', 'request_id': 'req-352fe7fa-f340-46ca-8584-cf9d0a2807ce'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:01.396154 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-352fe7fa-f340-46ca-8584-cf9d0a2807ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2753288332784ccdb2094009424fb259', 'request_id': 'req-352fe7fa-f340-46ca-8584-cf9d0a2807ce'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:01.515509 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-352fe7fa-f340-46ca-8584-cf9d0a2807ce admin admin] The token cache is being invalidate because project 2753288332784ccdb2094009424fb259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:01.518134 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-352fe7fa-f340-46ca-8584-cf9d0a2807ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:01.518134 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-352fe7fa-f340-46ca-8584-cf9d0a2807ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:01.518447 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 919/1827] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:01 2022] DELETE /identity/v3/projects/2753288332784ccdb2094009424fb259 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:01.523556 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9068a6f-7330-43fc-816c-3ea804c2d25b None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:01.524019 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9068a6f-7330-43fc-816c-3ea804c2d25b None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:01.524127 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9068a6f-7330-43fc-816c-3ea804c2d25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:01.553239 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-b9068a6f-7330-43fc-816c-3ea804c2d25b None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:01.554927 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-b9068a6f-7330-43fc-816c-3ea804c2d25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:01.637407 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 909/1828] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:21:01.646461 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba8d39-c105-47a4-8cb1-85324c6e622c None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:01.646755 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba8d39-c105-47a4-8cb1-85324c6e622c None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:01.647040 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba8d39-c105-47a4-8cb1-85324c6e622c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:01.668755 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-e4ba8d39-c105-47a4-8cb1-85324c6e622c None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:01.670470 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e4ba8d39-c105-47a4-8cb1-85324c6e622c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:01.681566 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 920/1829] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:01.686025 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9068a6f-7330-43fc-816c-3ea804c2d25b None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:01.698183 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9068a6f-7330-43fc-816c-3ea804c2d25b None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:01.704531 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e990b85-11a7-452e-961d-c6cab3796011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:01.705715 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e990b85-11a7-452e-961d-c6cab3796011 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:01.706181 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e990b85-11a7-452e-961d-c6cab3796011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:01.707127 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e990b85-11a7-452e-961d-c6cab3796011 admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:01.708158 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e990b85-11a7-452e-961d-c6cab3796011 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:21:01.708654 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e990b85-11a7-452e-961d-c6cab3796011 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:01.710672 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e990b85-11a7-452e-961d-c6cab3796011 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:01.730314 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 910/1830] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:21:01.734303 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba8d39-c105-47a4-8cb1-85324c6e622c None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:01.744247 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba8d39-c105-47a4-8cb1-85324c6e622c None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:01.749333 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99315c96-0139-43c8-9af6-122560921201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:01.749930 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99315c96-0139-43c8-9af6-122560921201 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:01.750214 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99315c96-0139-43c8-9af6-122560921201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:01.750493 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99315c96-0139-43c8-9af6-122560921201 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:01.751304 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99315c96-0139-43c8-9af6-122560921201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:01.753227 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99315c96-0139-43c8-9af6-122560921201 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:01.830590 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 921/1831] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:01 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:01.834711 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e990b85-11a7-452e-961d-c6cab3796011 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:01.844801 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e990b85-11a7-452e-961d-c6cab3796011 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:01.955493 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b803e-1705-41d0-9be0-7fec24c14a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:01.956900 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b803e-1705-41d0-9be0-7fec24c14a96 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:01.957575 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b803e-1705-41d0-9be0-7fec24c14a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:01.958033 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b803e-1705-41d0-9be0-7fec24c14a96 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:01.958996 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b803e-1705-41d0-9be0-7fec24c14a96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:01.961334 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b803e-1705-41d0-9be0-7fec24c14a96 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:02.060651 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 911/1832] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:01 2022] POST /identity/v3/users => generated 286 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:02.067382 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99315c96-0139-43c8-9af6-122560921201 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:02.077170 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99315c96-0139-43c8-9af6-122560921201 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:02.094997 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846378ed-3e3c-4f41-9fcc-9990b13a6052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:02.098666 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846378ed-3e3c-4f41-9fcc-9990b13a6052 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:02.098666 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846378ed-3e3c-4f41-9fcc-9990b13a6052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:02.101004 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846378ed-3e3c-4f41-9fcc-9990b13a6052 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:02.112321 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846378ed-3e3c-4f41-9fcc-9990b13a6052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:02.118518 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846378ed-3e3c-4f41-9fcc-9990b13a6052 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:02.162863 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 922/1833] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:02.166812 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b803e-1705-41d0-9be0-7fec24c14a96 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:02.191988 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b803e-1705-41d0-9be0-7fec24c14a96 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:02.210903 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351edc9-975c-4634-967b-f206ab46bf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:02.211287 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351edc9-975c-4634-967b-f206ab46bf44 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:02.211611 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351edc9-975c-4634-967b-f206ab46bf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:02.211794 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351edc9-975c-4634-967b-f206ab46bf44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:02.212603 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351edc9-975c-4634-967b-f206ab46bf44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:02.215701 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351edc9-975c-4634-967b-f206ab46bf44 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:02.271837 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846378ed-3e3c-4f41-9fcc-9990b13a6052 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:02.273273 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 912/1834] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:02.288500 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846378ed-3e3c-4f41-9fcc-9990b13a6052 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:02.302762 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326277e-a906-49a3-b61f-481432876b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:02.304100 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326277e-a906-49a3-b61f-481432876b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:02.313956 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326277e-a906-49a3-b61f-481432876b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:02.313956 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326277e-a906-49a3-b61f-481432876b88 admin admin] PATH_INFO: `/v3/projects/5517914e520f417481d625314e3478b2/users/7efc4dc80777436894ac3fcfbe071157/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:02.347458 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326277e-a906-49a3-b61f-481432876b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5517914e520f417481d625314e3478b2, user_id=7efc4dc80777436894ac3fcfbe071157, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:02.350735 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326277e-a906-49a3-b61f-481432876b88 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:02.445894 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 923/1835] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:02 2022] PUT /identity/v3/projects/5517914e520f417481d625314e3478b2/users/7efc4dc80777436894ac3fcfbe071157/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:02.447659 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96deedb-c182-46c3-964f-9243364f14b4 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:02.448407 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96deedb-c182-46c3-964f-9243364f14b4 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:02.448407 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96deedb-c182-46c3-964f-9243364f14b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:02.518458 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-c96deedb-c182-46c3-964f-9243364f14b4 None None] MFA Rules not processed for user `7efc4dc80777436894ac3fcfbe071157`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:02.518458 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-c96deedb-c182-46c3-964f-9243364f14b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:02.586475 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 913/1836] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:02.593717 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326277e-a906-49a3-b61f-481432876b88 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:02.657969 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326277e-a906-49a3-b61f-481432876b88 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:02.668037 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6a41c-840c-4664-9578-b88f816b3981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:02.668753 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6a41c-840c-4664-9578-b88f816b3981 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:02.669273 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6a41c-840c-4664-9578-b88f816b3981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:02.669400 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6a41c-840c-4664-9578-b88f816b3981 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:02.670071 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6a41c-840c-4664-9578-b88f816b3981 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:02.672005 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6a41c-840c-4664-9578-b88f816b3981 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:03.527425 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 924/1837] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:02 2022] POST /identity/v3/projects => generated 377 bytes in 935 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:03.531246 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96deedb-c182-46c3-964f-9243364f14b4 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:03.554471 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96deedb-c182-46c3-964f-9243364f14b4 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:03.675576 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662d40e-b110-4af1-b177-b44adfaa3572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:03.678252 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662d40e-b110-4af1-b177-b44adfaa3572 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:03.679391 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662d40e-b110-4af1-b177-b44adfaa3572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:03.681894 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662d40e-b110-4af1-b177-b44adfaa3572 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:03.682919 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662d40e-b110-4af1-b177-b44adfaa3572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:03.685115 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662d40e-b110-4af1-b177-b44adfaa3572 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:03.820999 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 914/1838] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:03 2022] POST /identity/v3/users => generated 295 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:03.822308 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6a41c-840c-4664-9578-b88f816b3981 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:03.854626 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6a41c-840c-4664-9578-b88f816b3981 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:03.863974 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f595b7b-f67e-4c91-9e34-9aa308c38ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:03.865011 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f595b7b-f67e-4c91-9e34-9aa308c38ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:03.865365 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f595b7b-f67e-4c91-9e34-9aa308c38ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:03.865709 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f595b7b-f67e-4c91-9e34-9aa308c38ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:03.866694 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f595b7b-f67e-4c91-9e34-9aa308c38ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:03.869041 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f595b7b-f67e-4c91-9e34-9aa308c38ec4 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:03.887622 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 925/1839] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:21:03.891897 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662d40e-b110-4af1-b177-b44adfaa3572 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:03.902613 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662d40e-b110-4af1-b177-b44adfaa3572 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:03.909920 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3da8c3-b572-4f00-8801-639ee9be3cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:03.911152 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3da8c3-b572-4f00-8801-639ee9be3cff admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:03.911582 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3da8c3-b572-4f00-8801-639ee9be3cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:03.914258 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3da8c3-b572-4f00-8801-639ee9be3cff admin admin] PATH_INFO: `/v3/projects/765d322488f348299538ad2e3605f012/users/fb752d118e724e06803ae6677c33d57f/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:03.946077 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3da8c3-b572-4f00-8801-639ee9be3cff admin admin] RBAC: Authorizing `identity:create_grant(project_id=765d322488f348299538ad2e3605f012, user_id=fb752d118e724e06803ae6677c33d57f, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:03.946077 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3da8c3-b572-4f00-8801-639ee9be3cff admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:04.054439 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 915/1840] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:03 2022] PUT /identity/v3/projects/765d322488f348299538ad2e3605f012/users/fb752d118e724e06803ae6677c33d57f/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:04.056117 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f595b7b-f67e-4c91-9e34-9aa308c38ec4 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:04.074593 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f595b7b-f67e-4c91-9e34-9aa308c38ec4 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:04.152698 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdb07c-2332-4f5e-a469-c744201b0473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:04.153996 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdb07c-2332-4f5e-a469-c744201b0473 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:04.154394 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdb07c-2332-4f5e-a469-c744201b0473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:04.154953 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdb07c-2332-4f5e-a469-c744201b0473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:04.157911 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdb07c-2332-4f5e-a469-c744201b0473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:04.159949 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdb07c-2332-4f5e-a469-c744201b0473 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:04.181828 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 926/1841] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:04.184091 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3da8c3-b572-4f00-8801-639ee9be3cff admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:04.195305 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3da8c3-b572-4f00-8801-639ee9be3cff admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:04.200571 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2affd4-4722-45ef-af5d-de54e2c2bd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:04.200865 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2affd4-4722-45ef-af5d-de54e2c2bd2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:04.201175 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2affd4-4722-45ef-af5d-de54e2c2bd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:04.201487 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2affd4-4722-45ef-af5d-de54e2c2bd2f admin admin] PATH_INFO: `/v3/projects/765d322488f348299538ad2e3605f012/users/fb752d118e724e06803ae6677c33d57f/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:04.203476 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2affd4-4722-45ef-af5d-de54e2c2bd2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=765d322488f348299538ad2e3605f012, user_id=fb752d118e724e06803ae6677c33d57f, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:04.207369 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2affd4-4722-45ef-af5d-de54e2c2bd2f admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:04.237213 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 916/1842] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:04 2022] PUT /identity/v3/projects/765d322488f348299538ad2e3605f012/users/fb752d118e724e06803ae6677c33d57f/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:04.247242 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f20647-361a-49a6-a8f2-739701c9d609 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:04.247534 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f20647-361a-49a6-a8f2-739701c9d609 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:04.247815 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f20647-361a-49a6-a8f2-739701c9d609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:04.276815 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-e8f20647-361a-49a6-a8f2-739701c9d609 None None] MFA Rules not processed for user `fb752d118e724e06803ae6677c33d57f`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:04.278143 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e8f20647-361a-49a6-a8f2-739701c9d609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:04.355266 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 927/1843] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:04.367154 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2affd4-4722-45ef-af5d-de54e2c2bd2f admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:04.368893 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-5e2affd4-4722-45ef-af5d-de54e2c2bd2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:04.435387 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2affd4-4722-45ef-af5d-de54e2c2bd2f admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:04.440424 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39336c06-b962-4618-a7b5-ce83ca4e70a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:04.441101 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39336c06-b962-4618-a7b5-ce83ca4e70a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:04.441411 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39336c06-b962-4618-a7b5-ce83ca4e70a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:04.441691 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39336c06-b962-4618-a7b5-ce83ca4e70a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:04.514682 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39336c06-b962-4618-a7b5-ce83ca4e70a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:04.514682 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39336c06-b962-4618-a7b5-ce83ca4e70a4 service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:04.525518 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 917/1844] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:21:05.642661 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f602dfd-b89c-439e-ae99-ecf1a86c8ec2 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:05.643239 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f602dfd-b89c-439e-ae99-ecf1a86c8ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:05.643239 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f602dfd-b89c-439e-ae99-ecf1a86c8ec2 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:05.646263 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 928/1845] 10.222.0.43 () {54 vars in 921 bytes} [Tue Mar 29 20:21:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:21:05.656756 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ded7a-b4d5-48ff-b278-8a4d00026f3d None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:05.661947 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ded7a-b4d5-48ff-b278-8a4d00026f3d None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:05.661947 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ded7a-b4d5-48ff-b278-8a4d00026f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:05.685926 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-5f1ded7a-b4d5-48ff-b278-8a4d00026f3d None None] MFA Rules not processed for user `b797e15939694c9abf1f2b8e9aee4d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:05.687300 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-5f1ded7a-b4d5-48ff-b278-8a4d00026f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:05.791264 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 918/1846] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Mar 29 20:21:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:05.858803 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f602dfd-b89c-439e-ae99-ecf1a86c8ec2 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:05.858803 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-5f602dfd-b89c-439e-ae99-ecf1a86c8ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:05.883812 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f602dfd-b89c-439e-ae99-ecf1a86c8ec2 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:05.889352 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f4efa-2811-4de2-b6e5-fb17af5dc602 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:05.890058 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f4efa-2811-4de2-b6e5-fb17af5dc602 service nova] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:05.890320 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f4efa-2811-4de2-b6e5-fb17af5dc602 service nova] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:05.893105 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f4efa-2811-4de2-b6e5-fb17af5dc602 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:05.900425 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f4efa-2811-4de2-b6e5-fb17af5dc602 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:05.902089 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f4efa-2811-4de2-b6e5-fb17af5dc602 service nova] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:05.913629 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 929/1847] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:21:06.932457 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ded7a-b4d5-48ff-b278-8a4d00026f3d None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:06.933986 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-5f1ded7a-b4d5-48ff-b278-8a4d00026f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:07.057068 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ded7a-b4d5-48ff-b278-8a4d00026f3d None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:07.057316 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f4efa-2811-4de2-b6e5-fb17af5dc602 service nova] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:07.058927 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a57f4efa-2811-4de2-b6e5-fb17af5dc602 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:07.062111 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99e7ca-534f-469c-9bd4-21d577f1405f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:07.063585 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99e7ca-534f-469c-9bd4-21d577f1405f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:07.063877 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99e7ca-534f-469c-9bd4-21d577f1405f admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:07.064157 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99e7ca-534f-469c-9bd4-21d577f1405f admin admin] PATH_INFO: `/v3/users/e7ead14590d74386aa14a8b41a8afc58` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:07.065407 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99e7ca-534f-469c-9bd4-21d577f1405f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ead14590d74386aa14a8b41a8afc58)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:07.067372 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99e7ca-534f-469c-9bd4-21d577f1405f admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:07.073503 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f4efa-2811-4de2-b6e5-fb17af5dc602 service nova] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:07.078284 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e831c2-a828-4846-a7ca-2b00dd04a5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:07.080701 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e831c2-a828-4846-a7ca-2b00dd04a5b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:07.081044 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e831c2-a828-4846-a7ca-2b00dd04a5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:07.081878 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e831c2-a828-4846-a7ca-2b00dd04a5b1 admin admin] PATH_INFO: `/v3/users/be5f3736a6ce4ef19d51b4e3c8b60e97` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:07.082747 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e831c2-a828-4846-a7ca-2b00dd04a5b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be5f3736a6ce4ef19d51b4e3c8b60e97)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:07.084736 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e831c2-a828-4846-a7ca-2b00dd04a5b1 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:07.267251 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-3e99e7ca-534f-469c-9bd4-21d577f1405f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ead14590d74386aa14a8b41a8afc58'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:07.293456 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d4e831c2-a828-4846-a7ca-2b00dd04a5b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be5f3736a6ce4ef19d51b4e3c8b60e97'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:07.315451 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-3e99e7ca-534f-469c-9bd4-21d577f1405f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ead14590d74386aa14a8b41a8afc58'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:07.316090 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-3e99e7ca-534f-469c-9bd4-21d577f1405f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ead14590d74386aa14a8b41a8afc58'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:07.323605 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-3e99e7ca-534f-469c-9bd4-21d577f1405f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ead14590d74386aa14a8b41a8afc58'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:07.336866 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-3e99e7ca-534f-469c-9bd4-21d577f1405f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ead14590d74386aa14a8b41a8afc58'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:07.342755 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 919/1848] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:06 2022] DELETE /identity/v3/users/e7ead14590d74386aa14a8b41a8afc58 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:07.347290 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a4c4a-8e82-4a16-8f5d-d7baf02e3767 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:07.347581 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a4c4a-8e82-4a16-8f5d-d7baf02e3767 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:07.347864 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a4c4a-8e82-4a16-8f5d-d7baf02e3767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:07.365989 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-259a4c4a-8e82-4a16-8f5d-d7baf02e3767 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:07.367013 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d4e831c2-a828-4846-a7ca-2b00dd04a5b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be5f3736a6ce4ef19d51b4e3c8b60e97'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:07.367437 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-259a4c4a-8e82-4a16-8f5d-d7baf02e3767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:07.368396 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d4e831c2-a828-4846-a7ca-2b00dd04a5b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be5f3736a6ce4ef19d51b4e3c8b60e97'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:07.369215 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d4e831c2-a828-4846-a7ca-2b00dd04a5b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be5f3736a6ce4ef19d51b4e3c8b60e97'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:07.380883 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d4e831c2-a828-4846-a7ca-2b00dd04a5b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be5f3736a6ce4ef19d51b4e3c8b60e97'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:07.412080 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 930/1849] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:07 2022] DELETE /identity/v3/users/be5f3736a6ce4ef19d51b4e3c8b60e97 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:07.414150 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efd774-270d-4e92-a93d-9ea95bf28517 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:07.414448 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efd774-270d-4e92-a93d-9ea95bf28517 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:07.414899 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efd774-270d-4e92-a93d-9ea95bf28517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:07.448467 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 920/1850] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:21:07.456648 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a4c4a-8e82-4a16-8f5d-d7baf02e3767 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:07.459210 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-259a4c4a-8e82-4a16-8f5d-d7baf02e3767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:07.480505 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-61efd774-270d-4e92-a93d-9ea95bf28517 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:07.483396 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-61efd774-270d-4e92-a93d-9ea95bf28517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:07.569356 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 931/1851] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:07.593854 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efd774-270d-4e92-a93d-9ea95bf28517 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:07.598180 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-61efd774-270d-4e92-a93d-9ea95bf28517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:07.620200 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a4c4a-8e82-4a16-8f5d-d7baf02e3767 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:07.669513 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efd774-270d-4e92-a93d-9ea95bf28517 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:07.673549 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e4352-4677-4535-9119-98fa37fb40a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:07.674240 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e4352-4677-4535-9119-98fa37fb40a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:07.674520 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e4352-4677-4535-9119-98fa37fb40a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:07.674848 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e4352-4677-4535-9119-98fa37fb40a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:07.678041 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd135e-4e2b-4f7e-b258-05d72059c762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:07.678709 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd135e-4e2b-4f7e-b258-05d72059c762 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:07.679002 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd135e-4e2b-4f7e-b258-05d72059c762 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:07.679299 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd135e-4e2b-4f7e-b258-05d72059c762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:07.684786 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e4352-4677-4535-9119-98fa37fb40a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:07.686267 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e4352-4677-4535-9119-98fa37fb40a9 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:07.691346 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd135e-4e2b-4f7e-b258-05d72059c762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:07.693193 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd135e-4e2b-4f7e-b258-05d72059c762 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:07.707490 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 921/1852] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:21:07.714305 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 932/1853] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:21:08.339441 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd135e-4e2b-4f7e-b258-05d72059c762 service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:08.340836 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-adfd135e-4e2b-4f7e-b258-05d72059c762 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:08.354873 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd135e-4e2b-4f7e-b258-05d72059c762 service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:08.360549 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965a043-6990-488d-a295-1bccf5d94d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:08.362119 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965a043-6990-488d-a295-1bccf5d94d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:08.362119 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965a043-6990-488d-a295-1bccf5d94d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:08.362119 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965a043-6990-488d-a295-1bccf5d94d01 admin admin] PATH_INFO: `/v3/projects/1f94dd3b9a3942f3bb53b33b9b2cf3b3` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:08.363800 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e4352-4677-4535-9119-98fa37fb40a9 service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:08.368391 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-db2e4352-4677-4535-9119-98fa37fb40a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:08.369554 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965a043-6990-488d-a295-1bccf5d94d01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f94dd3b9a3942f3bb53b33b9b2cf3b3)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:08.371726 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965a043-6990-488d-a295-1bccf5d94d01 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:08.385800 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e4352-4677-4535-9119-98fa37fb40a9 service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:08.392571 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6292f-c9e6-4b55-bdc7-80198a51e0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:08.393913 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6292f-c9e6-4b55-bdc7-80198a51e0b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:08.394015 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6292f-c9e6-4b55-bdc7-80198a51e0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:08.394545 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6292f-c9e6-4b55-bdc7-80198a51e0b7 admin admin] PATH_INFO: `/v3/projects/02a64bbc2ae349a6a3d76689cb7e8403` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:08.395844 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6292f-c9e6-4b55-bdc7-80198a51e0b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02a64bbc2ae349a6a3d76689cb7e8403)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:08.397784 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6292f-c9e6-4b55-bdc7-80198a51e0b7 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:08.457737 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-2965a043-6990-488d-a295-1bccf5d94d01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f94dd3b9a3942f3bb53b33b9b2cf3b3', 'request_id': 'req-2965a043-6990-488d-a295-1bccf5d94d01'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:08.474968 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-18b6292f-c9e6-4b55-bdc7-80198a51e0b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02a64bbc2ae349a6a3d76689cb7e8403', 'request_id': 'req-18b6292f-c9e6-4b55-bdc7-80198a51e0b7'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:08.480454 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-18b6292f-c9e6-4b55-bdc7-80198a51e0b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02a64bbc2ae349a6a3d76689cb7e8403', 'request_id': 'req-18b6292f-c9e6-4b55-bdc7-80198a51e0b7'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:08.487510 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-18b6292f-c9e6-4b55-bdc7-80198a51e0b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02a64bbc2ae349a6a3d76689cb7e8403', 'request_id': 'req-18b6292f-c9e6-4b55-bdc7-80198a51e0b7'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:08.509557 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-2965a043-6990-488d-a295-1bccf5d94d01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f94dd3b9a3942f3bb53b33b9b2cf3b3', 'request_id': 'req-2965a043-6990-488d-a295-1bccf5d94d01'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:08.515465 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-2965a043-6990-488d-a295-1bccf5d94d01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f94dd3b9a3942f3bb53b33b9b2cf3b3', 'request_id': 'req-2965a043-6990-488d-a295-1bccf5d94d01'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:08.527086 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-2965a043-6990-488d-a295-1bccf5d94d01 admin admin] The token cache is being invalidate because project 1f94dd3b9a3942f3bb53b33b9b2cf3b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:08.527379 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-2965a043-6990-488d-a295-1bccf5d94d01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:08.528034 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-2965a043-6990-488d-a295-1bccf5d94d01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:08.529710 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 922/1854] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:08 2022] DELETE /identity/v3/projects/1f94dd3b9a3942f3bb53b33b9b2cf3b3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:08.534144 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965a043-6990-488d-a295-1bccf5d94d01 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:08.535517 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-2965a043-6990-488d-a295-1bccf5d94d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:08.549641 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-18b6292f-c9e6-4b55-bdc7-80198a51e0b7 admin admin] The token cache is being invalidate because project 02a64bbc2ae349a6a3d76689cb7e8403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:08.549935 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-18b6292f-c9e6-4b55-bdc7-80198a51e0b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:08.550611 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-18b6292f-c9e6-4b55-bdc7-80198a51e0b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:08.552318 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 933/1855] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:08 2022] DELETE /identity/v3/projects/02a64bbc2ae349a6a3d76689cb7e8403 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:08.556877 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6292f-c9e6-4b55-bdc7-80198a51e0b7 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:08.557255 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-18b6292f-c9e6-4b55-bdc7-80198a51e0b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:08.599270 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965a043-6990-488d-a295-1bccf5d94d01 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:08.622004 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6292f-c9e6-4b55-bdc7-80198a51e0b7 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:08.631892 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c67cc-8a29-492c-9325-8787e1e3c3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:08.632796 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c67cc-8a29-492c-9325-8787e1e3c3a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:08.633077 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c67cc-8a29-492c-9325-8787e1e3c3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:08.633381 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c67cc-8a29-492c-9325-8787e1e3c3a9 admin admin] PATH_INFO: `/v3/users/e79b85171aa24c7ab752d98eb8dccc48` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:08.634758 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c67cc-8a29-492c-9325-8787e1e3c3a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e79b85171aa24c7ab752d98eb8dccc48)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:08.636871 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c67cc-8a29-492c-9325-8787e1e3c3a9 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:08.660147 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796ac9d-370d-494e-8c32-ace57f7a9205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:08.661021 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796ac9d-370d-494e-8c32-ace57f7a9205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:08.661330 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796ac9d-370d-494e-8c32-ace57f7a9205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:08.661678 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796ac9d-370d-494e-8c32-ace57f7a9205 admin admin] PATH_INFO: `/v3/users/b2d71e340b34417783d77a447e85aed5` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:08.662886 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796ac9d-370d-494e-8c32-ace57f7a9205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d71e340b34417783d77a447e85aed5)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:08.664815 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796ac9d-370d-494e-8c32-ace57f7a9205 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:08.819700 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-eb1c67cc-8a29-492c-9325-8787e1e3c3a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e79b85171aa24c7ab752d98eb8dccc48'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:08.876774 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-7796ac9d-370d-494e-8c32-ace57f7a9205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d71e340b34417783d77a447e85aed5'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:08.892279 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-eb1c67cc-8a29-492c-9325-8787e1e3c3a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e79b85171aa24c7ab752d98eb8dccc48'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:08.892914 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-eb1c67cc-8a29-492c-9325-8787e1e3c3a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e79b85171aa24c7ab752d98eb8dccc48'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:08.893569 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-eb1c67cc-8a29-492c-9325-8787e1e3c3a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e79b85171aa24c7ab752d98eb8dccc48'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:08.900922 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-eb1c67cc-8a29-492c-9325-8787e1e3c3a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e79b85171aa24c7ab752d98eb8dccc48'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:08.919232 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 934/1856] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:08 2022] DELETE /identity/v3/users/e79b85171aa24c7ab752d98eb8dccc48 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:08.978301 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-7796ac9d-370d-494e-8c32-ace57f7a9205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d71e340b34417783d77a447e85aed5'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:08.979015 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-7796ac9d-370d-494e-8c32-ace57f7a9205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d71e340b34417783d77a447e85aed5'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:08.992081 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-7796ac9d-370d-494e-8c32-ace57f7a9205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d71e340b34417783d77a447e85aed5'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:09.006546 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-7796ac9d-370d-494e-8c32-ace57f7a9205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d71e340b34417783d77a447e85aed5'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:09.021685 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 923/1857] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:08 2022] DELETE /identity/v3/users/b2d71e340b34417783d77a447e85aed5 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:09.495077 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c67cc-8a29-492c-9325-8787e1e3c3a9 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:09.497217 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-eb1c67cc-8a29-492c-9325-8787e1e3c3a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:09.580153 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c67cc-8a29-492c-9325-8787e1e3c3a9 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:09.622021 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796ac9d-370d-494e-8c32-ace57f7a9205 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:09.624470 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-7796ac9d-370d-494e-8c32-ace57f7a9205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:09.643186 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae28ce-69a3-474c-91d0-6d4b60421c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:09.644066 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae28ce-69a3-474c-91d0-6d4b60421c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:09.644353 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae28ce-69a3-474c-91d0-6d4b60421c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:09.644952 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae28ce-69a3-474c-91d0-6d4b60421c5c admin admin] PATH_INFO: `/v3/projects/89111444668e4bbfa55432ee421d36c0` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:09.646559 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae28ce-69a3-474c-91d0-6d4b60421c5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=89111444668e4bbfa55432ee421d36c0)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:09.648528 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae28ce-69a3-474c-91d0-6d4b60421c5c admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:09.716609 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796ac9d-370d-494e-8c32-ace57f7a9205 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:09.722008 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d87e12-262d-4224-be1f-aafedf2155bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:09.722868 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d87e12-262d-4224-be1f-aafedf2155bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:09.723155 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d87e12-262d-4224-be1f-aafedf2155bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:09.723436 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d87e12-262d-4224-be1f-aafedf2155bd admin admin] PATH_INFO: `/v3/projects/41bfb86970864001bd75d4d39eabeff4` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:09.724620 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d87e12-262d-4224-be1f-aafedf2155bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=41bfb86970864001bd75d4d39eabeff4)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:09.726567 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d87e12-262d-4224-be1f-aafedf2155bd admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:09.777462 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-94ae28ce-69a3-474c-91d0-6d4b60421c5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89111444668e4bbfa55432ee421d36c0', 'request_id': 'req-94ae28ce-69a3-474c-91d0-6d4b60421c5c'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:09.783480 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-94ae28ce-69a3-474c-91d0-6d4b60421c5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89111444668e4bbfa55432ee421d36c0', 'request_id': 'req-94ae28ce-69a3-474c-91d0-6d4b60421c5c'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:09.789666 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-94ae28ce-69a3-474c-91d0-6d4b60421c5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89111444668e4bbfa55432ee421d36c0', 'request_id': 'req-94ae28ce-69a3-474c-91d0-6d4b60421c5c'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:09.853490 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f0d87e12-262d-4224-be1f-aafedf2155bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41bfb86970864001bd75d4d39eabeff4', 'request_id': 'req-f0d87e12-262d-4224-be1f-aafedf2155bd'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:09.874400 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-94ae28ce-69a3-474c-91d0-6d4b60421c5c admin admin] The token cache is being invalidate because project 89111444668e4bbfa55432ee421d36c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:09.874693 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-94ae28ce-69a3-474c-91d0-6d4b60421c5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:09.880723 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-94ae28ce-69a3-474c-91d0-6d4b60421c5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:09.880723 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 935/1858] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:09 2022] DELETE /identity/v3/projects/89111444668e4bbfa55432ee421d36c0 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:09.881521 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785c8ed-ab76-493e-942b-0cd313daa0a8 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:09.881815 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785c8ed-ab76-493e-942b-0cd313daa0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:09.882100 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785c8ed-ab76-493e-942b-0cd313daa0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:09.899449 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-6785c8ed-ab76-493e-942b-0cd313daa0a8 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:09.900571 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-6785c8ed-ab76-493e-942b-0cd313daa0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:09.926825 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f0d87e12-262d-4224-be1f-aafedf2155bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41bfb86970864001bd75d4d39eabeff4', 'request_id': 'req-f0d87e12-262d-4224-be1f-aafedf2155bd'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:09.932995 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f0d87e12-262d-4224-be1f-aafedf2155bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41bfb86970864001bd75d4d39eabeff4', 'request_id': 'req-f0d87e12-262d-4224-be1f-aafedf2155bd'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:09.945224 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f0d87e12-262d-4224-be1f-aafedf2155bd admin admin] The token cache is being invalidate because project 41bfb86970864001bd75d4d39eabeff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:09.945553 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f0d87e12-262d-4224-be1f-aafedf2155bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:09.946215 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f0d87e12-262d-4224-be1f-aafedf2155bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:09.947895 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 924/1859] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:09 2022] DELETE /identity/v3/projects/41bfb86970864001bd75d4d39eabeff4 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:09.951918 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d87e12-262d-4224-be1f-aafedf2155bd admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:09.955422 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-f0d87e12-262d-4224-be1f-aafedf2155bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:09.971145 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 936/1860] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:21:09.978623 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f653653-b975-4545-8708-07aaf6030ba5 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:09.978900 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f653653-b975-4545-8708-07aaf6030ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:09.979178 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f653653-b975-4545-8708-07aaf6030ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:09.997555 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-9f653653-b975-4545-8708-07aaf6030ba5 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:09.998743 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-9f653653-b975-4545-8708-07aaf6030ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:10.007024 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 937/1861] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:21:10.011016 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f653653-b975-4545-8708-07aaf6030ba5 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:10.017759 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d87e12-262d-4224-be1f-aafedf2155bd admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:10.020709 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f653653-b975-4545-8708-07aaf6030ba5 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:10.022489 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d675b4-ff11-4589-bb5b-f6504a2ae457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:10.023393 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d675b4-ff11-4589-bb5b-f6504a2ae457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:10.023801 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d675b4-ff11-4589-bb5b-f6504a2ae457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:10.024091 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d675b4-ff11-4589-bb5b-f6504a2ae457 admin admin] PATH_INFO: `/v3/users/d54b095982834ef6891ff8ac26d9448e` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:10.025187 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf6f87-3e7e-463a-a24f-bd15b38b9e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:10.025391 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d675b4-ff11-4589-bb5b-f6504a2ae457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d54b095982834ef6891ff8ac26d9448e)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:10.025857 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf6f87-3e7e-463a-a24f-bd15b38b9e3c admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:10.026138 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf6f87-3e7e-463a-a24f-bd15b38b9e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:10.026411 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf6f87-3e7e-463a-a24f-bd15b38b9e3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:10.027112 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf6f87-3e7e-463a-a24f-bd15b38b9e3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:21:10.027318 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d675b4-ff11-4589-bb5b-f6504a2ae457 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:10.027416 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf6f87-3e7e-463a-a24f-bd15b38b9e3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:10.028971 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf6f87-3e7e-463a-a24f-bd15b38b9e3c admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:10.041739 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 938/1862] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:21:10.045879 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf6f87-3e7e-463a-a24f-bd15b38b9e3c admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:10.055698 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf6f87-3e7e-463a-a24f-bd15b38b9e3c admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:10.060485 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbfd6f-de60-4a96-a1a7-afa651b8fb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:10.061169 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbfd6f-de60-4a96-a1a7-afa651b8fb56 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:10.061495 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbfd6f-de60-4a96-a1a7-afa651b8fb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:10.061776 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbfd6f-de60-4a96-a1a7-afa651b8fb56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:10.062820 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbfd6f-de60-4a96-a1a7-afa651b8fb56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:10.064727 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbfd6f-de60-4a96-a1a7-afa651b8fb56 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:10.154061 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 939/1863] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:10 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:21:10.155088 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbfd6f-de60-4a96-a1a7-afa651b8fb56 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:10.214150 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-d3d675b4-ff11-4589-bb5b-f6504a2ae457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd54b095982834ef6891ff8ac26d9448e'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:10.222121 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbfd6f-de60-4a96-a1a7-afa651b8fb56 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:10.226931 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf25e0f-e843-461a-bae6-1a3234d70a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:10.230146 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf25e0f-e843-461a-bae6-1a3234d70a39 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:10.230465 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf25e0f-e843-461a-bae6-1a3234d70a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:10.230966 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf25e0f-e843-461a-bae6-1a3234d70a39 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:10.231681 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf25e0f-e843-461a-bae6-1a3234d70a39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:10.234192 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf25e0f-e843-461a-bae6-1a3234d70a39 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:10.264214 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-d3d675b4-ff11-4589-bb5b-f6504a2ae457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd54b095982834ef6891ff8ac26d9448e'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:10.264933 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-d3d675b4-ff11-4589-bb5b-f6504a2ae457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd54b095982834ef6891ff8ac26d9448e'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:10.273090 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-d3d675b4-ff11-4589-bb5b-f6504a2ae457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd54b095982834ef6891ff8ac26d9448e'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:10.286420 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-d3d675b4-ff11-4589-bb5b-f6504a2ae457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd54b095982834ef6891ff8ac26d9448e'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:10.293120 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 925/1864] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:09 2022] DELETE /identity/v3/users/d54b095982834ef6891ff8ac26d9448e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:10.320659 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 940/1865] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:10 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:21:10.321902 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d675b4-ff11-4589-bb5b-f6504a2ae457 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:10.323966 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-d3d675b4-ff11-4589-bb5b-f6504a2ae457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:10.495296 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d675b4-ff11-4589-bb5b-f6504a2ae457 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:10.510329 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf279a-8a76-43ff-92ab-eb77cde50423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:10.511768 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf279a-8a76-43ff-92ab-eb77cde50423 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:10.512285 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf279a-8a76-43ff-92ab-eb77cde50423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:10.513428 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf279a-8a76-43ff-92ab-eb77cde50423 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:10.514611 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf279a-8a76-43ff-92ab-eb77cde50423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:10.527190 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf279a-8a76-43ff-92ab-eb77cde50423 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:10.546853 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 926/1866] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:21:10.553730 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf25e0f-e843-461a-bae6-1a3234d70a39 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:10.571908 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf25e0f-e843-461a-bae6-1a3234d70a39 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:10.587024 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc37db-e4df-42e4-99cb-b5bfb41179a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:10.587731 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc37db-e4df-42e4-99cb-b5bfb41179a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:10.588021 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc37db-e4df-42e4-99cb-b5bfb41179a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:10.588310 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc37db-e4df-42e4-99cb-b5bfb41179a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:10.589058 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc37db-e4df-42e4-99cb-b5bfb41179a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:10.596677 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc37db-e4df-42e4-99cb-b5bfb41179a6 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:10.624591 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 941/1867] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:10.627984 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf279a-8a76-43ff-92ab-eb77cde50423 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:10.643997 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf279a-8a76-43ff-92ab-eb77cde50423 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:10.652559 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf151d-6de1-4c60-9dfd-a0842f38ebc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:10.653513 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf151d-6de1-4c60-9dfd-a0842f38ebc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:10.653971 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf151d-6de1-4c60-9dfd-a0842f38ebc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:10.654476 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf151d-6de1-4c60-9dfd-a0842f38ebc4 admin admin] PATH_INFO: `/v3/projects/3943382a293240a2a5f8fd9ae0ea663b/users/1460d21ed95f4e6e80a595e1cac731cb/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:10.674670 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf151d-6de1-4c60-9dfd-a0842f38ebc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3943382a293240a2a5f8fd9ae0ea663b, user_id=1460d21ed95f4e6e80a595e1cac731cb, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:10.677736 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf151d-6de1-4c60-9dfd-a0842f38ebc4 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:10.717061 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc37db-e4df-42e4-99cb-b5bfb41179a6 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:10.720719 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-81fc37db-e4df-42e4-99cb-b5bfb41179a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:10.752288 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 927/1868] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:10 2022] PUT /identity/v3/projects/3943382a293240a2a5f8fd9ae0ea663b/users/1460d21ed95f4e6e80a595e1cac731cb/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:10.768105 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6b071-789d-4d1e-baab-9cb66e05ce00 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:10.768405 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6b071-789d-4d1e-baab-9cb66e05ce00 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:10.768692 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6b071-789d-4d1e-baab-9cb66e05ce00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:10.852502 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-51a6b071-789d-4d1e-baab-9cb66e05ce00 None None] MFA Rules not processed for user `1460d21ed95f4e6e80a595e1cac731cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:10.854359 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-51a6b071-789d-4d1e-baab-9cb66e05ce00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:10.896860 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc37db-e4df-42e4-99cb-b5bfb41179a6 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:10.996907 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 928/1869] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:10.999501 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6b071-789d-4d1e-baab-9cb66e05ce00 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:11.033161 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ead9b-77f9-43fd-9438-a64ce0ebe478 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:11.039882 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ead9b-77f9-43fd-9438-a64ce0ebe478 service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:11.039882 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ead9b-77f9-43fd-9438-a64ce0ebe478 service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:11.039882 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ead9b-77f9-43fd-9438-a64ce0ebe478 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:11.039882 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-7f8ead9b-77f9-43fd-9438-a64ce0ebe478 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:11.114159 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6b071-789d-4d1e-baab-9cb66e05ce00 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:11.119258 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f3091-cb58-40d6-8312-7842b684e0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:11.119992 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f3091-cb58-40d6-8312-7842b684e0fc admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:11.120314 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f3091-cb58-40d6-8312-7842b684e0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:11.120605 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f3091-cb58-40d6-8312-7842b684e0fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:11.121668 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f3091-cb58-40d6-8312-7842b684e0fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:11.123792 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f3091-cb58-40d6-8312-7842b684e0fc admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:11.126592 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ead9b-77f9-43fd-9438-a64ce0ebe478 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:11.128100 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ead9b-77f9-43fd-9438-a64ce0ebe478 service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:11.140325 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 942/1870] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:10 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:21:11.145651 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ead9b-77f9-43fd-9438-a64ce0ebe478 service cinder] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:11.148999 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-7f8ead9b-77f9-43fd-9438-a64ce0ebe478 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:11.162682 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ead9b-77f9-43fd-9438-a64ce0ebe478 service cinder] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:11.168326 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b87c4-0ec4-4545-aa68-bb99f88de2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:11.169262 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b87c4-0ec4-4545-aa68-bb99f88de2a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:11.169646 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b87c4-0ec4-4545-aa68-bb99f88de2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:11.177936 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b87c4-0ec4-4545-aa68-bb99f88de2a1 admin admin] PATH_INFO: `/v3/projects/de64370b47544757b8ef53ad395f723d` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:11.177936 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b87c4-0ec4-4545-aa68-bb99f88de2a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de64370b47544757b8ef53ad395f723d)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:11.177936 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b87c4-0ec4-4545-aa68-bb99f88de2a1 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:11.219928 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 929/1871] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:10 2022] POST /identity/v3/projects => generated 387 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:11.223800 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f3091-cb58-40d6-8312-7842b684e0fc admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:11.287909 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f3091-cb58-40d6-8312-7842b684e0fc admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:11.293846 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e19fd2-29a7-45bf-b3d5-92ad795ffdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:11.295343 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e19fd2-29a7-45bf-b3d5-92ad795ffdcb admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:11.295687 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e19fd2-29a7-45bf-b3d5-92ad795ffdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:11.295978 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e19fd2-29a7-45bf-b3d5-92ad795ffdcb admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:11.296914 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e19fd2-29a7-45bf-b3d5-92ad795ffdcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:11.299696 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e19fd2-29a7-45bf-b3d5-92ad795ffdcb admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:11.316878 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-429b87c4-0ec4-4545-aa68-bb99f88de2a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de64370b47544757b8ef53ad395f723d', 'request_id': 'req-429b87c4-0ec4-4545-aa68-bb99f88de2a1'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:11.324460 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-429b87c4-0ec4-4545-aa68-bb99f88de2a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de64370b47544757b8ef53ad395f723d', 'request_id': 'req-429b87c4-0ec4-4545-aa68-bb99f88de2a1'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:11.333872 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-429b87c4-0ec4-4545-aa68-bb99f88de2a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de64370b47544757b8ef53ad395f723d', 'request_id': 'req-429b87c4-0ec4-4545-aa68-bb99f88de2a1'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:11.413185 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-429b87c4-0ec4-4545-aa68-bb99f88de2a1 admin admin] The token cache is being invalidate because project de64370b47544757b8ef53ad395f723d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:11.413505 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-429b87c4-0ec4-4545-aa68-bb99f88de2a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:11.415431 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-429b87c4-0ec4-4545-aa68-bb99f88de2a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:11.415530 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 930/1872] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:11 2022] POST /identity/v3/users => generated 300 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:21:11.415910 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 943/1873] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:11 2022] DELETE /identity/v3/projects/de64370b47544757b8ef53ad395f723d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:11.418800 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e19fd2-29a7-45bf-b3d5-92ad795ffdcb admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:11.421192 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-08e19fd2-29a7-45bf-b3d5-92ad795ffdcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:11.421775 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b626a-7962-4a17-aede-15199ecd3683 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:11.422198 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b626a-7962-4a17-aede-15199ecd3683 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:11.422558 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b626a-7962-4a17-aede-15199ecd3683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:11.443349 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e19fd2-29a7-45bf-b3d5-92ad795ffdcb admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:11.444756 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-3c2b626a-7962-4a17-aede-15199ecd3683 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:11.446276 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-3c2b626a-7962-4a17-aede-15199ecd3683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:11.537370 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e891a2-cf82-4d16-9e52-0fbc0541308a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:11.539735 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e891a2-cf82-4d16-9e52-0fbc0541308a admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:11.540836 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e891a2-cf82-4d16-9e52-0fbc0541308a admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:11.541126 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e891a2-cf82-4d16-9e52-0fbc0541308a admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:11.543287 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e891a2-cf82-4d16-9e52-0fbc0541308a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:11.544886 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e891a2-cf82-4d16-9e52-0fbc0541308a admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:11.557549 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 944/1874] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:11.558073 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 931/1875] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:11.561585 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b626a-7962-4a17-aede-15199ecd3683 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:11.565174 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985c50f-75d0-4903-b206-53a47ac1f5a9 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:11.569006 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985c50f-75d0-4903-b206-53a47ac1f5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:11.569314 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985c50f-75d0-4903-b206-53a47ac1f5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:11.574874 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b626a-7962-4a17-aede-15199ecd3683 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:11.581192 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab046f-0dcc-411f-8642-17ff6ec70a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:11.582428 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab046f-0dcc-411f-8642-17ff6ec70a6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:11.582798 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab046f-0dcc-411f-8642-17ff6ec70a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:11.583162 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab046f-0dcc-411f-8642-17ff6ec70a6f admin admin] PATH_INFO: `/v3/projects/39292ffbcb47467e8bb79eb0db1dd007/users/708310b3ebf54e71955c747a4a0e39c5/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:11.591069 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-e985c50f-75d0-4903-b206-53a47ac1f5a9 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:11.592311 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-e985c50f-75d0-4903-b206-53a47ac1f5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:11.599839 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab046f-0dcc-411f-8642-17ff6ec70a6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=39292ffbcb47467e8bb79eb0db1dd007, user_id=708310b3ebf54e71955c747a4a0e39c5, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:11.604021 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 932/1876] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:11.604168 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab046f-0dcc-411f-8642-17ff6ec70a6f admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:11.606451 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985c50f-75d0-4903-b206-53a47ac1f5a9 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:11.616069 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985c50f-75d0-4903-b206-53a47ac1f5a9 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:11.621125 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163415e5-103b-4f98-b1e4-52250bf3314a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:11.621896 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163415e5-103b-4f98-b1e4-52250bf3314a admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:11.627878 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163415e5-103b-4f98-b1e4-52250bf3314a admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:11.627878 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163415e5-103b-4f98-b1e4-52250bf3314a admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:11.627878 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163415e5-103b-4f98-b1e4-52250bf3314a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:21:11.627878 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163415e5-103b-4f98-b1e4-52250bf3314a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:11.627878 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163415e5-103b-4f98-b1e4-52250bf3314a admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:11.637939 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 933/1877] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:21:11.642914 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163415e5-103b-4f98-b1e4-52250bf3314a admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:11.658288 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163415e5-103b-4f98-b1e4-52250bf3314a admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:11.663295 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b393bbc-4e56-4e33-afb3-e9173298944c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:11.663967 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b393bbc-4e56-4e33-afb3-e9173298944c admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:11.664256 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b393bbc-4e56-4e33-afb3-e9173298944c admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:11.664561 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b393bbc-4e56-4e33-afb3-e9173298944c admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:11.665276 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b393bbc-4e56-4e33-afb3-e9173298944c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:11.667209 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b393bbc-4e56-4e33-afb3-e9173298944c admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:11.683004 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 945/1878] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:11 2022] PUT /identity/v3/projects/39292ffbcb47467e8bb79eb0db1dd007/users/708310b3ebf54e71955c747a4a0e39c5/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:11.687015 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab046f-0dcc-411f-8642-17ff6ec70a6f admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:11.755881 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab046f-0dcc-411f-8642-17ff6ec70a6f admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:11.760473 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a3a40-c79b-4b01-b1c4-edf93703bdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:11.761133 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a3a40-c79b-4b01-b1c4-edf93703bdfd admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:11.761445 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a3a40-c79b-4b01-b1c4-edf93703bdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:11.761724 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a3a40-c79b-4b01-b1c4-edf93703bdfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:11.762437 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a3a40-c79b-4b01-b1c4-edf93703bdfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:11.764015 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a3a40-c79b-4b01-b1c4-edf93703bdfd admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:11.774465 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 946/1879] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:21:11.778450 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a3a40-c79b-4b01-b1c4-edf93703bdfd admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:11.779481 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 934/1880] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:11 2022] POST /identity/v3/projects => generated 391 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:11.784170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b393bbc-4e56-4e33-afb3-e9173298944c admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:11.789123 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a3a40-c79b-4b01-b1c4-edf93703bdfd admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:11.854170 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda4d21-ef1e-4360-8a86-28cff507ad0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:11.855349 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda4d21-ef1e-4360-8a86-28cff507ad0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:11.855689 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda4d21-ef1e-4360-8a86-28cff507ad0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:11.856058 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda4d21-ef1e-4360-8a86-28cff507ad0b admin admin] PATH_INFO: `/v3/projects/39292ffbcb47467e8bb79eb0db1dd007/users/708310b3ebf54e71955c747a4a0e39c5/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:11.858253 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda4d21-ef1e-4360-8a86-28cff507ad0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=39292ffbcb47467e8bb79eb0db1dd007, user_id=708310b3ebf54e71955c747a4a0e39c5, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:11.861020 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda4d21-ef1e-4360-8a86-28cff507ad0b admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:11.864882 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b393bbc-4e56-4e33-afb3-e9173298944c admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:11.871669 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1343417-54b2-4d3d-a2e0-5c04418b0624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:11.872696 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1343417-54b2-4d3d-a2e0-5c04418b0624 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:11.873058 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1343417-54b2-4d3d-a2e0-5c04418b0624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:11.873443 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1343417-54b2-4d3d-a2e0-5c04418b0624 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:11.874345 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1343417-54b2-4d3d-a2e0-5c04418b0624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:11.881330 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 947/1881] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:11 2022] PUT /identity/v3/projects/39292ffbcb47467e8bb79eb0db1dd007/users/708310b3ebf54e71955c747a4a0e39c5/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:11.881494 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1343417-54b2-4d3d-a2e0-5c04418b0624 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:11.896555 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5c0b2-9e38-4a42-98f6-e6ec8621f885 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:11.896555 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5c0b2-9e38-4a42-98f6-e6ec8621f885 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:11.896555 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5c0b2-9e38-4a42-98f6-e6ec8621f885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:11.920108 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-f3a5c0b2-9e38-4a42-98f6-e6ec8621f885 None None] MFA Rules not processed for user `708310b3ebf54e71955c747a4a0e39c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:11.924147 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-f3a5c0b2-9e38-4a42-98f6-e6ec8621f885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:11.974207 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 935/1882] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:11 2022] POST /identity/v3/users => generated 296 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:21:11.979219 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1343417-54b2-4d3d-a2e0-5c04418b0624 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:11.990341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1343417-54b2-4d3d-a2e0-5c04418b0624 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:11.998190 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 948/1883] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:12.006640 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5c0b2-9e38-4a42-98f6-e6ec8621f885 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:12.008140 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-f3a5c0b2-9e38-4a42-98f6-e6ec8621f885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:12.056415 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8feaba8-ce12-45a6-aad4-f657d17f4aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:12.057081 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8feaba8-ce12-45a6-aad4-f657d17f4aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:12.057405 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8feaba8-ce12-45a6-aad4-f657d17f4aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:12.057689 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8feaba8-ce12-45a6-aad4-f657d17f4aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:12.058423 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8feaba8-ce12-45a6-aad4-f657d17f4aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:12.060033 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8feaba8-ce12-45a6-aad4-f657d17f4aa2 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:12.073385 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 936/1884] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:12.073574 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5c0b2-9e38-4a42-98f6-e6ec8621f885 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:12.076558 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8feaba8-ce12-45a6-aad4-f657d17f4aa2 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:12.077175 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0bff8-95aa-409c-b77e-eebd35d631f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:12.077861 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0bff8-95aa-409c-b77e-eebd35d631f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:12.078250 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0bff8-95aa-409c-b77e-eebd35d631f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:12.079205 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0bff8-95aa-409c-b77e-eebd35d631f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:12.088177 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8feaba8-ce12-45a6-aad4-f657d17f4aa2 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:12.091225 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0bff8-95aa-409c-b77e-eebd35d631f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:12.093052 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0bff8-95aa-409c-b77e-eebd35d631f8 service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:12.096511 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa84a5-b23b-415a-b965-93e1694ea626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:12.097190 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa84a5-b23b-415a-b965-93e1694ea626 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:12.097512 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa84a5-b23b-415a-b965-93e1694ea626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:12.097793 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa84a5-b23b-415a-b965-93e1694ea626 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:12.098531 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa84a5-b23b-415a-b965-93e1694ea626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:12.100201 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa84a5-b23b-415a-b965-93e1694ea626 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:12.112509 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 949/1885] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:21:12.119279 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 937/1886] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:12.123489 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0bff8-95aa-409c-b77e-eebd35d631f8 service cinder] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:12.143595 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0bff8-95aa-409c-b77e-eebd35d631f8 service cinder] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:12.150206 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e836ae-6254-4c81-b939-d8e9fc39f07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:12.151126 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e836ae-6254-4c81-b939-d8e9fc39f07a admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:12.151413 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e836ae-6254-4c81-b939-d8e9fc39f07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:12.151689 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e836ae-6254-4c81-b939-d8e9fc39f07a admin admin] PATH_INFO: `/v3/projects/4d7474bc06ae489b9959d9178eb4e642/users/f76904a7b5924e7b9108561473321ece/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:12.158170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa84a5-b23b-415a-b965-93e1694ea626 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:12.170252 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e836ae-6254-4c81-b939-d8e9fc39f07a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d7474bc06ae489b9959d9178eb4e642, user_id=f76904a7b5924e7b9108561473321ece, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:12.171478 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa84a5-b23b-415a-b965-93e1694ea626 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:12.174907 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e836ae-6254-4c81-b939-d8e9fc39f07a admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:12.178331 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9871a2f-9b1c-4051-91bd-9323d8ec3a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:12.179413 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9871a2f-9b1c-4051-91bd-9323d8ec3a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:12.180442 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9871a2f-9b1c-4051-91bd-9323d8ec3a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:12.180917 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9871a2f-9b1c-4051-91bd-9323d8ec3a5f admin admin] PATH_INFO: `/v3/users/1460d21ed95f4e6e80a595e1cac731cb` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:12.184028 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9871a2f-9b1c-4051-91bd-9323d8ec3a5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1460d21ed95f4e6e80a595e1cac731cb)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:12.186043 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9871a2f-9b1c-4051-91bd-9323d8ec3a5f admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:12.291077 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 950/1887] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:12 2022] PUT /identity/v3/projects/4d7474bc06ae489b9959d9178eb4e642/users/f76904a7b5924e7b9108561473321ece/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:12.303964 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3ca5b-493f-4bb5-a8b9-e14ec9a4f58a None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:12.304259 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3ca5b-493f-4bb5-a8b9-e14ec9a4f58a None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:12.304542 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3ca5b-493f-4bb5-a8b9-e14ec9a4f58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:12.331151 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-02b3ca5b-493f-4bb5-a8b9-e14ec9a4f58a None None] MFA Rules not processed for user `f76904a7b5924e7b9108561473321ece`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:12.332373 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-02b3ca5b-493f-4bb5-a8b9-e14ec9a4f58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:12.396493 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 951/1888] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:21:12.401139 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3ca5b-493f-4bb5-a8b9-e14ec9a4f58a None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:12.411914 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f9871a2f-9b1c-4051-91bd-9323d8ec3a5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1460d21ed95f4e6e80a595e1cac731cb'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:12.469485 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3ca5b-493f-4bb5-a8b9-e14ec9a4f58a None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:12.474393 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278577e-8850-4f14-88ec-02ddd7970201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:12.475086 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278577e-8850-4f14-88ec-02ddd7970201 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:12.475339 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278577e-8850-4f14-88ec-02ddd7970201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:12.475618 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278577e-8850-4f14-88ec-02ddd7970201 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:12.476310 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278577e-8850-4f14-88ec-02ddd7970201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:12.478222 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278577e-8850-4f14-88ec-02ddd7970201 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:12.503915 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f9871a2f-9b1c-4051-91bd-9323d8ec3a5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1460d21ed95f4e6e80a595e1cac731cb'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:12.504577 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f9871a2f-9b1c-4051-91bd-9323d8ec3a5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1460d21ed95f4e6e80a595e1cac731cb'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:12.512320 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f9871a2f-9b1c-4051-91bd-9323d8ec3a5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1460d21ed95f4e6e80a595e1cac731cb'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:12.524630 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f9871a2f-9b1c-4051-91bd-9323d8ec3a5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1460d21ed95f4e6e80a595e1cac731cb'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:12.530628 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 938/1889] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:12 2022] DELETE /identity/v3/users/1460d21ed95f4e6e80a595e1cac731cb => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:12.535673 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc92d53-f5af-4ec4-a382-0c805d70f3a1 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:12.535984 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc92d53-f5af-4ec4-a382-0c805d70f3a1 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:12.536267 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc92d53-f5af-4ec4-a382-0c805d70f3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:12.551045 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 952/1890] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:12 2022] POST /identity/v3/projects => generated 391 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:21:12.553969 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-2bc92d53-f5af-4ec4-a382-0c805d70f3a1 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:12.555213 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-2bc92d53-f5af-4ec4-a382-0c805d70f3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:12.555386 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278577e-8850-4f14-88ec-02ddd7970201 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:12.556974 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-9278577e-8850-4f14-88ec-02ddd7970201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:12.623899 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 939/1891] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:21:12.632916 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278577e-8850-4f14-88ec-02ddd7970201 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:12.637678 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325598e-4aaf-4046-855a-d3419b3eaee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:12.638357 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325598e-4aaf-4046-855a-d3419b3eaee1 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:12.638654 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325598e-4aaf-4046-855a-d3419b3eaee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:12.638922 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325598e-4aaf-4046-855a-d3419b3eaee1 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:12.639609 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325598e-4aaf-4046-855a-d3419b3eaee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:12.642359 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325598e-4aaf-4046-855a-d3419b3eaee1 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:12.648956 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc92d53-f5af-4ec4-a382-0c805d70f3a1 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:12.651244 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-2bc92d53-f5af-4ec4-a382-0c805d70f3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:12.709200 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc92d53-f5af-4ec4-a382-0c805d70f3a1 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:12.713389 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe2496-1b60-44f9-96d2-81706abe2a43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:12.714356 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe2496-1b60-44f9-96d2-81706abe2a43 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:12.714646 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe2496-1b60-44f9-96d2-81706abe2a43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:12.714926 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe2496-1b60-44f9-96d2-81706abe2a43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:12.724585 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 953/1892] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:12 2022] POST /identity/v3/users => generated 302 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:12.728100 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe2496-1b60-44f9-96d2-81706abe2a43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:12.728813 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325598e-4aaf-4046-855a-d3419b3eaee1 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:12.729578 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe2496-1b60-44f9-96d2-81706abe2a43 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:12.750219 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 940/1893] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:21:12.750336 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325598e-4aaf-4046-855a-d3419b3eaee1 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:12.754529 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f355d-471c-4c45-98da-24dbc80449f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:12.755216 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f355d-471c-4c45-98da-24dbc80449f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:12.755607 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f355d-471c-4c45-98da-24dbc80449f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:12.755766 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f355d-471c-4c45-98da-24dbc80449f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:12.756484 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f355d-471c-4c45-98da-24dbc80449f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:12.758115 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f355d-471c-4c45-98da-24dbc80449f9 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:12.774533 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 954/1894] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:21:12.775578 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe2496-1b60-44f9-96d2-81706abe2a43 service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:12.787896 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe2496-1b60-44f9-96d2-81706abe2a43 service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:12.794141 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422e0e8-7e53-4630-b381-e3a460019004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:12.795777 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422e0e8-7e53-4630-b381-e3a460019004 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:12.796073 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422e0e8-7e53-4630-b381-e3a460019004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:12.796828 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422e0e8-7e53-4630-b381-e3a460019004 admin admin] PATH_INFO: `/v3/projects/562a54bdbd6e4487847b9691b7f5b788/users/7ac5a387723946f28969ca943c051d26/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:12.815404 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422e0e8-7e53-4630-b381-e3a460019004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=562a54bdbd6e4487847b9691b7f5b788, user_id=7ac5a387723946f28969ca943c051d26, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:12.818010 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422e0e8-7e53-4630-b381-e3a460019004 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:12.882157 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 941/1895] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:12 2022] PUT /identity/v3/projects/562a54bdbd6e4487847b9691b7f5b788/users/7ac5a387723946f28969ca943c051d26/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:12.886777 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f355d-471c-4c45-98da-24dbc80449f9 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:12.899147 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f355d-471c-4c45-98da-24dbc80449f9 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:12.973189 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830cbc8-cfba-4c1e-a03e-5fa070a22466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:12.973189 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830cbc8-cfba-4c1e-a03e-5fa070a22466 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:12.973189 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830cbc8-cfba-4c1e-a03e-5fa070a22466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:12.973189 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830cbc8-cfba-4c1e-a03e-5fa070a22466 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:12.973597 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830cbc8-cfba-4c1e-a03e-5fa070a22466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:12.973597 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830cbc8-cfba-4c1e-a03e-5fa070a22466 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:12.980420 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 955/1896] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:12.984947 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422e0e8-7e53-4630-b381-e3a460019004 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:12.997459 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422e0e8-7e53-4630-b381-e3a460019004 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:13.004024 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3db35b-4b67-41af-85a8-2515a7c32d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:13.004921 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3db35b-4b67-41af-85a8-2515a7c32d9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:13.005199 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3db35b-4b67-41af-85a8-2515a7c32d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:13.005512 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3db35b-4b67-41af-85a8-2515a7c32d9e admin admin] PATH_INFO: `/v3/projects/562a54bdbd6e4487847b9691b7f5b788/users/7ac5a387723946f28969ca943c051d26/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:13.009194 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3db35b-4b67-41af-85a8-2515a7c32d9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=562a54bdbd6e4487847b9691b7f5b788, user_id=7ac5a387723946f28969ca943c051d26, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:13.011984 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3db35b-4b67-41af-85a8-2515a7c32d9e admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:13.023874 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 942/1897] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:12 2022] PUT /identity/v3/projects/562a54bdbd6e4487847b9691b7f5b788/users/7ac5a387723946f28969ca943c051d26/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:13.034636 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0247130-8ec5-496e-ad62-7bcc49b052d4 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:13.034940 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0247130-8ec5-496e-ad62-7bcc49b052d4 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:13.037077 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0247130-8ec5-496e-ad62-7bcc49b052d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:13.064285 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-e0247130-8ec5-496e-ad62-7bcc49b052d4 None None] MFA Rules not processed for user `7ac5a387723946f28969ca943c051d26`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:13.065653 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e0247130-8ec5-496e-ad62-7bcc49b052d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:13.139748 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 956/1898] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:13.152025 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3db35b-4b67-41af-85a8-2515a7c32d9e admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:13.154193 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-aa3db35b-4b67-41af-85a8-2515a7c32d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:13.214356 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3db35b-4b67-41af-85a8-2515a7c32d9e admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:13.218463 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413cfd0-eb3e-4340-800f-8664e0d6cca7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:13.219223 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413cfd0-eb3e-4340-800f-8664e0d6cca7 service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:13.219582 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413cfd0-eb3e-4340-800f-8664e0d6cca7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:13.219927 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413cfd0-eb3e-4340-800f-8664e0d6cca7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:13.225814 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0247130-8ec5-496e-ad62-7bcc49b052d4 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:13.227920 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e0247130-8ec5-496e-ad62-7bcc49b052d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:13.231205 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413cfd0-eb3e-4340-800f-8664e0d6cca7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:13.232827 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413cfd0-eb3e-4340-800f-8664e0d6cca7 service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:13.244325 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 943/1899] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:21:13.317259 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413cfd0-eb3e-4340-800f-8664e0d6cca7 service cinder] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:13.326683 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413cfd0-eb3e-4340-800f-8664e0d6cca7 service cinder] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:13.331900 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b4a92-2434-47ef-ae64-b84dec548972 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:13.332578 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b4a92-2434-47ef-ae64-b84dec548972 service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:13.332864 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b4a92-2434-47ef-ae64-b84dec548972 service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:13.333202 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b4a92-2434-47ef-ae64-b84dec548972 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:13.335193 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-803b4a92-2434-47ef-ae64-b84dec548972 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:13.358288 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0247130-8ec5-496e-ad62-7bcc49b052d4 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:13.365217 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee31ec-29b1-47f8-9840-21626f7a283b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:13.366349 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee31ec-29b1-47f8-9840-21626f7a283b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:13.366734 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee31ec-29b1-47f8-9840-21626f7a283b admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:13.367157 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee31ec-29b1-47f8-9840-21626f7a283b admin admin] PATH_INFO: `/v3/projects/3943382a293240a2a5f8fd9ae0ea663b` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:13.368516 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee31ec-29b1-47f8-9840-21626f7a283b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3943382a293240a2a5f8fd9ae0ea663b)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:13.371042 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee31ec-29b1-47f8-9840-21626f7a283b admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:13.415968 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b4a92-2434-47ef-ae64-b84dec548972 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:13.417610 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b4a92-2434-47ef-ae64-b84dec548972 service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:13.430734 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 944/1900] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:21:13.481169 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c3ee31ec-29b1-47f8-9840-21626f7a283b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3943382a293240a2a5f8fd9ae0ea663b', 'request_id': 'req-c3ee31ec-29b1-47f8-9840-21626f7a283b'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:13.508190 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c3ee31ec-29b1-47f8-9840-21626f7a283b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3943382a293240a2a5f8fd9ae0ea663b', 'request_id': 'req-c3ee31ec-29b1-47f8-9840-21626f7a283b'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:13.520607 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c3ee31ec-29b1-47f8-9840-21626f7a283b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3943382a293240a2a5f8fd9ae0ea663b', 'request_id': 'req-c3ee31ec-29b1-47f8-9840-21626f7a283b'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:13.606876 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c3ee31ec-29b1-47f8-9840-21626f7a283b admin admin] The token cache is being invalidate because project 3943382a293240a2a5f8fd9ae0ea663b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:13.607263 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c3ee31ec-29b1-47f8-9840-21626f7a283b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:13.608055 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c3ee31ec-29b1-47f8-9840-21626f7a283b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:13.609906 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 957/1901] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:13 2022] DELETE /identity/v3/projects/3943382a293240a2a5f8fd9ae0ea663b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:13.613798 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b4a92-2434-47ef-ae64-b84dec548972 service cinder] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:13.626570 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b4a92-2434-47ef-ae64-b84dec548972 service cinder] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:13.684051 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30280fec-2874-4aa0-bfbf-195b61761561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:13.684937 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30280fec-2874-4aa0-bfbf-195b61761561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:13.685226 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30280fec-2874-4aa0-bfbf-195b61761561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:13.685534 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30280fec-2874-4aa0-bfbf-195b61761561 admin admin] PATH_INFO: `/v3/users/708310b3ebf54e71955c747a4a0e39c5` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:13.686762 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30280fec-2874-4aa0-bfbf-195b61761561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=708310b3ebf54e71955c747a4a0e39c5)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:13.690147 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30280fec-2874-4aa0-bfbf-195b61761561 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:13.924995 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-30280fec-2874-4aa0-bfbf-195b61761561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '708310b3ebf54e71955c747a4a0e39c5'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:13.995375 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-30280fec-2874-4aa0-bfbf-195b61761561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '708310b3ebf54e71955c747a4a0e39c5'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:13.996022 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-30280fec-2874-4aa0-bfbf-195b61761561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '708310b3ebf54e71955c747a4a0e39c5'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:14.004031 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-30280fec-2874-4aa0-bfbf-195b61761561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '708310b3ebf54e71955c747a4a0e39c5'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:14.015583 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-30280fec-2874-4aa0-bfbf-195b61761561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '708310b3ebf54e71955c747a4a0e39c5'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:14.021923 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 945/1902] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:13 2022] DELETE /identity/v3/users/708310b3ebf54e71955c747a4a0e39c5 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:14.066047 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee31ec-29b1-47f8-9840-21626f7a283b admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:14.067608 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-c3ee31ec-29b1-47f8-9840-21626f7a283b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:14.083580 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee31ec-29b1-47f8-9840-21626f7a283b admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:14.145138 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b3d7c-eaaf-4538-8ab2-54cf498d545e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:14.146116 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b3d7c-eaaf-4538-8ab2-54cf498d545e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:14.146400 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b3d7c-eaaf-4538-8ab2-54cf498d545e admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:14.146678 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b3d7c-eaaf-4538-8ab2-54cf498d545e admin admin] PATH_INFO: `/v3/users/5a31a1b17add447a98309270b6d52f02` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:14.147897 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b3d7c-eaaf-4538-8ab2-54cf498d545e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a31a1b17add447a98309270b6d52f02)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:14.150007 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b3d7c-eaaf-4538-8ab2-54cf498d545e admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:14.347345 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ec4b3d7c-eaaf-4538-8ab2-54cf498d545e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a31a1b17add447a98309270b6d52f02'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:14.503302 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ec4b3d7c-eaaf-4538-8ab2-54cf498d545e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a31a1b17add447a98309270b6d52f02'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:14.504295 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ec4b3d7c-eaaf-4538-8ab2-54cf498d545e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a31a1b17add447a98309270b6d52f02'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:14.504976 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ec4b3d7c-eaaf-4538-8ab2-54cf498d545e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a31a1b17add447a98309270b6d52f02'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:14.512377 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30280fec-2874-4aa0-bfbf-195b61761561 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:14.514036 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-30280fec-2874-4aa0-bfbf-195b61761561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:14.519728 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ec4b3d7c-eaaf-4538-8ab2-54cf498d545e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a31a1b17add447a98309270b6d52f02'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:14.529656 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30280fec-2874-4aa0-bfbf-195b61761561 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:14.536175 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbfb5a-0050-4bf7-8cb0-df7846074755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:14.537670 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbfb5a-0050-4bf7-8cb0-df7846074755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:14.538038 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbfb5a-0050-4bf7-8cb0-df7846074755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:14.538398 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbfb5a-0050-4bf7-8cb0-df7846074755 admin admin] PATH_INFO: `/v3/projects/39292ffbcb47467e8bb79eb0db1dd007` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:14.539758 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bbfb5a-0050-4bf7-8cb0-df7846074755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39292ffbcb47467e8bb79eb0db1dd007)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:14.541799 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bbfb5a-0050-4bf7-8cb0-df7846074755 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:14.559153 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 958/1903] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:14 2022] DELETE /identity/v3/users/5a31a1b17add447a98309270b6d52f02 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:14.561088 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7c2a5-6dce-44f6-bd38-01d871e37723 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:14.561370 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7c2a5-6dce-44f6-bd38-01d871e37723 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:14.561663 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7c2a5-6dce-44f6-bd38-01d871e37723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:14.580983 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-b9d7c2a5-6dce-44f6-bd38-01d871e37723 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:14.582664 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b9d7c2a5-6dce-44f6-bd38-01d871e37723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:14.642421 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 959/1904] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:14.652722 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7c2a5-6dce-44f6-bd38-01d871e37723 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:14.654195 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b9d7c2a5-6dce-44f6-bd38-01d871e37723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:14.677691 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-61bbfb5a-0050-4bf7-8cb0-df7846074755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39292ffbcb47467e8bb79eb0db1dd007', 'request_id': 'req-61bbfb5a-0050-4bf7-8cb0-df7846074755'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:14.721710 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7c2a5-6dce-44f6-bd38-01d871e37723 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:14.767330 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-61bbfb5a-0050-4bf7-8cb0-df7846074755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39292ffbcb47467e8bb79eb0db1dd007', 'request_id': 'req-61bbfb5a-0050-4bf7-8cb0-df7846074755'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:14.773383 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77169947-2b66-4a77-be0c-c98ed7f20020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:14.773709 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77169947-2b66-4a77-be0c-c98ed7f20020 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:14.773835 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-61bbfb5a-0050-4bf7-8cb0-df7846074755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39292ffbcb47467e8bb79eb0db1dd007', 'request_id': 'req-61bbfb5a-0050-4bf7-8cb0-df7846074755'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:14.773989 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77169947-2b66-4a77-be0c-c98ed7f20020 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:14.774425 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77169947-2b66-4a77-be0c-c98ed7f20020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:14.786937 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-61bbfb5a-0050-4bf7-8cb0-df7846074755 admin admin] The token cache is being invalidate because project 39292ffbcb47467e8bb79eb0db1dd007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:14.787289 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-61bbfb5a-0050-4bf7-8cb0-df7846074755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:14.788122 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-61bbfb5a-0050-4bf7-8cb0-df7846074755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:14.790036 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 946/1905] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:14 2022] DELETE /identity/v3/projects/39292ffbcb47467e8bb79eb0db1dd007 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:14.794657 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770a643-f719-4bce-a255-e7198ca8972d None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:14.795166 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770a643-f719-4bce-a255-e7198ca8972d None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:14.795629 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770a643-f719-4bce-a255-e7198ca8972d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:14.814708 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-d770a643-f719-4bce-a255-e7198ca8972d None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:14.815929 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-d770a643-f719-4bce-a255-e7198ca8972d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:14.844395 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77169947-2b66-4a77-be0c-c98ed7f20020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:14.846122 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77169947-2b66-4a77-be0c-c98ed7f20020 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:14.859800 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 960/1906] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:21:14.882566 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 947/1907] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:21:14.890315 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87310498-0507-4032-b944-3ef9df90b65a None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:14.890618 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87310498-0507-4032-b944-3ef9df90b65a None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:14.890904 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87310498-0507-4032-b944-3ef9df90b65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:14.913820 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-87310498-0507-4032-b944-3ef9df90b65a None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:14.915027 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-87310498-0507-4032-b944-3ef9df90b65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:14.923418 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 961/1908] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:14.931500 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770a643-f719-4bce-a255-e7198ca8972d None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:14.940860 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770a643-f719-4bce-a255-e7198ca8972d None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:14.955545 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d8112-1d81-4007-8338-c5f38b4dbe84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:14.955545 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d8112-1d81-4007-8338-c5f38b4dbe84 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:14.955545 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d8112-1d81-4007-8338-c5f38b4dbe84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:14.955545 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d8112-1d81-4007-8338-c5f38b4dbe84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:14.955905 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d8112-1d81-4007-8338-c5f38b4dbe84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:21:14.955905 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d8112-1d81-4007-8338-c5f38b4dbe84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:14.955905 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d8112-1d81-4007-8338-c5f38b4dbe84 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:14.967190 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 948/1909] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:21:14.971796 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87310498-0507-4032-b944-3ef9df90b65a None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:14.981080 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87310498-0507-4032-b944-3ef9df90b65a None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:14.986168 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417b962-4462-41f5-ac14-41e35df00c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:14.986826 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417b962-4462-41f5-ac14-41e35df00c5e admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:14.987111 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417b962-4462-41f5-ac14-41e35df00c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:14.987389 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417b962-4462-41f5-ac14-41e35df00c5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:14.988119 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417b962-4462-41f5-ac14-41e35df00c5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:14.990055 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417b962-4462-41f5-ac14-41e35df00c5e admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:15.120254 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 962/1910] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:14 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:15.126492 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d8112-1d81-4007-8338-c5f38b4dbe84 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:15.139580 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d8112-1d81-4007-8338-c5f38b4dbe84 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:15.226159 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80be06-2e35-4d3c-910e-d2852e4a7250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:15.234419 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80be06-2e35-4d3c-910e-d2852e4a7250 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:15.234837 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80be06-2e35-4d3c-910e-d2852e4a7250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:15.235427 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80be06-2e35-4d3c-910e-d2852e4a7250 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:15.236815 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80be06-2e35-4d3c-910e-d2852e4a7250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:15.240366 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80be06-2e35-4d3c-910e-d2852e4a7250 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:15.399930 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 949/1911] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:15 2022] POST /identity/v3/users => generated 291 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:15.404625 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417b962-4462-41f5-ac14-41e35df00c5e admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:15.406109 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80be06-2e35-4d3c-910e-d2852e4a7250 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:15.408665 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9e80be06-2e35-4d3c-910e-d2852e4a7250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:15.419299 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417b962-4462-41f5-ac14-41e35df00c5e admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:15.425565 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897b809-f444-4f72-962c-1a707651b681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:15.427029 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897b809-f444-4f72-962c-1a707651b681 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:15.427029 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897b809-f444-4f72-962c-1a707651b681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:15.427283 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897b809-f444-4f72-962c-1a707651b681 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:15.427966 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897b809-f444-4f72-962c-1a707651b681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:15.430126 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897b809-f444-4f72-962c-1a707651b681 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:15.431919 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80be06-2e35-4d3c-910e-d2852e4a7250 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:15.443197 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36add466-3b06-4917-b211-8ad63575a7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:15.444126 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36add466-3b06-4917-b211-8ad63575a7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:15.448568 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 963/1912] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:21:15.452161 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897b809-f444-4f72-962c-1a707651b681 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:15.454714 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36add466-3b06-4917-b211-8ad63575a7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:15.455124 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36add466-3b06-4917-b211-8ad63575a7d3 admin admin] PATH_INFO: `/v3/projects/1d3531dd55fa48a29e992822e6384e3e` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:15.458152 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36add466-3b06-4917-b211-8ad63575a7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3531dd55fa48a29e992822e6384e3e)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:15.460755 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36add466-3b06-4917-b211-8ad63575a7d3 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:15.464814 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897b809-f444-4f72-962c-1a707651b681 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:15.476498 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8d29e-4336-4218-b91d-9ff3524aa98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:15.476910 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8d29e-4336-4218-b91d-9ff3524aa98b admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:15.477780 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8d29e-4336-4218-b91d-9ff3524aa98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:15.477780 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8d29e-4336-4218-b91d-9ff3524aa98b admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:15.496778 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8d29e-4336-4218-b91d-9ff3524aa98b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:15.498476 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8d29e-4336-4218-b91d-9ff3524aa98b admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:15.522924 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 964/1913] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:15.524014 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8d29e-4336-4218-b91d-9ff3524aa98b admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:15.537635 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8d29e-4336-4218-b91d-9ff3524aa98b admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:15.542305 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda93d86-4a87-4e6a-8205-d71b6f230b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:15.543378 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda93d86-4a87-4e6a-8205-d71b6f230b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:15.543667 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda93d86-4a87-4e6a-8205-d71b6f230b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:15.543944 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda93d86-4a87-4e6a-8205-d71b6f230b0e admin admin] PATH_INFO: `/v3/projects/d052f5d0819e42aea14e8778ca5d347a/users/de8d0ab57e3245d7a5f77568b5990c9e/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:15.566373 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda93d86-4a87-4e6a-8205-d71b6f230b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d052f5d0819e42aea14e8778ca5d347a, user_id=de8d0ab57e3245d7a5f77568b5990c9e, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:15.569242 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda93d86-4a87-4e6a-8205-d71b6f230b0e admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:15.658995 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 965/1914] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:15 2022] PUT /identity/v3/projects/d052f5d0819e42aea14e8778ca5d347a/users/de8d0ab57e3245d7a5f77568b5990c9e/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:15.670996 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c22803-e4ff-4c59-b660-c9bc29164077 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:15.671348 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c22803-e4ff-4c59-b660-c9bc29164077 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:15.671814 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c22803-e4ff-4c59-b660-c9bc29164077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:15.678142 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-36add466-3b06-4917-b211-8ad63575a7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3531dd55fa48a29e992822e6384e3e', 'request_id': 'req-36add466-3b06-4917-b211-8ad63575a7d3'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:15.707086 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-c6c22803-e4ff-4c59-b660-c9bc29164077 None None] MFA Rules not processed for user `de8d0ab57e3245d7a5f77568b5990c9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:15.708419 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-c6c22803-e4ff-4c59-b660-c9bc29164077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:15.789363 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 966/1915] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:15.793280 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-36add466-3b06-4917-b211-8ad63575a7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3531dd55fa48a29e992822e6384e3e', 'request_id': 'req-36add466-3b06-4917-b211-8ad63575a7d3'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:15.794068 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c22803-e4ff-4c59-b660-c9bc29164077 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:15.803928 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-36add466-3b06-4917-b211-8ad63575a7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3531dd55fa48a29e992822e6384e3e', 'request_id': 'req-36add466-3b06-4917-b211-8ad63575a7d3'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:15.820700 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-36add466-3b06-4917-b211-8ad63575a7d3 admin admin] The token cache is being invalidate because project 1d3531dd55fa48a29e992822e6384e3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:15.821087 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-36add466-3b06-4917-b211-8ad63575a7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:15.821839 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-36add466-3b06-4917-b211-8ad63575a7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:15.823460 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 950/1916] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:15 2022] DELETE /identity/v3/projects/1d3531dd55fa48a29e992822e6384e3e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:15.827378 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36add466-3b06-4917-b211-8ad63575a7d3 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:15.829328 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-36add466-3b06-4917-b211-8ad63575a7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:15.877801 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c22803-e4ff-4c59-b660-c9bc29164077 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:15.894703 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f046d-1ef3-4789-b820-43a9de18ec8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:15.895454 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f046d-1ef3-4789-b820-43a9de18ec8f admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:15.895789 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f046d-1ef3-4789-b820-43a9de18ec8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:15.896074 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f046d-1ef3-4789-b820-43a9de18ec8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:15.898013 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f046d-1ef3-4789-b820-43a9de18ec8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:15.899079 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f046d-1ef3-4789-b820-43a9de18ec8f admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:15.925499 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36add466-3b06-4917-b211-8ad63575a7d3 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:15.930313 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc715e4-e172-4936-bbab-2da84c13d1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:15.931472 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc715e4-e172-4936-bbab-2da84c13d1f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:15.931959 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc715e4-e172-4936-bbab-2da84c13d1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:15.932378 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc715e4-e172-4936-bbab-2da84c13d1f0 admin admin] PATH_INFO: `/v3/users/cc72db46e95545feb682fcdcb9393a02` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:15.933778 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc715e4-e172-4936-bbab-2da84c13d1f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc72db46e95545feb682fcdcb9393a02)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:15.936015 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc715e4-e172-4936-bbab-2da84c13d1f0 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:16.005460 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 967/1917] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:15 2022] POST /identity/v3/projects => generated 379 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:16.018808 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f046d-1ef3-4789-b820-43a9de18ec8f admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:16.020837 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-ea3f046d-1ef3-4789-b820-43a9de18ec8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:16.091521 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f046d-1ef3-4789-b820-43a9de18ec8f admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:16.097713 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aff4a5-226e-456a-8b6b-6e0ace0732c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:16.098396 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aff4a5-226e-456a-8b6b-6e0ace0732c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:16.098676 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aff4a5-226e-456a-8b6b-6e0ace0732c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:16.098951 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aff4a5-226e-456a-8b6b-6e0ace0732c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:16.099827 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aff4a5-226e-456a-8b6b-6e0ace0732c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:16.101584 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aff4a5-226e-456a-8b6b-6e0ace0732c5 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:16.139688 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-6fc715e4-e172-4936-bbab-2da84c13d1f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc72db46e95545feb682fcdcb9393a02'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:16.196100 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 968/1918] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:16 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:21:16.200023 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aff4a5-226e-456a-8b6b-6e0ace0732c5 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:16.209621 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aff4a5-226e-456a-8b6b-6e0ace0732c5 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:16.212227 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-6fc715e4-e172-4936-bbab-2da84c13d1f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc72db46e95545feb682fcdcb9393a02'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:16.213011 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-6fc715e4-e172-4936-bbab-2da84c13d1f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc72db46e95545feb682fcdcb9393a02'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:16.216712 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010e40d-f9d9-4449-b654-ed76b2c10d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:16.217411 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010e40d-f9d9-4449-b654-ed76b2c10d6d admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:16.217698 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010e40d-f9d9-4449-b654-ed76b2c10d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:16.218043 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010e40d-f9d9-4449-b654-ed76b2c10d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:16.219170 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010e40d-f9d9-4449-b654-ed76b2c10d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:16.220807 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010e40d-f9d9-4449-b654-ed76b2c10d6d admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:16.222714 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-6fc715e4-e172-4936-bbab-2da84c13d1f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc72db46e95545feb682fcdcb9393a02'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:16.232252 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 969/1919] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:21:16.236773 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010e40d-f9d9-4449-b654-ed76b2c10d6d admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:16.238795 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-f010e40d-f9d9-4449-b654-ed76b2c10d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:16.245125 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-6fc715e4-e172-4936-bbab-2da84c13d1f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc72db46e95545feb682fcdcb9393a02'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:16.253393 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 951/1920] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:15 2022] DELETE /identity/v3/users/cc72db46e95545feb682fcdcb9393a02 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:16.258802 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010e40d-f9d9-4449-b654-ed76b2c10d6d admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:16.349580 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ff104-0289-4a0d-8fdc-42622a561825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:16.350543 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ff104-0289-4a0d-8fdc-42622a561825 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:16.350827 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ff104-0289-4a0d-8fdc-42622a561825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:16.353024 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ff104-0289-4a0d-8fdc-42622a561825 admin admin] PATH_INFO: `/v3/projects/b8fdd164c7064052a9e2f77a8c97c07c/users/100eae75544b4b1ba8d9c815f856d65e/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:16.375292 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ff104-0289-4a0d-8fdc-42622a561825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8fdd164c7064052a9e2f77a8c97c07c, user_id=100eae75544b4b1ba8d9c815f856d65e, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:16.378557 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ff104-0289-4a0d-8fdc-42622a561825 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:16.487687 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 970/1921] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:16 2022] PUT /identity/v3/projects/b8fdd164c7064052a9e2f77a8c97c07c/users/100eae75544b4b1ba8d9c815f856d65e/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:16.491685 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc715e4-e172-4936-bbab-2da84c13d1f0 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:16.502008 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc715e4-e172-4936-bbab-2da84c13d1f0 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:16.570588 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e46fbc-20ca-4fc2-a999-91d017e38221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:16.571259 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e46fbc-20ca-4fc2-a999-91d017e38221 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:16.571622 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e46fbc-20ca-4fc2-a999-91d017e38221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:16.572006 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e46fbc-20ca-4fc2-a999-91d017e38221 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:16.572861 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e46fbc-20ca-4fc2-a999-91d017e38221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:16.574627 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e46fbc-20ca-4fc2-a999-91d017e38221 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:16.593366 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 952/1922] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:16.595638 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ff104-0289-4a0d-8fdc-42622a561825 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:16.617477 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ff104-0289-4a0d-8fdc-42622a561825 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:16.633330 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626d3a8-6aa9-4dd3-bfa8-aec3b74eacfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:16.634716 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626d3a8-6aa9-4dd3-bfa8-aec3b74eacfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:16.635038 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626d3a8-6aa9-4dd3-bfa8-aec3b74eacfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:16.635328 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626d3a8-6aa9-4dd3-bfa8-aec3b74eacfb admin admin] PATH_INFO: `/v3/projects/b8fdd164c7064052a9e2f77a8c97c07c/users/100eae75544b4b1ba8d9c815f856d65e/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:16.640426 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626d3a8-6aa9-4dd3-bfa8-aec3b74eacfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8fdd164c7064052a9e2f77a8c97c07c, user_id=100eae75544b4b1ba8d9c815f856d65e, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:16.646163 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626d3a8-6aa9-4dd3-bfa8-aec3b74eacfb admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:16.665454 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 971/1923] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:16 2022] PUT /identity/v3/projects/b8fdd164c7064052a9e2f77a8c97c07c/users/100eae75544b4b1ba8d9c815f856d65e/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:16.676200 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e0af7-5022-48a6-9566-d492ed2a46a9 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:16.676500 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e0af7-5022-48a6-9566-d492ed2a46a9 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:16.676789 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e0af7-5022-48a6-9566-d492ed2a46a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:16.705648 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-3f8e0af7-5022-48a6-9566-d492ed2a46a9 None None] MFA Rules not processed for user `100eae75544b4b1ba8d9c815f856d65e`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:16.706860 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-3f8e0af7-5022-48a6-9566-d492ed2a46a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:16.751927 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626d3a8-6aa9-4dd3-bfa8-aec3b74eacfb admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:16.754206 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-0626d3a8-6aa9-4dd3-bfa8-aec3b74eacfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:16.795023 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 953/1924] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:16.808217 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e0af7-5022-48a6-9566-d492ed2a46a9 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:16.809746 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-3f8e0af7-5022-48a6-9566-d492ed2a46a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:16.856803 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626d3a8-6aa9-4dd3-bfa8-aec3b74eacfb admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:16.864059 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7948ef8-e5e0-4f08-bc7d-c1ab164ce0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:16.865175 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7948ef8-e5e0-4f08-bc7d-c1ab164ce0d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:16.865511 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7948ef8-e5e0-4f08-bc7d-c1ab164ce0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:16.865782 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7948ef8-e5e0-4f08-bc7d-c1ab164ce0d8 admin admin] PATH_INFO: `/v3/projects/c70dad81a0d24620be115cc43e2342a5` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:16.867047 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7948ef8-e5e0-4f08-bc7d-c1ab164ce0d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c70dad81a0d24620be115cc43e2342a5)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:16.869221 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7948ef8-e5e0-4f08-bc7d-c1ab164ce0d8 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:16.873663 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e0af7-5022-48a6-9566-d492ed2a46a9 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:16.878045 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26add7-a10d-4814-ae93-79bfc0592a70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:16.878943 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26add7-a10d-4814-ae93-79bfc0592a70 service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:16.879691 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26add7-a10d-4814-ae93-79bfc0592a70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:16.880523 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26add7-a10d-4814-ae93-79bfc0592a70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:16.893710 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26add7-a10d-4814-ae93-79bfc0592a70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:16.895307 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26add7-a10d-4814-ae93-79bfc0592a70 service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:16.905886 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 954/1925] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:21:17.020719 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a7948ef8-e5e0-4f08-bc7d-c1ab164ce0d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c70dad81a0d24620be115cc43e2342a5', 'request_id': 'req-a7948ef8-e5e0-4f08-bc7d-c1ab164ce0d8'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:17.026898 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a7948ef8-e5e0-4f08-bc7d-c1ab164ce0d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c70dad81a0d24620be115cc43e2342a5', 'request_id': 'req-a7948ef8-e5e0-4f08-bc7d-c1ab164ce0d8'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:17.033896 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a7948ef8-e5e0-4f08-bc7d-c1ab164ce0d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c70dad81a0d24620be115cc43e2342a5', 'request_id': 'req-a7948ef8-e5e0-4f08-bc7d-c1ab164ce0d8'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:17.105929 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a7948ef8-e5e0-4f08-bc7d-c1ab164ce0d8 admin admin] The token cache is being invalidate because project c70dad81a0d24620be115cc43e2342a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:17.105929 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a7948ef8-e5e0-4f08-bc7d-c1ab164ce0d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:17.105929 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a7948ef8-e5e0-4f08-bc7d-c1ab164ce0d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:17.106551 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 972/1926] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:16 2022] DELETE /identity/v3/projects/c70dad81a0d24620be115cc43e2342a5 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:17.111910 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fbbee-6d30-4ee8-ace9-06615d650541 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:17.112216 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fbbee-6d30-4ee8-ace9-06615d650541 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:17.112498 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fbbee-6d30-4ee8-ace9-06615d650541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:17.137743 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-119fbbee-6d30-4ee8-ace9-06615d650541 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:17.139330 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-119fbbee-6d30-4ee8-ace9-06615d650541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:17.201089 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 955/1927] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:21:17.209828 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dbc3e-04da-46a2-8bbb-ee1f833f0e39 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:17.210369 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dbc3e-04da-46a2-8bbb-ee1f833f0e39 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:17.210480 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dbc3e-04da-46a2-8bbb-ee1f833f0e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:17.232983 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-ce6dbc3e-04da-46a2-8bbb-ee1f833f0e39 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:17.235065 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-ce6dbc3e-04da-46a2-8bbb-ee1f833f0e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:17.249407 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 973/1928] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:17.254463 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fbbee-6d30-4ee8-ace9-06615d650541 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:17.264914 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fbbee-6d30-4ee8-ace9-06615d650541 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:17.270516 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6704eb-a777-4481-807e-c24a905acc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:17.271328 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6704eb-a777-4481-807e-c24a905acc0f admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:17.271713 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6704eb-a777-4481-807e-c24a905acc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:17.272094 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6704eb-a777-4481-807e-c24a905acc0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:17.273156 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6704eb-a777-4481-807e-c24a905acc0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:21:17.273841 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6704eb-a777-4481-807e-c24a905acc0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:17.276516 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6704eb-a777-4481-807e-c24a905acc0f admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:17.313797 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 956/1929] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:21:17.319349 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6dbc3e-04da-46a2-8bbb-ee1f833f0e39 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:17.332956 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6dbc3e-04da-46a2-8bbb-ee1f833f0e39 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:17.338019 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283dfac-f92f-4c1b-8c4f-0da3b8b26fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:17.338690 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283dfac-f92f-4c1b-8c4f-0da3b8b26fcc admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:17.338974 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283dfac-f92f-4c1b-8c4f-0da3b8b26fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:17.339256 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283dfac-f92f-4c1b-8c4f-0da3b8b26fcc admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:17.340068 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9283dfac-f92f-4c1b-8c4f-0da3b8b26fcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:17.341915 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9283dfac-f92f-4c1b-8c4f-0da3b8b26fcc admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:17.451246 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 974/1930] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:17 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:17.455882 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6704eb-a777-4481-807e-c24a905acc0f admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:17.467269 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6704eb-a777-4481-807e-c24a905acc0f admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:17.528235 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21ad4e-5107-4015-98ab-9c4c992e7147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:17.533344 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21ad4e-5107-4015-98ab-9c4c992e7147 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:17.533344 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21ad4e-5107-4015-98ab-9c4c992e7147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:17.533344 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21ad4e-5107-4015-98ab-9c4c992e7147 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:17.533344 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21ad4e-5107-4015-98ab-9c4c992e7147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:17.533344 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21ad4e-5107-4015-98ab-9c4c992e7147 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:17.652310 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 957/1931] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:17 2022] POST /identity/v3/users => generated 294 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:17.652548 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283dfac-f92f-4c1b-8c4f-0da3b8b26fcc admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:17.664082 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283dfac-f92f-4c1b-8c4f-0da3b8b26fcc admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:17.678782 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14847b7-ff26-40c7-8898-fe25a99b358f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:17.679493 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14847b7-ff26-40c7-8898-fe25a99b358f admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:17.679842 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14847b7-ff26-40c7-8898-fe25a99b358f admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:17.680042 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14847b7-ff26-40c7-8898-fe25a99b358f admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:17.680934 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14847b7-ff26-40c7-8898-fe25a99b358f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:17.682717 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14847b7-ff26-40c7-8898-fe25a99b358f admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:17.700752 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 975/1932] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:17.704685 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21ad4e-5107-4015-98ab-9c4c992e7147 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:17.715181 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21ad4e-5107-4015-98ab-9c4c992e7147 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:17.720534 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4196bf-3bb8-4d98-b957-9212da66803e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:17.721203 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4196bf-3bb8-4d98-b957-9212da66803e admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:17.721988 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4196bf-3bb8-4d98-b957-9212da66803e admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:17.722281 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4196bf-3bb8-4d98-b957-9212da66803e admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:17.723092 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4196bf-3bb8-4d98-b957-9212da66803e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:17.724841 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4196bf-3bb8-4d98-b957-9212da66803e admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:17.735625 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 958/1933] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:17.739896 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14847b7-ff26-40c7-8898-fe25a99b358f admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:17.751249 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14847b7-ff26-40c7-8898-fe25a99b358f admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:17.755956 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641456c-76bf-42cf-b13c-0ee3595a267c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:17.756909 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641456c-76bf-42cf-b13c-0ee3595a267c admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:17.757204 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641456c-76bf-42cf-b13c-0ee3595a267c admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:17.757632 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641456c-76bf-42cf-b13c-0ee3595a267c admin admin] PATH_INFO: `/v3/projects/2e865f05e58e432b86f32e0f8565bc90/users/56b2102af7874eac95b07c93431a0aae/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:17.777969 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641456c-76bf-42cf-b13c-0ee3595a267c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e865f05e58e432b86f32e0f8565bc90, user_id=56b2102af7874eac95b07c93431a0aae, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:17.780781 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641456c-76bf-42cf-b13c-0ee3595a267c admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:17.898134 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 976/1934] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:17 2022] PUT /identity/v3/projects/2e865f05e58e432b86f32e0f8565bc90/users/56b2102af7874eac95b07c93431a0aae/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:17.903420 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df92456-a84c-4f7a-9477-068515dbed6f None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:17.904280 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df92456-a84c-4f7a-9477-068515dbed6f None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:17.904964 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df92456-a84c-4f7a-9477-068515dbed6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:17.934429 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-5df92456-a84c-4f7a-9477-068515dbed6f None None] MFA Rules not processed for user `56b2102af7874eac95b07c93431a0aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:17.936134 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-5df92456-a84c-4f7a-9477-068515dbed6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:18.004761 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 959/1935] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:18.009393 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641456c-76bf-42cf-b13c-0ee3595a267c admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:18.074175 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641456c-76bf-42cf-b13c-0ee3595a267c admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:18.079896 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42009d9-b6e3-4df0-8757-6e535a5ec7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:18.080016 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42009d9-b6e3-4df0-8757-6e535a5ec7fd admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:18.080219 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42009d9-b6e3-4df0-8757-6e535a5ec7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:18.080500 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42009d9-b6e3-4df0-8757-6e535a5ec7fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:18.081247 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42009d9-b6e3-4df0-8757-6e535a5ec7fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:18.083192 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42009d9-b6e3-4df0-8757-6e535a5ec7fd admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:18.192484 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 977/1936] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:18 2022] POST /identity/v3/projects => generated 383 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:21:18.196448 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df92456-a84c-4f7a-9477-068515dbed6f None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:18.209268 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df92456-a84c-4f7a-9477-068515dbed6f None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:18.286321 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e900c-9da0-4be1-b5a5-b3800ee9cbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:18.286983 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e900c-9da0-4be1-b5a5-b3800ee9cbfd admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:18.287365 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e900c-9da0-4be1-b5a5-b3800ee9cbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:18.287713 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e900c-9da0-4be1-b5a5-b3800ee9cbfd admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:18.289636 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e900c-9da0-4be1-b5a5-b3800ee9cbfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:18.295076 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e900c-9da0-4be1-b5a5-b3800ee9cbfd admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:18.319538 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42009d9-b6e3-4df0-8757-6e535a5ec7fd admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:18.321469 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a42009d9-b6e3-4df0-8757-6e535a5ec7fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:18.386210 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 960/1937] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:18 2022] POST /identity/v3/users => generated 298 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:18.390006 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e900c-9da0-4be1-b5a5-b3800ee9cbfd admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:18.403030 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e900c-9da0-4be1-b5a5-b3800ee9cbfd admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:18.409939 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30661a52-6214-4b07-a72a-cd7ce8123610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:18.410836 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30661a52-6214-4b07-a72a-cd7ce8123610 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:18.411116 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30661a52-6214-4b07-a72a-cd7ce8123610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:18.411396 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30661a52-6214-4b07-a72a-cd7ce8123610 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:18.412150 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30661a52-6214-4b07-a72a-cd7ce8123610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:18.413850 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30661a52-6214-4b07-a72a-cd7ce8123610 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:18.414076 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42009d9-b6e3-4df0-8757-6e535a5ec7fd admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:18.422206 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889216e-4e30-4db4-9eb5-0f8a2848eb3e tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100eae75544b4b1ba8d9c815f856d65e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8fdd164c7064052a9e2f77a8c97c07c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:18.423445 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889216e-4e30-4db4-9eb5-0f8a2848eb3e tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:18.428647 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889216e-4e30-4db4-9eb5-0f8a2848eb3e tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:18.428647 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889216e-4e30-4db4-9eb5-0f8a2848eb3e tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:18.428647 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889216e-4e30-4db4-9eb5-0f8a2848eb3e tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:21:18.428647 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889216e-4e30-4db4-9eb5-0f8a2848eb3e tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:18.428980 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 961/1938] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:21:18.430213 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889216e-4e30-4db4-9eb5-0f8a2848eb3e tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:18.433170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30661a52-6214-4b07-a72a-cd7ce8123610 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:18.449175 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30661a52-6214-4b07-a72a-cd7ce8123610 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:18.453853 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 978/1939] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:21:18.455036 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889216e-4e30-4db4-9eb5-0f8a2848eb3e tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:18.459768 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dcad90-ea84-42d4-b9c3-253df53a6f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:18.467257 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889216e-4e30-4db4-9eb5-0f8a2848eb3e tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:18.473668 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcad90-ea84-42d4-b9c3-253df53a6f24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:18.474093 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcad90-ea84-42d4-b9c3-253df53a6f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:18.474460 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcad90-ea84-42d4-b9c3-253df53a6f24 admin admin] PATH_INFO: `/v3/projects/ec1f71c44ee440389cdfd881c06beffc/users/74d666c6c8ef483992f0530cc5c94ee2/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:18.475560 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc057e-fc08-439b-b9cd-8ca038d1d3ca tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100eae75544b4b1ba8d9c815f856d65e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8fdd164c7064052a9e2f77a8c97c07c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:18.476991 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc057e-fc08-439b-b9cd-8ca038d1d3ca tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:18.477391 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc057e-fc08-439b-b9cd-8ca038d1d3ca tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:18.477733 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc057e-fc08-439b-b9cd-8ca038d1d3ca tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:18.480312 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc057e-fc08-439b-b9cd-8ca038d1d3ca tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:18.481316 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc057e-fc08-439b-b9cd-8ca038d1d3ca tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:18.493905 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dcad90-ea84-42d4-b9c3-253df53a6f24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec1f71c44ee440389cdfd881c06beffc, user_id=74d666c6c8ef483992f0530cc5c94ee2, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:18.496566 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dcad90-ea84-42d4-b9c3-253df53a6f24 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:18.555758 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 962/1940] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:18 2022] PUT /identity/v3/projects/ec1f71c44ee440389cdfd881c06beffc/users/74d666c6c8ef483992f0530cc5c94ee2/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:18.559873 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dcad90-ea84-42d4-b9c3-253df53a6f24 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:18.580147 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 979/1941] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:18 2022] POST /identity/v3/projects => generated 354 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:21:18.583916 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc057e-fc08-439b-b9cd-8ca038d1d3ca tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:18.664531 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc057e-fc08-439b-b9cd-8ca038d1d3ca tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:18.670940 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec52d26-2706-4e26-92f3-0597b6b3ddfa tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100eae75544b4b1ba8d9c815f856d65e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8fdd164c7064052a9e2f77a8c97c07c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:18.671114 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dcad90-ea84-42d4-b9c3-253df53a6f24 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:18.672320 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec52d26-2706-4e26-92f3-0597b6b3ddfa tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:18.672857 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec52d26-2706-4e26-92f3-0597b6b3ddfa tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:18.673644 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec52d26-2706-4e26-92f3-0597b6b3ddfa tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:18.674541 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec52d26-2706-4e26-92f3-0597b6b3ddfa tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:21:18.675015 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec52d26-2706-4e26-92f3-0597b6b3ddfa tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:18.676715 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec52d26-2706-4e26-92f3-0597b6b3ddfa tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:18.689946 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 980/1942] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:21:18.768949 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68863c-d024-4375-80fe-8252d0a19a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:18.768949 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68863c-d024-4375-80fe-8252d0a19a1f admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:18.768949 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68863c-d024-4375-80fe-8252d0a19a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:18.768949 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68863c-d024-4375-80fe-8252d0a19a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:18.769382 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68863c-d024-4375-80fe-8252d0a19a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:18.770077 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec52d26-2706-4e26-92f3-0597b6b3ddfa tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:18.771009 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68863c-d024-4375-80fe-8252d0a19a1f admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:18.783372 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec52d26-2706-4e26-92f3-0597b6b3ddfa tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:18.783686 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 963/1943] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:21:18.788009 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68863c-d024-4375-80fe-8252d0a19a1f admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:18.792050 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f975fd2-3323-448c-bd48-3a929770c37a tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100eae75544b4b1ba8d9c815f856d65e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8fdd164c7064052a9e2f77a8c97c07c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:18.793458 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f975fd2-3323-448c-bd48-3a929770c37a tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:18.794117 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f975fd2-3323-448c-bd48-3a929770c37a tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:18.794509 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f975fd2-3323-448c-bd48-3a929770c37a tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] PATH_INFO: `/v3/projects/16a102f279904a67816d1d959566643a` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:18.796098 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f975fd2-3323-448c-bd48-3a929770c37a tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] RBAC: Authorizing `identity:delete_project(project_id=16a102f279904a67816d1d959566643a)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:18.798317 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f975fd2-3323-448c-bd48-3a929770c37a tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:18.800067 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68863c-d024-4375-80fe-8252d0a19a1f admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:18.805560 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f36b3e-5713-4052-8d51-5ec4dc566c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:18.806656 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f36b3e-5713-4052-8d51-5ec4dc566c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:18.807021 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f36b3e-5713-4052-8d51-5ec4dc566c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:18.807333 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f36b3e-5713-4052-8d51-5ec4dc566c67 admin admin] PATH_INFO: `/v3/projects/ec1f71c44ee440389cdfd881c06beffc/users/74d666c6c8ef483992f0530cc5c94ee2/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:18.810072 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f36b3e-5713-4052-8d51-5ec4dc566c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec1f71c44ee440389cdfd881c06beffc, user_id=74d666c6c8ef483992f0530cc5c94ee2, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:18.814127 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f36b3e-5713-4052-8d51-5ec4dc566c67 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:18.826484 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 964/1944] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:18 2022] PUT /identity/v3/projects/ec1f71c44ee440389cdfd881c06beffc/users/74d666c6c8ef483992f0530cc5c94ee2/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:18.839173 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ab6df-faf5-479f-9438-83e2fce8f6f9 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:18.839695 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ab6df-faf5-479f-9438-83e2fce8f6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:18.839979 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ab6df-faf5-479f-9438-83e2fce8f6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:18.879731 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-f30ab6df-faf5-479f-9438-83e2fce8f6f9 None None] MFA Rules not processed for user `74d666c6c8ef483992f0530cc5c94ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:18.880909 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-f30ab6df-faf5-479f-9438-83e2fce8f6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:18.899895 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-8f975fd2-3323-448c-bd48-3a929770c37a tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16a102f279904a67816d1d959566643a', 'request_id': 'req-8f975fd2-3323-448c-bd48-3a929770c37a'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:18.905635 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-8f975fd2-3323-448c-bd48-3a929770c37a tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16a102f279904a67816d1d959566643a', 'request_id': 'req-8f975fd2-3323-448c-bd48-3a929770c37a'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:18.912744 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-8f975fd2-3323-448c-bd48-3a929770c37a tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16a102f279904a67816d1d959566643a', 'request_id': 'req-8f975fd2-3323-448c-bd48-3a929770c37a'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:18.955312 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 965/1945] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:21:18.966753 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ab6df-faf5-479f-9438-83e2fce8f6f9 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:18.968107 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-f30ab6df-faf5-479f-9438-83e2fce8f6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:19.006502 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-8f975fd2-3323-448c-bd48-3a929770c37a tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] The token cache is being invalidate because project 16a102f279904a67816d1d959566643a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:19.006978 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-8f975fd2-3323-448c-bd48-3a929770c37a tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:19.007898 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-8f975fd2-3323-448c-bd48-3a929770c37a tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:19.010200 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 981/1946] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:18 2022] DELETE /identity/v3/projects/16a102f279904a67816d1d959566643a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:19.030725 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ab6df-faf5-479f-9438-83e2fce8f6f9 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:19.080867 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f66b7-7be7-4b1b-b763-63433b459b90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:19.081658 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f66b7-7be7-4b1b-b763-63433b459b90 service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:19.081946 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f66b7-7be7-4b1b-b763-63433b459b90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:19.082378 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f66b7-7be7-4b1b-b763-63433b459b90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:19.084372 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-196f66b7-7be7-4b1b-b763-63433b459b90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:19.146929 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f66b7-7be7-4b1b-b763-63433b459b90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:19.148384 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f66b7-7be7-4b1b-b763-63433b459b90 service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:19.158574 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 966/1947] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:21:20.263095 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f975fd2-3323-448c-bd48-3a929770c37a tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:20.264511 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-8f975fd2-3323-448c-bd48-3a929770c37a tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:20.333359 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f975fd2-3323-448c-bd48-3a929770c37a tempest-VolumeQuotaClassesTest-560727657 tempest-VolumeQuotaClassesTest-560727657-project-admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:20.338464 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff8d9b-2bcd-4658-9cf3-11b0c16d4697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:20.339478 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff8d9b-2bcd-4658-9cf3-11b0c16d4697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:20.339847 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff8d9b-2bcd-4658-9cf3-11b0c16d4697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:20.340178 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff8d9b-2bcd-4658-9cf3-11b0c16d4697 admin admin] PATH_INFO: `/v3/users/de8d0ab57e3245d7a5f77568b5990c9e` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:20.342440 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff8d9b-2bcd-4658-9cf3-11b0c16d4697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de8d0ab57e3245d7a5f77568b5990c9e)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:20.343742 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff8d9b-2bcd-4658-9cf3-11b0c16d4697 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:20.679741 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f2ff8d9b-2bcd-4658-9cf3-11b0c16d4697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de8d0ab57e3245d7a5f77568b5990c9e'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:20.955146 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f2ff8d9b-2bcd-4658-9cf3-11b0c16d4697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de8d0ab57e3245d7a5f77568b5990c9e'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:20.955794 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f2ff8d9b-2bcd-4658-9cf3-11b0c16d4697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de8d0ab57e3245d7a5f77568b5990c9e'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:20.956468 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f2ff8d9b-2bcd-4658-9cf3-11b0c16d4697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de8d0ab57e3245d7a5f77568b5990c9e'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:20.965228 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f2ff8d9b-2bcd-4658-9cf3-11b0c16d4697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de8d0ab57e3245d7a5f77568b5990c9e'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:20.982974 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 982/1948] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:20 2022] DELETE /identity/v3/users/de8d0ab57e3245d7a5f77568b5990c9e => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:20.987574 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e44adf-f9e9-4ebb-8e16-7c87b205330c None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:20.988275 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e44adf-f9e9-4ebb-8e16-7c87b205330c None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:20.988275 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e44adf-f9e9-4ebb-8e16-7c87b205330c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:21.006783 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-89e44adf-f9e9-4ebb-8e16-7c87b205330c None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:21.011943 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-89e44adf-f9e9-4ebb-8e16-7c87b205330c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:21.078927 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff8d9b-2bcd-4658-9cf3-11b0c16d4697 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:21.081013 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-f2ff8d9b-2bcd-4658-9cf3-11b0c16d4697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:21.104328 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 967/1949] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:21:21.116158 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e44adf-f9e9-4ebb-8e16-7c87b205330c None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:21.118442 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-89e44adf-f9e9-4ebb-8e16-7c87b205330c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:21.181894 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff8d9b-2bcd-4658-9cf3-11b0c16d4697 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:21.188819 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a70b70-f880-4a61-9f01-1d8e93e200e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:21.189993 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a70b70-f880-4a61-9f01-1d8e93e200e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:21.190452 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a70b70-f880-4a61-9f01-1d8e93e200e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:21.190736 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a70b70-f880-4a61-9f01-1d8e93e200e8 admin admin] PATH_INFO: `/v3/users/f76904a7b5924e7b9108561473321ece` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:21.192026 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a70b70-f880-4a61-9f01-1d8e93e200e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f76904a7b5924e7b9108561473321ece)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:21.192734 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e44adf-f9e9-4ebb-8e16-7c87b205330c None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:21.193994 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a70b70-f880-4a61-9f01-1d8e93e200e8 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:21.197864 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03ee04-13a6-4342-a208-8c5ff5a09368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:21.198368 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03ee04-13a6-4342-a208-8c5ff5a09368 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:21.198663 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03ee04-13a6-4342-a208-8c5ff5a09368 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:21.198956 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03ee04-13a6-4342-a208-8c5ff5a09368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:21.213480 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03ee04-13a6-4342-a208-8c5ff5a09368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:21.215099 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03ee04-13a6-4342-a208-8c5ff5a09368 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:21.229246 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 968/1950] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:21:21.369315 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-68a70b70-f880-4a61-9f01-1d8e93e200e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f76904a7b5924e7b9108561473321ece'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:21.451176 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-68a70b70-f880-4a61-9f01-1d8e93e200e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f76904a7b5924e7b9108561473321ece'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:21.452157 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-68a70b70-f880-4a61-9f01-1d8e93e200e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f76904a7b5924e7b9108561473321ece'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:21.454144 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-68a70b70-f880-4a61-9f01-1d8e93e200e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f76904a7b5924e7b9108561473321ece'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:21.465694 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-68a70b70-f880-4a61-9f01-1d8e93e200e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f76904a7b5924e7b9108561473321ece'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:21.502814 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03ee04-13a6-4342-a208-8c5ff5a09368 service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:21.506378 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 983/1951] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:21 2022] DELETE /identity/v3/users/f76904a7b5924e7b9108561473321ece => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:21.506507 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-1a03ee04-13a6-4342-a208-8c5ff5a09368 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:21.506601 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e968f-3458-4761-8066-9e7b12b291ee None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:21.506601 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e968f-3458-4761-8066-9e7b12b291ee None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:21.506601 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e968f-3458-4761-8066-9e7b12b291ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:21.517122 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03ee04-13a6-4342-a208-8c5ff5a09368 service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:21.527987 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-ac5e968f-3458-4761-8066-9e7b12b291ee None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:21.532778 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-ac5e968f-3458-4761-8066-9e7b12b291ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:21.601567 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5107c5f4-37e6-443e-b4ee-921d2b3997dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:21.602744 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107c5f4-37e6-443e-b4ee-921d2b3997dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:21.603036 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107c5f4-37e6-443e-b4ee-921d2b3997dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:21.603300 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 984/1952] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:21.603443 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107c5f4-37e6-443e-b4ee-921d2b3997dc admin admin] PATH_INFO: `/v3/users/56b2102af7874eac95b07c93431a0aae` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:21.604529 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5107c5f4-37e6-443e-b4ee-921d2b3997dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=56b2102af7874eac95b07c93431a0aae)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:21.606736 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5107c5f4-37e6-443e-b4ee-921d2b3997dc admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:21.612841 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e968f-3458-4761-8066-9e7b12b291ee None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:21.614268 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-ac5e968f-3458-4761-8066-9e7b12b291ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:21.699397 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e968f-3458-4761-8066-9e7b12b291ee None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:21.703907 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c03a9c-71dd-4110-8671-47e7bfd089a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:21.704565 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c03a9c-71dd-4110-8671-47e7bfd089a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:21.704848 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c03a9c-71dd-4110-8671-47e7bfd089a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:21.705127 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c03a9c-71dd-4110-8671-47e7bfd089a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:21.715089 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c03a9c-71dd-4110-8671-47e7bfd089a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:21.716545 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c03a9c-71dd-4110-8671-47e7bfd089a8 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:21.727982 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 985/1953] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:21:21.731186 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c03a9c-71dd-4110-8671-47e7bfd089a8 service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:21.731186 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-64c03a9c-71dd-4110-8671-47e7bfd089a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:21.744272 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c03a9c-71dd-4110-8671-47e7bfd089a8 service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:21.750141 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b368be5-6bc6-4a76-af78-a6fc4d5ac76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:21.751185 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b368be5-6bc6-4a76-af78-a6fc4d5ac76f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:21.751476 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b368be5-6bc6-4a76-af78-a6fc4d5ac76f admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:21.751756 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b368be5-6bc6-4a76-af78-a6fc4d5ac76f admin admin] PATH_INFO: `/v3/projects/d052f5d0819e42aea14e8778ca5d347a` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:21.752962 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b368be5-6bc6-4a76-af78-a6fc4d5ac76f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d052f5d0819e42aea14e8778ca5d347a)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:21.755053 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b368be5-6bc6-4a76-af78-a6fc4d5ac76f admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:21.791463 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-5107c5f4-37e6-443e-b4ee-921d2b3997dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56b2102af7874eac95b07c93431a0aae'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:21.846524 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-5107c5f4-37e6-443e-b4ee-921d2b3997dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56b2102af7874eac95b07c93431a0aae'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:21.847403 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-5107c5f4-37e6-443e-b4ee-921d2b3997dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56b2102af7874eac95b07c93431a0aae'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:21.850805 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-1b368be5-6bc6-4a76-af78-a6fc4d5ac76f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd052f5d0819e42aea14e8778ca5d347a', 'request_id': 'req-1b368be5-6bc6-4a76-af78-a6fc4d5ac76f'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:21.857449 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-1b368be5-6bc6-4a76-af78-a6fc4d5ac76f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd052f5d0819e42aea14e8778ca5d347a', 'request_id': 'req-1b368be5-6bc6-4a76-af78-a6fc4d5ac76f'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:21.858329 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-5107c5f4-37e6-443e-b4ee-921d2b3997dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56b2102af7874eac95b07c93431a0aae'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:21.864060 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-1b368be5-6bc6-4a76-af78-a6fc4d5ac76f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd052f5d0819e42aea14e8778ca5d347a', 'request_id': 'req-1b368be5-6bc6-4a76-af78-a6fc4d5ac76f'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:21.871154 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-5107c5f4-37e6-443e-b4ee-921d2b3997dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56b2102af7874eac95b07c93431a0aae'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:21.877763 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 969/1954] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:21 2022] DELETE /identity/v3/users/56b2102af7874eac95b07c93431a0aae => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:21.882034 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be79bea-9354-41df-a07a-62fa9af6bf76 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:21.887462 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be79bea-9354-41df-a07a-62fa9af6bf76 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:21.887462 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be79bea-9354-41df-a07a-62fa9af6bf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:21.900668 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-9be79bea-9354-41df-a07a-62fa9af6bf76 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:21.901891 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9be79bea-9354-41df-a07a-62fa9af6bf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:21.932450 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-1b368be5-6bc6-4a76-af78-a6fc4d5ac76f admin admin] The token cache is being invalidate because project d052f5d0819e42aea14e8778ca5d347a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:21.932756 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-1b368be5-6bc6-4a76-af78-a6fc4d5ac76f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:21.934263 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-1b368be5-6bc6-4a76-af78-a6fc4d5ac76f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:21.937727 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 986/1955] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:21 2022] DELETE /identity/v3/projects/d052f5d0819e42aea14e8778ca5d347a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:21.948473 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b368be5-6bc6-4a76-af78-a6fc4d5ac76f admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:21.949860 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-1b368be5-6bc6-4a76-af78-a6fc4d5ac76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:21.984112 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 970/1956] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:21:21.996114 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be79bea-9354-41df-a07a-62fa9af6bf76 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:21.997642 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9be79bea-9354-41df-a07a-62fa9af6bf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:22.026906 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b368be5-6bc6-4a76-af78-a6fc4d5ac76f admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:22.032914 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74535991-f127-49e9-b1d8-3217fcd66507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:22.033830 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74535991-f127-49e9-b1d8-3217fcd66507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:22.034232 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74535991-f127-49e9-b1d8-3217fcd66507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:22.034519 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74535991-f127-49e9-b1d8-3217fcd66507 admin admin] PATH_INFO: `/v3/users/100eae75544b4b1ba8d9c815f856d65e` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:22.035723 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74535991-f127-49e9-b1d8-3217fcd66507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=100eae75544b4b1ba8d9c815f856d65e)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:22.037698 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74535991-f127-49e9-b1d8-3217fcd66507 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:22.072811 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be79bea-9354-41df-a07a-62fa9af6bf76 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:22.076534 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bc2c6-1500-4896-9ccb-7f32e2cc7710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:22.077219 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bc2c6-1500-4896-9ccb-7f32e2cc7710 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:22.078226 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bc2c6-1500-4896-9ccb-7f32e2cc7710 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:22.078558 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bc2c6-1500-4896-9ccb-7f32e2cc7710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:22.088262 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bc2c6-1500-4896-9ccb-7f32e2cc7710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:22.089642 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bc2c6-1500-4896-9ccb-7f32e2cc7710 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:22.100331 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 971/1957] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:21:22.224455 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bc2c6-1500-4896-9ccb-7f32e2cc7710 service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:22.226004 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-c89bc2c6-1500-4896-9ccb-7f32e2cc7710 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:22.238919 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bc2c6-1500-4896-9ccb-7f32e2cc7710 service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:22.249010 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8b933-940f-483b-ad3d-e5b8a042192c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:22.250614 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8b933-940f-483b-ad3d-e5b8a042192c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:22.250614 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8b933-940f-483b-ad3d-e5b8a042192c admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:22.250614 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8b933-940f-483b-ad3d-e5b8a042192c admin admin] PATH_INFO: `/v3/projects/4d7474bc06ae489b9959d9178eb4e642` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:22.251740 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8b933-940f-483b-ad3d-e5b8a042192c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d7474bc06ae489b9959d9178eb4e642)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:22.253952 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8b933-940f-483b-ad3d-e5b8a042192c admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:22.255365 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-74535991-f127-49e9-b1d8-3217fcd66507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '100eae75544b4b1ba8d9c815f856d65e'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:22.320727 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-74535991-f127-49e9-b1d8-3217fcd66507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '100eae75544b4b1ba8d9c815f856d65e'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:22.321481 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-74535991-f127-49e9-b1d8-3217fcd66507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '100eae75544b4b1ba8d9c815f856d65e'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:22.322118 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-74535991-f127-49e9-b1d8-3217fcd66507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '100eae75544b4b1ba8d9c815f856d65e'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:22.329993 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-74535991-f127-49e9-b1d8-3217fcd66507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '100eae75544b4b1ba8d9c815f856d65e'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:22.351947 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 987/1958] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:21 2022] DELETE /identity/v3/users/100eae75544b4b1ba8d9c815f856d65e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:22.443961 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-20a8b933-940f-483b-ad3d-e5b8a042192c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d7474bc06ae489b9959d9178eb4e642', 'request_id': 'req-20a8b933-940f-483b-ad3d-e5b8a042192c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:22.503926 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-20a8b933-940f-483b-ad3d-e5b8a042192c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d7474bc06ae489b9959d9178eb4e642', 'request_id': 'req-20a8b933-940f-483b-ad3d-e5b8a042192c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:22.510343 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-20a8b933-940f-483b-ad3d-e5b8a042192c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d7474bc06ae489b9959d9178eb4e642', 'request_id': 'req-20a8b933-940f-483b-ad3d-e5b8a042192c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:22.523128 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-20a8b933-940f-483b-ad3d-e5b8a042192c admin admin] The token cache is being invalidate because project 4d7474bc06ae489b9959d9178eb4e642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:22.523479 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-20a8b933-940f-483b-ad3d-e5b8a042192c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:22.524214 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-20a8b933-940f-483b-ad3d-e5b8a042192c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:22.525969 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 972/1959] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:22 2022] DELETE /identity/v3/projects/4d7474bc06ae489b9959d9178eb4e642 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:22.530175 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74535991-f127-49e9-b1d8-3217fcd66507 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:22.543002 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-74535991-f127-49e9-b1d8-3217fcd66507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:22.607438 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74535991-f127-49e9-b1d8-3217fcd66507 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:22.673856 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4ed38-71da-46a0-8efe-62f93e697801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:22.675246 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4ed38-71da-46a0-8efe-62f93e697801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:22.675537 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4ed38-71da-46a0-8efe-62f93e697801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:22.675819 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4ed38-71da-46a0-8efe-62f93e697801 admin admin] PATH_INFO: `/v3/users/7ac5a387723946f28969ca943c051d26` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:22.677707 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4ed38-71da-46a0-8efe-62f93e697801 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ac5a387723946f28969ca943c051d26)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:22.680360 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4ed38-71da-46a0-8efe-62f93e697801 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:22.794482 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8b933-940f-483b-ad3d-e5b8a042192c admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:22.795996 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-20a8b933-940f-483b-ad3d-e5b8a042192c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:22.814562 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8b933-940f-483b-ad3d-e5b8a042192c admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:22.830704 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0508e2-cd8f-420e-807b-5a1b7ef043d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:22.832786 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0508e2-cd8f-420e-807b-5a1b7ef043d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:22.835385 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0508e2-cd8f-420e-807b-5a1b7ef043d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:22.835967 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0508e2-cd8f-420e-807b-5a1b7ef043d8 admin admin] PATH_INFO: `/v3/projects/b8fdd164c7064052a9e2f77a8c97c07c` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:22.840053 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0508e2-cd8f-420e-807b-5a1b7ef043d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8fdd164c7064052a9e2f77a8c97c07c)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:22.844848 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0508e2-cd8f-420e-807b-5a1b7ef043d8 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:22.871761 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-06d4ed38-71da-46a0-8efe-62f93e697801 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ac5a387723946f28969ca943c051d26'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:22.932577 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-06d4ed38-71da-46a0-8efe-62f93e697801 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ac5a387723946f28969ca943c051d26'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:22.933373 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-06d4ed38-71da-46a0-8efe-62f93e697801 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ac5a387723946f28969ca943c051d26'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:22.933999 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-06d4ed38-71da-46a0-8efe-62f93e697801 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ac5a387723946f28969ca943c051d26'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:22.944704 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-06d4ed38-71da-46a0-8efe-62f93e697801 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ac5a387723946f28969ca943c051d26'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:22.963083 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 988/1960] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:22 2022] DELETE /identity/v3/users/7ac5a387723946f28969ca943c051d26 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:22.996859 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-9c0508e2-cd8f-420e-807b-5a1b7ef043d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8fdd164c7064052a9e2f77a8c97c07c', 'request_id': 'req-9c0508e2-cd8f-420e-807b-5a1b7ef043d8'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:23.017560 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4ed38-71da-46a0-8efe-62f93e697801 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:23.019038 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-06d4ed38-71da-46a0-8efe-62f93e697801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:23.081748 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-9c0508e2-cd8f-420e-807b-5a1b7ef043d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8fdd164c7064052a9e2f77a8c97c07c', 'request_id': 'req-9c0508e2-cd8f-420e-807b-5a1b7ef043d8'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:23.090981 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-9c0508e2-cd8f-420e-807b-5a1b7ef043d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8fdd164c7064052a9e2f77a8c97c07c', 'request_id': 'req-9c0508e2-cd8f-420e-807b-5a1b7ef043d8'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:23.092466 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4ed38-71da-46a0-8efe-62f93e697801 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:23.111386 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-9c0508e2-cd8f-420e-807b-5a1b7ef043d8 admin admin] The token cache is being invalidate because project b8fdd164c7064052a9e2f77a8c97c07c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:23.111857 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-9c0508e2-cd8f-420e-807b-5a1b7ef043d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:23.112847 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-9c0508e2-cd8f-420e-807b-5a1b7ef043d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:23.133427 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 973/1961] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:22 2022] DELETE /identity/v3/projects/b8fdd164c7064052a9e2f77a8c97c07c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:23.138157 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbd9b9-a370-41b6-bb1d-86b2da2e7fe1 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:23.138529 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbd9b9-a370-41b6-bb1d-86b2da2e7fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:23.138891 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbd9b9-a370-41b6-bb1d-86b2da2e7fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:23.161662 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de7345-b2ae-435c-9177-3d9957947922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:23.162641 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de7345-b2ae-435c-9177-3d9957947922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:23.163238 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de7345-b2ae-435c-9177-3d9957947922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:23.163238 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de7345-b2ae-435c-9177-3d9957947922 admin admin] PATH_INFO: `/v3/projects/2e865f05e58e432b86f32e0f8565bc90` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:23.165043 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de7345-b2ae-435c-9177-3d9957947922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e865f05e58e432b86f32e0f8565bc90)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:23.167251 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de7345-b2ae-435c-9177-3d9957947922 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:23.174160 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-21dbd9b9-a370-41b6-bb1d-86b2da2e7fe1 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:23.175400 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-21dbd9b9-a370-41b6-bb1d-86b2da2e7fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:23.183693 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 974/1962] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:23.192443 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c8567-7c74-4007-83a2-3aee6c1ee8fb None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:23.192736 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c8567-7c74-4007-83a2-3aee6c1ee8fb None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:23.193018 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c8567-7c74-4007-83a2-3aee6c1ee8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:23.213069 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-631c8567-7c74-4007-83a2-3aee6c1ee8fb None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:23.214041 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-631c8567-7c74-4007-83a2-3aee6c1ee8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:23.234243 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 975/1963] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:21:23.243010 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c8567-7c74-4007-83a2-3aee6c1ee8fb None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:23.255169 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c8567-7c74-4007-83a2-3aee6c1ee8fb None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:23.260906 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5026260-b7b2-4253-aaa0-2ac2850e0039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:23.261863 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5026260-b7b2-4253-aaa0-2ac2850e0039 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:23.262434 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5026260-b7b2-4253-aaa0-2ac2850e0039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:23.262838 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5026260-b7b2-4253-aaa0-2ac2850e0039 admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:23.263828 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5026260-b7b2-4253-aaa0-2ac2850e0039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:21:23.264209 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5026260-b7b2-4253-aaa0-2ac2850e0039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:23.266849 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5026260-b7b2-4253-aaa0-2ac2850e0039 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:23.285583 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 976/1964] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:21:23.289126 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5026260-b7b2-4253-aaa0-2ac2850e0039 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:23.303819 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5026260-b7b2-4253-aaa0-2ac2850e0039 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:23.326690 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa454fe-da61-4b3e-9a57-2f96d188158b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:23.328131 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa454fe-da61-4b3e-9a57-2f96d188158b admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:23.328797 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa454fe-da61-4b3e-9a57-2f96d188158b admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:23.329201 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa454fe-da61-4b3e-9a57-2f96d188158b admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:23.330301 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa454fe-da61-4b3e-9a57-2f96d188158b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:23.332522 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa454fe-da61-4b3e-9a57-2f96d188158b admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:23.335590 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-86de7345-b2ae-435c-9177-3d9957947922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e865f05e58e432b86f32e0f8565bc90', 'request_id': 'req-86de7345-b2ae-435c-9177-3d9957947922'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:23.341834 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-86de7345-b2ae-435c-9177-3d9957947922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e865f05e58e432b86f32e0f8565bc90', 'request_id': 'req-86de7345-b2ae-435c-9177-3d9957947922'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:23.349094 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-86de7345-b2ae-435c-9177-3d9957947922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e865f05e58e432b86f32e0f8565bc90', 'request_id': 'req-86de7345-b2ae-435c-9177-3d9957947922'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:23.417488 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-86de7345-b2ae-435c-9177-3d9957947922 admin admin] The token cache is being invalidate because project 2e865f05e58e432b86f32e0f8565bc90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:23.417992 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-86de7345-b2ae-435c-9177-3d9957947922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:23.418766 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-86de7345-b2ae-435c-9177-3d9957947922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:23.420375 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 989/1965] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:23 2022] DELETE /identity/v3/projects/2e865f05e58e432b86f32e0f8565bc90 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:23.425140 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de7345-b2ae-435c-9177-3d9957947922 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:23.426538 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-86de7345-b2ae-435c-9177-3d9957947922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:23.455269 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 977/1966] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:23 2022] POST /identity/v3/projects => generated 401 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:23.459066 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa454fe-da61-4b3e-9a57-2f96d188158b admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:23.460932 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-5aa454fe-da61-4b3e-9a57-2f96d188158b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:23.499909 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de7345-b2ae-435c-9177-3d9957947922 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:23.530937 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa454fe-da61-4b3e-9a57-2f96d188158b admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:23.536660 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce4364-f349-4718-a649-e1aed0b410b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:23.537370 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce4364-f349-4718-a649-e1aed0b410b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:23.537657 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce4364-f349-4718-a649-e1aed0b410b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:23.537965 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce4364-f349-4718-a649-e1aed0b410b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:23.538652 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce4364-f349-4718-a649-e1aed0b410b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:23.540564 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce4364-f349-4718-a649-e1aed0b410b8 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:23.560112 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ad246-91d1-472a-9c68-1dfff904b81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:23.561017 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ad246-91d1-472a-9c68-1dfff904b81f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:23.561320 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ad246-91d1-472a-9c68-1dfff904b81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:23.561629 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ad246-91d1-472a-9c68-1dfff904b81f admin admin] PATH_INFO: `/v3/users/74d666c6c8ef483992f0530cc5c94ee2` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:23.563410 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ad246-91d1-472a-9c68-1dfff904b81f admin admin] RBAC: Authorizing `identity:delete_user(user_id=74d666c6c8ef483992f0530cc5c94ee2)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:23.565427 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ad246-91d1-472a-9c68-1dfff904b81f admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:23.624073 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 978/1967] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:23 2022] POST /identity/v3/users => generated 301 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:23.628261 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce4364-f349-4718-a649-e1aed0b410b8 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:23.639737 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce4364-f349-4718-a649-e1aed0b410b8 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:23.645676 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9d5b4-6a15-4e57-905c-4c4fc030ecaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:23.646342 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9d5b4-6a15-4e57-905c-4c4fc030ecaf admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:23.649778 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9d5b4-6a15-4e57-905c-4c4fc030ecaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:23.649778 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9d5b4-6a15-4e57-905c-4c4fc030ecaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:23.649778 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9d5b4-6a15-4e57-905c-4c4fc030ecaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:23.649778 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9d5b4-6a15-4e57-905c-4c4fc030ecaf admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:23.663219 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 979/1968] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:21:23.664198 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9d5b4-6a15-4e57-905c-4c4fc030ecaf admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:23.674998 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9d5b4-6a15-4e57-905c-4c4fc030ecaf admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:23.679828 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd2c07-f8b7-4948-ac96-5afb89415890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:23.680488 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd2c07-f8b7-4948-ac96-5afb89415890 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:23.680778 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd2c07-f8b7-4948-ac96-5afb89415890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:23.681059 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd2c07-f8b7-4948-ac96-5afb89415890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:23.681812 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd2c07-f8b7-4948-ac96-5afb89415890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:23.683398 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd2c07-f8b7-4948-ac96-5afb89415890 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:23.693530 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 980/1969] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:21:23.697648 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd2c07-f8b7-4948-ac96-5afb89415890 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:23.708123 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd2c07-f8b7-4948-ac96-5afb89415890 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:23.712759 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8003da-bbe6-48ff-a697-956e2744843a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:23.713671 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8003da-bbe6-48ff-a697-956e2744843a admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:23.713959 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8003da-bbe6-48ff-a697-956e2744843a admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:23.714240 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8003da-bbe6-48ff-a697-956e2744843a admin admin] PATH_INFO: `/v3/projects/07b47d6ec8974ed189fd838adf30badf/users/e9b1953683564ef8bd80ff638b4e3b9a/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:23.730555 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8003da-bbe6-48ff-a697-956e2744843a admin admin] RBAC: Authorizing `identity:create_grant(project_id=07b47d6ec8974ed189fd838adf30badf, user_id=e9b1953683564ef8bd80ff638b4e3b9a, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:23.733211 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8003da-bbe6-48ff-a697-956e2744843a admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:23.770719 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-5f5ad246-91d1-472a-9c68-1dfff904b81f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74d666c6c8ef483992f0530cc5c94ee2'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:23.846196 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 981/1970] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:23 2022] PUT /identity/v3/projects/07b47d6ec8974ed189fd838adf30badf/users/e9b1953683564ef8bd80ff638b4e3b9a/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:23.846196 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8003da-bbe6-48ff-a697-956e2744843a admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:23.846196 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-4a8003da-bbe6-48ff-a697-956e2744843a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:23.881665 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-5f5ad246-91d1-472a-9c68-1dfff904b81f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74d666c6c8ef483992f0530cc5c94ee2'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:23.882766 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-5f5ad246-91d1-472a-9c68-1dfff904b81f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74d666c6c8ef483992f0530cc5c94ee2'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:23.883567 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-5f5ad246-91d1-472a-9c68-1dfff904b81f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74d666c6c8ef483992f0530cc5c94ee2'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:23.892682 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-5f5ad246-91d1-472a-9c68-1dfff904b81f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74d666c6c8ef483992f0530cc5c94ee2'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:23.911539 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 990/1971] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:23 2022] DELETE /identity/v3/users/74d666c6c8ef483992f0530cc5c94ee2 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:23.913129 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd515cb3-37e4-4b32-b9b6-7f554173911a None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:23.913464 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd515cb3-37e4-4b32-b9b6-7f554173911a None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:23.913732 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd515cb3-37e4-4b32-b9b6-7f554173911a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:23.932175 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8003da-bbe6-48ff-a697-956e2744843a admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:23.949614 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-bd515cb3-37e4-4b32-b9b6-7f554173911a None None] MFA Rules not processed for user `e9b1953683564ef8bd80ff638b4e3b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:23.959733 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-bd515cb3-37e4-4b32-b9b6-7f554173911a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:23.997209 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330f290-473b-4fba-8595-baecc1637b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:23.998224 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330f290-473b-4fba-8595-baecc1637b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:23.998703 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330f290-473b-4fba-8595-baecc1637b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:23.999055 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330f290-473b-4fba-8595-baecc1637b54 admin admin] PATH_INFO: `/v3/projects/562a54bdbd6e4487847b9691b7f5b788` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:24.001349 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330f290-473b-4fba-8595-baecc1637b54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=562a54bdbd6e4487847b9691b7f5b788)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:24.003487 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330f290-473b-4fba-8595-baecc1637b54 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:24.023323 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 991/1972] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:24.027863 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd515cb3-37e4-4b32-b9b6-7f554173911a None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:24.029204 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-bd515cb3-37e4-4b32-b9b6-7f554173911a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:24.043781 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd515cb3-37e4-4b32-b9b6-7f554173911a None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:24.048585 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177ae7e-a91e-42cf-8920-d652f5f11fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:24.049252 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177ae7e-a91e-42cf-8920-d652f5f11fbe admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:24.049580 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177ae7e-a91e-42cf-8920-d652f5f11fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:24.049865 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177ae7e-a91e-42cf-8920-d652f5f11fbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:24.050559 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177ae7e-a91e-42cf-8920-d652f5f11fbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:24.052471 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177ae7e-a91e-42cf-8920-d652f5f11fbe admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:24.109157 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8330f290-473b-4fba-8595-baecc1637b54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '562a54bdbd6e4487847b9691b7f5b788', 'request_id': 'req-8330f290-473b-4fba-8595-baecc1637b54'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:24.139776 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 992/1973] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:24 2022] POST /identity/v3/projects => generated 399 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:24.144698 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177ae7e-a91e-42cf-8920-d652f5f11fbe admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:24.200357 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8330f290-473b-4fba-8595-baecc1637b54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '562a54bdbd6e4487847b9691b7f5b788', 'request_id': 'req-8330f290-473b-4fba-8595-baecc1637b54'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:24.206669 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8330f290-473b-4fba-8595-baecc1637b54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '562a54bdbd6e4487847b9691b7f5b788', 'request_id': 'req-8330f290-473b-4fba-8595-baecc1637b54'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:24.210777 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177ae7e-a91e-42cf-8920-d652f5f11fbe admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:24.216402 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63166b51-323a-465c-9400-fd155194ad9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:24.217089 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63166b51-323a-465c-9400-fd155194ad9c admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:24.217404 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63166b51-323a-465c-9400-fd155194ad9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:24.217684 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63166b51-323a-465c-9400-fd155194ad9c admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:24.218387 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63166b51-323a-465c-9400-fd155194ad9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:24.219283 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8330f290-473b-4fba-8595-baecc1637b54 admin admin] The token cache is being invalidate because project 562a54bdbd6e4487847b9691b7f5b788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:24.219635 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8330f290-473b-4fba-8595-baecc1637b54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:24.220361 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8330f290-473b-4fba-8595-baecc1637b54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:24.220477 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63166b51-323a-465c-9400-fd155194ad9c admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:24.222276 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 982/1974] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:23 2022] DELETE /identity/v3/projects/562a54bdbd6e4487847b9691b7f5b788 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:24.227874 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ee947-3f33-4bea-9529-95fd54da07ae None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:24.228201 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ee947-3f33-4bea-9529-95fd54da07ae None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:24.228462 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ee947-3f33-4bea-9529-95fd54da07ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:24.250823 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-165ee947-3f33-4bea-9529-95fd54da07ae None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:24.252060 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-165ee947-3f33-4bea-9529-95fd54da07ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:24.260424 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 983/1975] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:21:24.269448 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a75da9-665f-440d-8637-43a4d3c61994 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:24.269746 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a75da9-665f-440d-8637-43a4d3c61994 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:24.271499 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a75da9-665f-440d-8637-43a4d3c61994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:24.289559 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-e1a75da9-665f-440d-8637-43a4d3c61994 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:24.294607 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-e1a75da9-665f-440d-8637-43a4d3c61994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:24.294770 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 993/1976] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:24 2022] POST /identity/v3/users => generated 306 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:21:24.304405 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 984/1977] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:24.308839 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63166b51-323a-465c-9400-fd155194ad9c admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:24.310332 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a75da9-665f-440d-8637-43a4d3c61994 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:24.310771 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-63166b51-323a-465c-9400-fd155194ad9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:24.320660 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a75da9-665f-440d-8637-43a4d3c61994 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:24.324148 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63166b51-323a-465c-9400-fd155194ad9c admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:24.324906 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88a8f2-bb36-4b62-bc2a-a555e93972ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:24.325594 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88a8f2-bb36-4b62-bc2a-a555e93972ca admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:24.333595 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88a8f2-bb36-4b62-bc2a-a555e93972ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:24.333595 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88a8f2-bb36-4b62-bc2a-a555e93972ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:24.333595 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88a8f2-bb36-4b62-bc2a-a555e93972ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:21:24.333595 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88a8f2-bb36-4b62-bc2a-a555e93972ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:24.333595 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88a8f2-bb36-4b62-bc2a-a555e93972ca admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:24.334079 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd741da-4795-4397-81ac-1f882b57df90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:24.334079 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd741da-4795-4397-81ac-1f882b57df90 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:24.334079 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd741da-4795-4397-81ac-1f882b57df90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:24.334079 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd741da-4795-4397-81ac-1f882b57df90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:24.334361 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd741da-4795-4397-81ac-1f882b57df90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:24.334361 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd741da-4795-4397-81ac-1f882b57df90 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:24.341791 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 985/1978] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:21:24.346632 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 994/1979] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:24.349026 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88a8f2-bb36-4b62-bc2a-a555e93972ca admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:24.354025 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd741da-4795-4397-81ac-1f882b57df90 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:24.361737 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88a8f2-bb36-4b62-bc2a-a555e93972ca admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:24.365377 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd741da-4795-4397-81ac-1f882b57df90 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:24.367164 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5033050-fdea-423e-a05a-46998a5fdb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:24.367833 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5033050-fdea-423e-a05a-46998a5fdb67 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:24.368129 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5033050-fdea-423e-a05a-46998a5fdb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:24.368852 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5033050-fdea-423e-a05a-46998a5fdb67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:24.369253 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5033050-fdea-423e-a05a-46998a5fdb67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:24.370844 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97f255-7ebb-4a51-afd4-c409f349e9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:24.371241 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5033050-fdea-423e-a05a-46998a5fdb67 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:24.371349 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97f255-7ebb-4a51-afd4-c409f349e9d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:24.371722 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97f255-7ebb-4a51-afd4-c409f349e9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:24.372009 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97f255-7ebb-4a51-afd4-c409f349e9d4 admin admin] PATH_INFO: `/v3/projects/41ee23ff52d247698d1ccc4b6fc53692/users/647c4aa44db541e488d5840b2b411204/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:24.392515 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97f255-7ebb-4a51-afd4-c409f349e9d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ee23ff52d247698d1ccc4b6fc53692, user_id=647c4aa44db541e488d5840b2b411204, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:24.395628 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97f255-7ebb-4a51-afd4-c409f349e9d4 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:24.464397 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 995/1980] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:24 2022] PUT /identity/v3/projects/41ee23ff52d247698d1ccc4b6fc53692/users/647c4aa44db541e488d5840b2b411204/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:24.468142 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97f255-7ebb-4a51-afd4-c409f349e9d4 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:24.487698 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 986/1981] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:24 2022] POST /identity/v3/projects => generated 389 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:24.492128 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5033050-fdea-423e-a05a-46998a5fdb67 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:24.598794 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5033050-fdea-423e-a05a-46998a5fdb67 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:24.602342 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97f255-7ebb-4a51-afd4-c409f349e9d4 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:24.604718 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a1ba5-037d-467e-8586-a6926e1204fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:24.605762 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a1ba5-037d-467e-8586-a6926e1204fa admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:24.606226 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a1ba5-037d-467e-8586-a6926e1204fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:24.606752 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a1ba5-037d-467e-8586-a6926e1204fa admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:24.607619 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a1ba5-037d-467e-8586-a6926e1204fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:24.609618 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2b54b-1b82-478f-9903-ac513332d4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:24.611424 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a1ba5-037d-467e-8586-a6926e1204fa admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:24.611850 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2b54b-1b82-478f-9903-ac513332d4bc admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:24.612142 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2b54b-1b82-478f-9903-ac513332d4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:24.612426 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2b54b-1b82-478f-9903-ac513332d4bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:24.613192 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2b54b-1b82-478f-9903-ac513332d4bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:24.614837 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2b54b-1b82-478f-9903-ac513332d4bc admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:24.635980 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 996/1982] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:24.635980 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2b54b-1b82-478f-9903-ac513332d4bc admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:24.639287 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-29f2b54b-1b82-478f-9903-ac513332d4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:24.653941 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2b54b-1b82-478f-9903-ac513332d4bc admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:24.663692 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-added8fa-3a2d-4918-986d-f4e14dbd45f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:24.663692 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-added8fa-3a2d-4918-986d-f4e14dbd45f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:24.663692 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-added8fa-3a2d-4918-986d-f4e14dbd45f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:24.663692 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-added8fa-3a2d-4918-986d-f4e14dbd45f9 admin admin] PATH_INFO: `/v3/projects/ec1f71c44ee440389cdfd881c06beffc` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:24.664219 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-added8fa-3a2d-4918-986d-f4e14dbd45f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec1f71c44ee440389cdfd881c06beffc)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:24.664812 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-added8fa-3a2d-4918-986d-f4e14dbd45f9 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:24.681686 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 987/1983] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:24 2022] POST /identity/v3/users => generated 295 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:24.683041 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a1ba5-037d-467e-8586-a6926e1204fa admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:24.710409 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a1ba5-037d-467e-8586-a6926e1204fa admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:24.720627 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f93dd-102f-49cd-8e6d-d545fe09df8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:24.720627 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f93dd-102f-49cd-8e6d-d545fe09df8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:24.720627 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f93dd-102f-49cd-8e6d-d545fe09df8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:24.720627 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f93dd-102f-49cd-8e6d-d545fe09df8d admin admin] PATH_INFO: `/v3/projects/41ee23ff52d247698d1ccc4b6fc53692/users/647c4aa44db541e488d5840b2b411204/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:24.720993 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f93dd-102f-49cd-8e6d-d545fe09df8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ee23ff52d247698d1ccc4b6fc53692, user_id=647c4aa44db541e488d5840b2b411204, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:24.723583 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f93dd-102f-49cd-8e6d-d545fe09df8d admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:24.750059 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 988/1984] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:24 2022] PUT /identity/v3/projects/41ee23ff52d247698d1ccc4b6fc53692/users/647c4aa44db541e488d5840b2b411204/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:24.750059 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f93dd-102f-49cd-8e6d-d545fe09df8d admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:24.801854 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-added8fa-3a2d-4918-986d-f4e14dbd45f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec1f71c44ee440389cdfd881c06beffc', 'request_id': 'req-added8fa-3a2d-4918-986d-f4e14dbd45f9'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:24.805510 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-added8fa-3a2d-4918-986d-f4e14dbd45f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec1f71c44ee440389cdfd881c06beffc', 'request_id': 'req-added8fa-3a2d-4918-986d-f4e14dbd45f9'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:24.815464 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-added8fa-3a2d-4918-986d-f4e14dbd45f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec1f71c44ee440389cdfd881c06beffc', 'request_id': 'req-added8fa-3a2d-4918-986d-f4e14dbd45f9'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:24.850168 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f93dd-102f-49cd-8e6d-d545fe09df8d admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:24.889430 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-added8fa-3a2d-4918-986d-f4e14dbd45f9 admin admin] The token cache is being invalidate because project ec1f71c44ee440389cdfd881c06beffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:24.889977 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-added8fa-3a2d-4918-986d-f4e14dbd45f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:24.891382 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-added8fa-3a2d-4918-986d-f4e14dbd45f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:24.893667 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 997/1985] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:24 2022] DELETE /identity/v3/projects/ec1f71c44ee440389cdfd881c06beffc => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:24.895309 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98949f-f04a-44fb-a04a-ad1c501d65b3 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:24.895608 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98949f-f04a-44fb-a04a-ad1c501d65b3 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:24.895943 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98949f-f04a-44fb-a04a-ad1c501d65b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:24.932131 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d5b5c-b6ad-4a53-85a9-714d462c9d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:24.932831 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d5b5c-b6ad-4a53-85a9-714d462c9d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:24.933118 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d5b5c-b6ad-4a53-85a9-714d462c9d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:24.933424 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d5b5c-b6ad-4a53-85a9-714d462c9d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:24.934166 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d5b5c-b6ad-4a53-85a9-714d462c9d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:24.945058 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d5b5c-b6ad-4a53-85a9-714d462c9d7d admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:24.953333 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-9a98949f-f04a-44fb-a04a-ad1c501d65b3 None None] MFA Rules not processed for user `647c4aa44db541e488d5840b2b411204`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:24.954943 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-9a98949f-f04a-44fb-a04a-ad1c501d65b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:24.977857 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 989/1986] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:24.989793 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb01b1-49ec-4513-a162-795d6fa6ca16 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:24.989793 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb01b1-49ec-4513-a162-795d6fa6ca16 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:24.989793 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb01b1-49ec-4513-a162-795d6fa6ca16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:25.026342 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-a9fb01b1-49ec-4513-a162-795d6fa6ca16 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:25.030538 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-a9fb01b1-49ec-4513-a162-795d6fa6ca16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:25.055214 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 990/1987] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:25.056054 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb01b1-49ec-4513-a162-795d6fa6ca16 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:25.058296 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-a9fb01b1-49ec-4513-a162-795d6fa6ca16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:25.068264 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 998/1988] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:24 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:25.072715 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3774dd-f950-4b52-9bee-3bde4a238c3e None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:25.075173 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3774dd-f950-4b52-9bee-3bde4a238c3e None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:25.075173 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3774dd-f950-4b52-9bee-3bde4a238c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:25.083760 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb01b1-49ec-4513-a162-795d6fa6ca16 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:25.098739 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497d0e0-222e-4142-912d-9019228085d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:25.099967 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497d0e0-222e-4142-912d-9019228085d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:25.100433 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497d0e0-222e-4142-912d-9019228085d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:25.101133 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497d0e0-222e-4142-912d-9019228085d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:25.102558 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497d0e0-222e-4142-912d-9019228085d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:25.103486 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-cf3774dd-f950-4b52-9bee-3bde4a238c3e None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:25.104655 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497d0e0-222e-4142-912d-9019228085d3 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:25.104870 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-cf3774dd-f950-4b52-9bee-3bde4a238c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:25.115832 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 999/1989] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:25.115832 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3774dd-f950-4b52-9bee-3bde4a238c3e None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:25.117271 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-cf3774dd-f950-4b52-9bee-3bde4a238c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:25.122983 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 991/1990] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:25.124660 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497d0e0-222e-4142-912d-9019228085d3 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:25.138882 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497d0e0-222e-4142-912d-9019228085d3 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:25.158016 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53187996-4cf1-446c-9dcf-7fa1be3f380a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:25.160929 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53187996-4cf1-446c-9dcf-7fa1be3f380a admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:25.161222 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53187996-4cf1-446c-9dcf-7fa1be3f380a admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:25.161564 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53187996-4cf1-446c-9dcf-7fa1be3f380a admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:25.162562 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53187996-4cf1-446c-9dcf-7fa1be3f380a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:21:25.163175 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53187996-4cf1-446c-9dcf-7fa1be3f380a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:25.164967 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53187996-4cf1-446c-9dcf-7fa1be3f380a admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:25.189778 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 992/1991] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:21:25.190719 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53187996-4cf1-446c-9dcf-7fa1be3f380a admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:25.204265 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53187996-4cf1-446c-9dcf-7fa1be3f380a admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:25.211277 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b27d4-98f4-46fd-9908-5a5bcac6e3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:25.212246 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b27d4-98f4-46fd-9908-5a5bcac6e3e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:25.212642 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b27d4-98f4-46fd-9908-5a5bcac6e3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:25.212925 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b27d4-98f4-46fd-9908-5a5bcac6e3e4 admin admin] PATH_INFO: `/v3/projects/a15c932e2d874a588b3cbf39aa7ffa8b/users/fbf6d84bdf424f199b6d48188cfeb65e/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:25.229976 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b27d4-98f4-46fd-9908-5a5bcac6e3e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a15c932e2d874a588b3cbf39aa7ffa8b, user_id=fbf6d84bdf424f199b6d48188cfeb65e, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:25.230343 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3774dd-f950-4b52-9bee-3bde4a238c3e None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:25.232758 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b27d4-98f4-46fd-9908-5a5bcac6e3e4 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:25.241341 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be78f16-f9e0-4347-9073-fa173d0854ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:25.242173 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be78f16-f9e0-4347-9073-fa173d0854ca service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:25.242469 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be78f16-f9e0-4347-9073-fa173d0854ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:25.242984 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be78f16-f9e0-4347-9073-fa173d0854ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:25.254949 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be78f16-f9e0-4347-9073-fa173d0854ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:25.256800 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be78f16-f9e0-4347-9073-fa173d0854ca service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:25.270546 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1000/1992] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:25 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:21:25.271470 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be78f16-f9e0-4347-9073-fa173d0854ca service cinder] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:25.283813 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be78f16-f9e0-4347-9073-fa173d0854ca service cinder] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:25.292528 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcaf06f-a2ae-4153-98bc-0c3a02bcac99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:25.293424 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcaf06f-a2ae-4153-98bc-0c3a02bcac99 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:25.293656 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcaf06f-a2ae-4153-98bc-0c3a02bcac99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:25.294003 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcaf06f-a2ae-4153-98bc-0c3a02bcac99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:25.295387 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcaf06f-a2ae-4153-98bc-0c3a02bcac99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:25.298027 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcaf06f-a2ae-4153-98bc-0c3a02bcac99 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:25.315579 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 993/1993] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:25 2022] PUT /identity/v3/projects/a15c932e2d874a588b3cbf39aa7ffa8b/users/fbf6d84bdf424f199b6d48188cfeb65e/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:25.316882 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee9214-9cf8-49a1-838a-e119d56e2a43 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:25.317188 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee9214-9cf8-49a1-838a-e119d56e2a43 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:25.321517 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee9214-9cf8-49a1-838a-e119d56e2a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:25.369651 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-a8ee9214-9cf8-49a1-838a-e119d56e2a43 None None] MFA Rules not processed for user `fbf6d84bdf424f199b6d48188cfeb65e`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:25.370795 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-a8ee9214-9cf8-49a1-838a-e119d56e2a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:25.447842 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1001/1994] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:25 2022] POST /identity/v3/projects => generated 381 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:25.451867 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcaf06f-a2ae-4153-98bc-0c3a02bcac99 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:25.461666 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 994/1995] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:25.466301 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee9214-9cf8-49a1-838a-e119d56e2a43 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:25.537413 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcaf06f-a2ae-4153-98bc-0c3a02bcac99 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:25.544992 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee9214-9cf8-49a1-838a-e119d56e2a43 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:25.548751 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6d0a7-1193-4d50-82b2-8da7fec36d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:25.549492 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6d0a7-1193-4d50-82b2-8da7fec36d2c admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:25.549776 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6d0a7-1193-4d50-82b2-8da7fec36d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:25.550051 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6d0a7-1193-4d50-82b2-8da7fec36d2c admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:25.550296 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dece89-6e92-45f7-80d1-d03603593934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:25.550751 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6d0a7-1193-4d50-82b2-8da7fec36d2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:25.551021 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dece89-6e92-45f7-80d1-d03603593934 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:25.551309 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dece89-6e92-45f7-80d1-d03603593934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:25.551593 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dece89-6e92-45f7-80d1-d03603593934 admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:25.552290 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dece89-6e92-45f7-80d1-d03603593934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:25.552682 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6d0a7-1193-4d50-82b2-8da7fec36d2c admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:25.554246 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dece89-6e92-45f7-80d1-d03603593934 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:25.641932 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1002/1996] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:25 2022] POST /identity/v3/users => generated 291 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:21:25.648382 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6d0a7-1193-4d50-82b2-8da7fec36d2c admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:25.648382 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-67e6d0a7-1193-4d50-82b2-8da7fec36d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:25.683292 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 995/1997] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:25 2022] POST /identity/v3/projects => generated 389 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:25.683292 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dece89-6e92-45f7-80d1-d03603593934 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:25.712270 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6d0a7-1193-4d50-82b2-8da7fec36d2c admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:25.750558 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dece89-6e92-45f7-80d1-d03603593934 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:25.755422 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963684e5-8e9f-4561-8c9e-2a9415bfef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:25.756186 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963684e5-8e9f-4561-8c9e-2a9415bfef39 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:25.756541 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963684e5-8e9f-4561-8c9e-2a9415bfef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:25.756885 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963684e5-8e9f-4561-8c9e-2a9415bfef39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:25.757643 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963684e5-8e9f-4561-8c9e-2a9415bfef39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:25.759226 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963684e5-8e9f-4561-8c9e-2a9415bfef39 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:25.763191 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadfbc5-2a44-4ddb-83bc-afab585c3c1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:25.763906 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadfbc5-2a44-4ddb-83bc-afab585c3c1b service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:25.764259 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadfbc5-2a44-4ddb-83bc-afab585c3c1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:25.764541 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadfbc5-2a44-4ddb-83bc-afab585c3c1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:25.767584 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-9fadfbc5-2a44-4ddb-83bc-afab585c3c1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:25.770845 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 996/1998] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:25.771661 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963684e5-8e9f-4561-8c9e-2a9415bfef39 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:25.784142 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963684e5-8e9f-4561-8c9e-2a9415bfef39 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:25.789070 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7d2a3-eea5-46b2-8cca-8227132811e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:25.789767 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7d2a3-eea5-46b2-8cca-8227132811e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:25.790052 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7d2a3-eea5-46b2-8cca-8227132811e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:25.790494 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7d2a3-eea5-46b2-8cca-8227132811e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:25.791197 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7d2a3-eea5-46b2-8cca-8227132811e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:25.793133 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7d2a3-eea5-46b2-8cca-8227132811e6 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:25.831179 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fadfbc5-2a44-4ddb-83bc-afab585c3c1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:25.832626 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fadfbc5-2a44-4ddb-83bc-afab585c3c1b service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:25.842380 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1003/1999] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:25 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:21:25.845742 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadfbc5-2a44-4ddb-83bc-afab585c3c1b service cinder] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:25.857089 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadfbc5-2a44-4ddb-83bc-afab585c3c1b service cinder] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:25.862331 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d629e9-5362-4abc-88bc-ab98cc59cbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:25.877578 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d629e9-5362-4abc-88bc-ab98cc59cbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:25.877867 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d629e9-5362-4abc-88bc-ab98cc59cbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:25.878145 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d629e9-5362-4abc-88bc-ab98cc59cbb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:25.878962 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d629e9-5362-4abc-88bc-ab98cc59cbb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:25.880601 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d629e9-5362-4abc-88bc-ab98cc59cbb8 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:25.894200 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1004/2000] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:25.897711 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 997/2001] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:25 2022] POST /identity/v3/users => generated 301 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:25.898682 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d629e9-5362-4abc-88bc-ab98cc59cbb8 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:25.899818 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7d2a3-eea5-46b2-8cca-8227132811e6 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:25.910340 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7d2a3-eea5-46b2-8cca-8227132811e6 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:25.912857 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d629e9-5362-4abc-88bc-ab98cc59cbb8 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:25.915215 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bda119-5f88-44e8-93a6-bbdf1b18d68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:25.916127 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bda119-5f88-44e8-93a6-bbdf1b18d68a admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:25.916478 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bda119-5f88-44e8-93a6-bbdf1b18d68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:25.916769 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bda119-5f88-44e8-93a6-bbdf1b18d68a admin admin] PATH_INFO: `/v3/projects/456d72938ce040478b97e530dd78f32a/users/188094305ebd421b8479e7f383afc452/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:25.918830 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db5dc3-702e-4f06-a376-0db0ae31f577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:25.919806 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db5dc3-702e-4f06-a376-0db0ae31f577 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:25.920877 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db5dc3-702e-4f06-a376-0db0ae31f577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:25.921242 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db5dc3-702e-4f06-a376-0db0ae31f577 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:25.922715 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db5dc3-702e-4f06-a376-0db0ae31f577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:25.924237 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db5dc3-702e-4f06-a376-0db0ae31f577 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:25.933637 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bda119-5f88-44e8-93a6-bbdf1b18d68a admin admin] RBAC: Authorizing `identity:create_grant(project_id=456d72938ce040478b97e530dd78f32a, user_id=188094305ebd421b8479e7f383afc452, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:25.936549 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bda119-5f88-44e8-93a6-bbdf1b18d68a admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:25.937075 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1005/2002] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:25.945343 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db5dc3-702e-4f06-a376-0db0ae31f577 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:25.957327 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db5dc3-702e-4f06-a376-0db0ae31f577 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:25.962071 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a47d3-e8bf-49da-bffc-77df295bdb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:25.962956 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a47d3-e8bf-49da-bffc-77df295bdb1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:25.963237 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a47d3-e8bf-49da-bffc-77df295bdb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:25.963512 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a47d3-e8bf-49da-bffc-77df295bdb1f admin admin] PATH_INFO: `/v3/projects/415985228c644329a580238a647e96f0/users/37f663804d7e4569a0d762ce151ac758/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:25.983182 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a47d3-e8bf-49da-bffc-77df295bdb1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=415985228c644329a580238a647e96f0, user_id=37f663804d7e4569a0d762ce151ac758, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:25.992354 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a47d3-e8bf-49da-bffc-77df295bdb1f admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:26.018586 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 998/2003] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:25 2022] PUT /identity/v3/projects/456d72938ce040478b97e530dd78f32a/users/188094305ebd421b8479e7f383afc452/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:26.029184 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5707d94-a479-4a40-9f8b-1a3c1236c438 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:26.029775 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5707d94-a479-4a40-9f8b-1a3c1236c438 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:26.029886 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5707d94-a479-4a40-9f8b-1a3c1236c438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:26.057551 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-d5707d94-a479-4a40-9f8b-1a3c1236c438 None None] MFA Rules not processed for user `188094305ebd421b8479e7f383afc452`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:26.058752 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-d5707d94-a479-4a40-9f8b-1a3c1236c438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:26.070301 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1006/2004] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:25 2022] PUT /identity/v3/projects/415985228c644329a580238a647e96f0/users/37f663804d7e4569a0d762ce151ac758/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:26.073978 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a47d3-e8bf-49da-bffc-77df295bdb1f admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:26.123707 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 999/2005] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:21:26.128658 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5707d94-a479-4a40-9f8b-1a3c1236c438 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:26.137813 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a47d3-e8bf-49da-bffc-77df295bdb1f admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:26.144378 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5036fa-2208-4a1d-a022-b31e19d8db12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:26.145104 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5036fa-2208-4a1d-a022-b31e19d8db12 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:26.145437 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5036fa-2208-4a1d-a022-b31e19d8db12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:26.149586 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5036fa-2208-4a1d-a022-b31e19d8db12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:26.149586 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5036fa-2208-4a1d-a022-b31e19d8db12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:26.149586 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5036fa-2208-4a1d-a022-b31e19d8db12 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:26.160122 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1007/2006] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:21:26.164062 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5036fa-2208-4a1d-a022-b31e19d8db12 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:26.175113 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5036fa-2208-4a1d-a022-b31e19d8db12 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:26.180886 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae57a7f-4d9c-4b31-95af-871a6fc36fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:26.182662 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae57a7f-4d9c-4b31-95af-871a6fc36fc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:26.182662 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae57a7f-4d9c-4b31-95af-871a6fc36fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:26.182662 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae57a7f-4d9c-4b31-95af-871a6fc36fc2 admin admin] PATH_INFO: `/v3/projects/415985228c644329a580238a647e96f0/users/37f663804d7e4569a0d762ce151ac758/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:26.184790 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae57a7f-4d9c-4b31-95af-871a6fc36fc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=415985228c644329a580238a647e96f0, user_id=37f663804d7e4569a0d762ce151ac758, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:26.188115 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae57a7f-4d9c-4b31-95af-871a6fc36fc2 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:26.199328 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1008/2007] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:26 2022] PUT /identity/v3/projects/415985228c644329a580238a647e96f0/users/37f663804d7e4569a0d762ce151ac758/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:26.199749 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5707d94-a479-4a40-9f8b-1a3c1236c438 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:26.210083 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61725e-1f0d-4880-8e94-eae618bb4c32 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:26.210375 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61725e-1f0d-4880-8e94-eae618bb4c32 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:26.210681 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61725e-1f0d-4880-8e94-eae618bb4c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:26.236968 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-4e61725e-1f0d-4880-8e94-eae618bb4c32 None None] MFA Rules not processed for user `37f663804d7e4569a0d762ce151ac758`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:26.238574 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-4e61725e-1f0d-4880-8e94-eae618bb4c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:26.258607 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c508035-6241-4ebd-9dc7-e2982e326409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:26.260590 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c508035-6241-4ebd-9dc7-e2982e326409 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:26.260590 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c508035-6241-4ebd-9dc7-e2982e326409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:26.260590 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c508035-6241-4ebd-9dc7-e2982e326409 admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:26.261212 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c508035-6241-4ebd-9dc7-e2982e326409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:26.263235 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c508035-6241-4ebd-9dc7-e2982e326409 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:26.309895 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1009/2008] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:26.320784 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61725e-1f0d-4880-8e94-eae618bb4c32 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:26.356097 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1000/2009] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:26 2022] POST /identity/v3/projects => generated 383 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:21:26.361232 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c508035-6241-4ebd-9dc7-e2982e326409 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:26.376759 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61725e-1f0d-4880-8e94-eae618bb4c32 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:26.431133 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c508035-6241-4ebd-9dc7-e2982e326409 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:26.432708 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f408f-59d7-4fbf-8fc3-7bbd35dc6bc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:26.433475 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f408f-59d7-4fbf-8fc3-7bbd35dc6bc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:26.433959 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f408f-59d7-4fbf-8fc3-7bbd35dc6bc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:26.434315 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f408f-59d7-4fbf-8fc3-7bbd35dc6bc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:26.436588 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c20e4f-5c36-4ac3-9fb5-958cfa97c891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:26.438050 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c20e4f-5c36-4ac3-9fb5-958cfa97c891 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:26.438346 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c20e4f-5c36-4ac3-9fb5-958cfa97c891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:26.438629 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c20e4f-5c36-4ac3-9fb5-958cfa97c891 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:26.439333 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c20e4f-5c36-4ac3-9fb5-958cfa97c891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:26.441799 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c20e4f-5c36-4ac3-9fb5-958cfa97c891 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:26.516692 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f408f-59d7-4fbf-8fc3-7bbd35dc6bc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:26.518588 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f408f-59d7-4fbf-8fc3-7bbd35dc6bc5 service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:26.529341 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1010/2010] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:21:26.575300 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1001/2011] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:26 2022] POST /identity/v3/users => generated 298 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:21:26.576904 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f408f-59d7-4fbf-8fc3-7bbd35dc6bc5 service cinder] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:26.590416 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f408f-59d7-4fbf-8fc3-7bbd35dc6bc5 service cinder] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:26.595598 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe89f2-a389-451e-a1ff-1bd41f284b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:26.596309 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe89f2-a389-451e-a1ff-1bd41f284b3f admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:26.596581 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe89f2-a389-451e-a1ff-1bd41f284b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:26.596949 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe89f2-a389-451e-a1ff-1bd41f284b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:26.597713 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe89f2-a389-451e-a1ff-1bd41f284b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:26.599313 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe89f2-a389-451e-a1ff-1bd41f284b3f admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:26.610527 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1011/2012] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:26.617486 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c20e4f-5c36-4ac3-9fb5-958cfa97c891 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:26.627345 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c20e4f-5c36-4ac3-9fb5-958cfa97c891 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:26.631134 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660496ba-2129-481c-a94d-579395a6fcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:26.632157 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660496ba-2129-481c-a94d-579395a6fcc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:26.632540 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660496ba-2129-481c-a94d-579395a6fcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:26.632925 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660496ba-2129-481c-a94d-579395a6fcc1 admin admin] PATH_INFO: `/v3/projects/e8acb66c364a4127be9fa133563bf2b3/users/60295c5fae1c4a7aa44e20432a81de6c/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:26.649877 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660496ba-2129-481c-a94d-579395a6fcc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8acb66c364a4127be9fa133563bf2b3, user_id=60295c5fae1c4a7aa44e20432a81de6c, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:26.652683 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660496ba-2129-481c-a94d-579395a6fcc1 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:26.663861 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe89f2-a389-451e-a1ff-1bd41f284b3f admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:26.674347 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe89f2-a389-451e-a1ff-1bd41f284b3f admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:26.678945 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45faeb1c-8592-4cbb-9a6f-813a5b132167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:26.679806 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45faeb1c-8592-4cbb-9a6f-813a5b132167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:26.680086 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45faeb1c-8592-4cbb-9a6f-813a5b132167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:26.680363 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45faeb1c-8592-4cbb-9a6f-813a5b132167 admin admin] PATH_INFO: `/v3/users/fbf6d84bdf424f199b6d48188cfeb65e` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:26.681577 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45faeb1c-8592-4cbb-9a6f-813a5b132167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbf6d84bdf424f199b6d48188cfeb65e)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:26.683519 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45faeb1c-8592-4cbb-9a6f-813a5b132167 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:26.766845 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1002/2013] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:26 2022] PUT /identity/v3/projects/e8acb66c364a4127be9fa133563bf2b3/users/60295c5fae1c4a7aa44e20432a81de6c/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:26.771577 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660496ba-2129-481c-a94d-579395a6fcc1 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:26.835694 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660496ba-2129-481c-a94d-579395a6fcc1 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:26.840551 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f1333-3432-4aee-9a34-f1b19c7b1dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:26.841224 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f1333-3432-4aee-9a34-f1b19c7b1dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:26.841565 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f1333-3432-4aee-9a34-f1b19c7b1dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:26.841872 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f1333-3432-4aee-9a34-f1b19c7b1dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:26.842554 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f1333-3432-4aee-9a34-f1b19c7b1dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:26.844931 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f1333-3432-4aee-9a34-f1b19c7b1dc3 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:26.849022 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-45faeb1c-8592-4cbb-9a6f-813a5b132167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbf6d84bdf424f199b6d48188cfeb65e'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:26.854879 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1003/2014] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:21:26.859807 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f1333-3432-4aee-9a34-f1b19c7b1dc3 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:26.869520 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f1333-3432-4aee-9a34-f1b19c7b1dc3 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:26.874264 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76583e4d-7c1c-4eab-a357-7c5c195e0997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:26.875252 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76583e4d-7c1c-4eab-a357-7c5c195e0997 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:26.875535 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76583e4d-7c1c-4eab-a357-7c5c195e0997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:26.875814 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76583e4d-7c1c-4eab-a357-7c5c195e0997 admin admin] PATH_INFO: `/v3/projects/e8acb66c364a4127be9fa133563bf2b3/users/60295c5fae1c4a7aa44e20432a81de6c/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:26.880749 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76583e4d-7c1c-4eab-a357-7c5c195e0997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8acb66c364a4127be9fa133563bf2b3, user_id=60295c5fae1c4a7aa44e20432a81de6c, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:26.880749 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76583e4d-7c1c-4eab-a357-7c5c195e0997 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:26.891098 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1004/2015] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:26 2022] PUT /identity/v3/projects/e8acb66c364a4127be9fa133563bf2b3/users/60295c5fae1c4a7aa44e20432a81de6c/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:26.891563 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-45faeb1c-8592-4cbb-9a6f-813a5b132167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbf6d84bdf424f199b6d48188cfeb65e'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:26.892213 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-45faeb1c-8592-4cbb-9a6f-813a5b132167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbf6d84bdf424f199b6d48188cfeb65e'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:26.892832 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-45faeb1c-8592-4cbb-9a6f-813a5b132167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbf6d84bdf424f199b6d48188cfeb65e'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:26.900262 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-45faeb1c-8592-4cbb-9a6f-813a5b132167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbf6d84bdf424f199b6d48188cfeb65e'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:26.901931 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16907b39-f94e-4483-9a18-46a1459a2aa1 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:26.902300 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16907b39-f94e-4483-9a18-46a1459a2aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:26.902585 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16907b39-f94e-4483-9a18-46a1459a2aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:26.918867 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1012/2016] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:26 2022] DELETE /identity/v3/users/fbf6d84bdf424f199b6d48188cfeb65e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:26.924481 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddf14d-d9d2-44cc-988e-7c7da228ec0f None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:26.924771 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddf14d-d9d2-44cc-988e-7c7da228ec0f None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:26.925055 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddf14d-d9d2-44cc-988e-7c7da228ec0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:26.931231 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-16907b39-f94e-4483-9a18-46a1459a2aa1 None None] MFA Rules not processed for user `60295c5fae1c4a7aa44e20432a81de6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:26.932432 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-16907b39-f94e-4483-9a18-46a1459a2aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:26.943093 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-2fddf14d-d9d2-44cc-988e-7c7da228ec0f None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:26.944340 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-2fddf14d-d9d2-44cc-988e-7c7da228ec0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:27.002478 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1005/2017] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:21:27.005819 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1013/2018] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:21:27.018562 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16907b39-f94e-4483-9a18-46a1459a2aa1 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:27.020024 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-16907b39-f94e-4483-9a18-46a1459a2aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:27.020218 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddf14d-d9d2-44cc-988e-7c7da228ec0f None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:27.021665 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-2fddf14d-d9d2-44cc-988e-7c7da228ec0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:27.077048 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16907b39-f94e-4483-9a18-46a1459a2aa1 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:27.080883 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28ddf3-66da-41e4-95ef-19023d675e58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:27.081527 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28ddf3-66da-41e4-95ef-19023d675e58 service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:27.081818 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28ddf3-66da-41e4-95ef-19023d675e58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:27.081920 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddf14d-d9d2-44cc-988e-7c7da228ec0f None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:27.082094 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28ddf3-66da-41e4-95ef-19023d675e58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:27.085500 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a88efd-fc1f-4f3b-af99-65880fbf345b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:27.086139 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a88efd-fc1f-4f3b-af99-65880fbf345b service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:27.086420 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a88efd-fc1f-4f3b-af99-65880fbf345b service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:27.086696 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a88efd-fc1f-4f3b-af99-65880fbf345b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:27.091065 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28ddf3-66da-41e4-95ef-19023d675e58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:27.092489 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28ddf3-66da-41e4-95ef-19023d675e58 service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:27.096193 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a88efd-fc1f-4f3b-af99-65880fbf345b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:27.097641 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a88efd-fc1f-4f3b-af99-65880fbf345b service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:27.102610 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1006/2019] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:21:27.107109 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1014/2020] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:21:27.256373 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28ddf3-66da-41e4-95ef-19023d675e58 service cinder] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:27.266494 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28ddf3-66da-41e4-95ef-19023d675e58 service cinder] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:27.270528 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7c079-2d08-4e9e-b164-00def88562db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:27.271170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7c079-2d08-4e9e-b164-00def88562db service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:27.271455 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7c079-2d08-4e9e-b164-00def88562db service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:27.271734 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7c079-2d08-4e9e-b164-00def88562db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:27.273672 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-c9d7c079-2d08-4e9e-b164-00def88562db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:27.338777 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7c079-2d08-4e9e-b164-00def88562db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:27.340311 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7c079-2d08-4e9e-b164-00def88562db service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:27.350881 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1007/2021] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:21:27.532593 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a88efd-fc1f-4f3b-af99-65880fbf345b service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:27.532593 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-d0a88efd-fc1f-4f3b-af99-65880fbf345b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:27.549604 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a88efd-fc1f-4f3b-af99-65880fbf345b service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:27.559114 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd599d8-5f2f-455a-bab7-997e5b80af65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:27.559114 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd599d8-5f2f-455a-bab7-997e5b80af65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:27.559114 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd599d8-5f2f-455a-bab7-997e5b80af65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:27.559114 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd599d8-5f2f-455a-bab7-997e5b80af65 admin admin] PATH_INFO: `/v3/projects/a15c932e2d874a588b3cbf39aa7ffa8b` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:27.559403 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd599d8-5f2f-455a-bab7-997e5b80af65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a15c932e2d874a588b3cbf39aa7ffa8b)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:27.559403 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd599d8-5f2f-455a-bab7-997e5b80af65 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:27.686473 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ffd599d8-5f2f-455a-bab7-997e5b80af65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a15c932e2d874a588b3cbf39aa7ffa8b', 'request_id': 'req-ffd599d8-5f2f-455a-bab7-997e5b80af65'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:27.693237 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ffd599d8-5f2f-455a-bab7-997e5b80af65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a15c932e2d874a588b3cbf39aa7ffa8b', 'request_id': 'req-ffd599d8-5f2f-455a-bab7-997e5b80af65'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:27.699440 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ffd599d8-5f2f-455a-bab7-997e5b80af65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a15c932e2d874a588b3cbf39aa7ffa8b', 'request_id': 'req-ffd599d8-5f2f-455a-bab7-997e5b80af65'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:27.783280 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ffd599d8-5f2f-455a-bab7-997e5b80af65 admin admin] The token cache is being invalidate because project a15c932e2d874a588b3cbf39aa7ffa8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:27.789013 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ffd599d8-5f2f-455a-bab7-997e5b80af65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:27.789013 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ffd599d8-5f2f-455a-bab7-997e5b80af65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:27.789013 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1015/2022] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:27 2022] DELETE /identity/v3/projects/a15c932e2d874a588b3cbf39aa7ffa8b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:27.790397 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7c079-2d08-4e9e-b164-00def88562db service cinder] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:27.801822 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7c079-2d08-4e9e-b164-00def88562db service cinder] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:27.857924 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3b22b-d38e-46f4-915e-7edca9a66272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:27.859267 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3b22b-d38e-46f4-915e-7edca9a66272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:27.859540 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3b22b-d38e-46f4-915e-7edca9a66272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:27.859820 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3b22b-d38e-46f4-915e-7edca9a66272 admin admin] PATH_INFO: `/v3/users/37f663804d7e4569a0d762ce151ac758` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:27.860989 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3b22b-d38e-46f4-915e-7edca9a66272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37f663804d7e4569a0d762ce151ac758)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:27.863018 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3b22b-d38e-46f4-915e-7edca9a66272 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:27.889525 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd599d8-5f2f-455a-bab7-997e5b80af65 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:27.892227 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-ffd599d8-5f2f-455a-bab7-997e5b80af65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:27.905020 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd599d8-5f2f-455a-bab7-997e5b80af65 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:27.909747 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8716d6-fa8e-43d0-8ae9-b4d844bc7a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:27.910649 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8716d6-fa8e-43d0-8ae9-b4d844bc7a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:27.910931 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8716d6-fa8e-43d0-8ae9-b4d844bc7a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:27.911205 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8716d6-fa8e-43d0-8ae9-b4d844bc7a38 admin admin] PATH_INFO: `/v3/users/188094305ebd421b8479e7f383afc452` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:27.912392 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8716d6-fa8e-43d0-8ae9-b4d844bc7a38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=188094305ebd421b8479e7f383afc452)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:27.914360 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8716d6-fa8e-43d0-8ae9-b4d844bc7a38 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:28.037382 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a9e3b22b-d38e-46f4-915e-7edca9a66272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37f663804d7e4569a0d762ce151ac758'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:28.054228 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ae8716d6-fa8e-43d0-8ae9-b4d844bc7a38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '188094305ebd421b8479e7f383afc452'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:28.080233 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a9e3b22b-d38e-46f4-915e-7edca9a66272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37f663804d7e4569a0d762ce151ac758'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:28.080846 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a9e3b22b-d38e-46f4-915e-7edca9a66272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37f663804d7e4569a0d762ce151ac758'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:28.088043 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a9e3b22b-d38e-46f4-915e-7edca9a66272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37f663804d7e4569a0d762ce151ac758'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:28.099809 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a9e3b22b-d38e-46f4-915e-7edca9a66272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37f663804d7e4569a0d762ce151ac758'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:28.105831 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1008/2023] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:27 2022] DELETE /identity/v3/users/37f663804d7e4569a0d762ce151ac758 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:28.120196 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ae8716d6-fa8e-43d0-8ae9-b4d844bc7a38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '188094305ebd421b8479e7f383afc452'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:28.120912 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ae8716d6-fa8e-43d0-8ae9-b4d844bc7a38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '188094305ebd421b8479e7f383afc452'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:28.121628 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ae8716d6-fa8e-43d0-8ae9-b4d844bc7a38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '188094305ebd421b8479e7f383afc452'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:28.129646 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ae8716d6-fa8e-43d0-8ae9-b4d844bc7a38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '188094305ebd421b8479e7f383afc452'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:28.146775 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1016/2024] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:27 2022] DELETE /identity/v3/users/188094305ebd421b8479e7f383afc452 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:28.151042 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d54173-96eb-4865-8fe4-29eaee0a2718 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:28.151496 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d54173-96eb-4865-8fe4-29eaee0a2718 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:28.151787 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d54173-96eb-4865-8fe4-29eaee0a2718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:28.169345 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-f5d54173-96eb-4865-8fe4-29eaee0a2718 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:28.170550 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-f5d54173-96eb-4865-8fe4-29eaee0a2718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:28.236382 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1009/2025] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:28.246990 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8716d6-fa8e-43d0-8ae9-b4d844bc7a38 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:28.248795 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-ae8716d6-fa8e-43d0-8ae9-b4d844bc7a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:28.309797 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8716d6-fa8e-43d0-8ae9-b4d844bc7a38 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:28.315445 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ef402-94a2-4810-bfdc-c453b3b1e51e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:28.316567 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ef402-94a2-4810-bfdc-c453b3b1e51e service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:28.316567 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ef402-94a2-4810-bfdc-c453b3b1e51e service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:28.316796 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ef402-94a2-4810-bfdc-c453b3b1e51e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:28.330749 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ef402-94a2-4810-bfdc-c453b3b1e51e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:28.333033 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ef402-94a2-4810-bfdc-c453b3b1e51e service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:28.344496 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1017/2026] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:21:28.607568 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d54173-96eb-4865-8fe4-29eaee0a2718 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:28.609671 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-f5d54173-96eb-4865-8fe4-29eaee0a2718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:28.626215 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d54173-96eb-4865-8fe4-29eaee0a2718 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:28.634004 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb5e77-364c-427f-9ecd-b7b1e59b9d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:28.635355 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb5e77-364c-427f-9ecd-b7b1e59b9d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:28.635648 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb5e77-364c-427f-9ecd-b7b1e59b9d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:28.635988 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb5e77-364c-427f-9ecd-b7b1e59b9d93 admin admin] PATH_INFO: `/v3/projects/415985228c644329a580238a647e96f0` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:28.637246 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb5e77-364c-427f-9ecd-b7b1e59b9d93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=415985228c644329a580238a647e96f0)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:28.653281 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb5e77-364c-427f-9ecd-b7b1e59b9d93 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:28.792475 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-88bb5e77-364c-427f-9ecd-b7b1e59b9d93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '415985228c644329a580238a647e96f0', 'request_id': 'req-88bb5e77-364c-427f-9ecd-b7b1e59b9d93'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:28.863575 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-88bb5e77-364c-427f-9ecd-b7b1e59b9d93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '415985228c644329a580238a647e96f0', 'request_id': 'req-88bb5e77-364c-427f-9ecd-b7b1e59b9d93'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:28.870168 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-88bb5e77-364c-427f-9ecd-b7b1e59b9d93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '415985228c644329a580238a647e96f0', 'request_id': 'req-88bb5e77-364c-427f-9ecd-b7b1e59b9d93'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:28.894886 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-88bb5e77-364c-427f-9ecd-b7b1e59b9d93 admin admin] The token cache is being invalidate because project 415985228c644329a580238a647e96f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:28.895181 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-88bb5e77-364c-427f-9ecd-b7b1e59b9d93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:28.895970 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-88bb5e77-364c-427f-9ecd-b7b1e59b9d93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:28.897616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1010/2027] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:28 2022] DELETE /identity/v3/projects/415985228c644329a580238a647e96f0 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:28.904090 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536cabe-227e-41b3-bc42-71dfe4f447bc None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:28.904563 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536cabe-227e-41b3-bc42-71dfe4f447bc None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:28.904639 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536cabe-227e-41b3-bc42-71dfe4f447bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:28.923222 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-c536cabe-227e-41b3-bc42-71dfe4f447bc None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:28.924439 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-c536cabe-227e-41b3-bc42-71dfe4f447bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:28.969217 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb5e77-364c-427f-9ecd-b7b1e59b9d93 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:28.972009 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-88bb5e77-364c-427f-9ecd-b7b1e59b9d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:28.993720 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1018/2028] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:21:29.004036 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7101724-e0fe-478f-bc99-e72f915d22e8 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:29.004335 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7101724-e0fe-478f-bc99-e72f915d22e8 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:29.004779 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7101724-e0fe-478f-bc99-e72f915d22e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:29.025822 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-a7101724-e0fe-478f-bc99-e72f915d22e8 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:29.027048 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a7101724-e0fe-478f-bc99-e72f915d22e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:29.036092 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1019/2029] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:29.040401 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7101724-e0fe-478f-bc99-e72f915d22e8 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:29.049673 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7101724-e0fe-478f-bc99-e72f915d22e8 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:29.054737 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb5e77-364c-427f-9ecd-b7b1e59b9d93 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:29.054887 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87d456-72fe-47ad-97d1-bb5869c7624c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:29.055403 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87d456-72fe-47ad-97d1-bb5869c7624c admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:29.057586 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87d456-72fe-47ad-97d1-bb5869c7624c admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:29.057586 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87d456-72fe-47ad-97d1-bb5869c7624c admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:29.057586 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87d456-72fe-47ad-97d1-bb5869c7624c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:21:29.057586 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87d456-72fe-47ad-97d1-bb5869c7624c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:29.058589 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87d456-72fe-47ad-97d1-bb5869c7624c admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:29.059431 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69fe5d-184d-4ec5-a78a-427cdf5001ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:29.060280 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69fe5d-184d-4ec5-a78a-427cdf5001ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:29.060569 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69fe5d-184d-4ec5-a78a-427cdf5001ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:29.060848 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69fe5d-184d-4ec5-a78a-427cdf5001ee admin admin] PATH_INFO: `/v3/projects/456d72938ce040478b97e530dd78f32a` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:29.063041 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69fe5d-184d-4ec5-a78a-427cdf5001ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=456d72938ce040478b97e530dd78f32a)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:29.065003 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69fe5d-184d-4ec5-a78a-427cdf5001ee admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:29.073359 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1020/2030] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:21:29.077908 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87d456-72fe-47ad-97d1-bb5869c7624c admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:29.093961 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87d456-72fe-47ad-97d1-bb5869c7624c admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:29.099179 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a653ad-c3ef-41ec-bd1e-68dd0eeef011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:29.099865 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a653ad-c3ef-41ec-bd1e-68dd0eeef011 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:29.100131 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a653ad-c3ef-41ec-bd1e-68dd0eeef011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:29.100433 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a653ad-c3ef-41ec-bd1e-68dd0eeef011 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:29.101197 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a653ad-c3ef-41ec-bd1e-68dd0eeef011 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:29.103131 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a653ad-c3ef-41ec-bd1e-68dd0eeef011 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:29.172747 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-4e69fe5d-184d-4ec5-a78a-427cdf5001ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '456d72938ce040478b97e530dd78f32a', 'request_id': 'req-4e69fe5d-184d-4ec5-a78a-427cdf5001ee'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:29.195936 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1021/2031] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:29 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:21:29.200150 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a653ad-c3ef-41ec-bd1e-68dd0eeef011 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:29.235702 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-4e69fe5d-184d-4ec5-a78a-427cdf5001ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '456d72938ce040478b97e530dd78f32a', 'request_id': 'req-4e69fe5d-184d-4ec5-a78a-427cdf5001ee'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:29.243007 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-4e69fe5d-184d-4ec5-a78a-427cdf5001ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '456d72938ce040478b97e530dd78f32a', 'request_id': 'req-4e69fe5d-184d-4ec5-a78a-427cdf5001ee'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:29.254641 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-4e69fe5d-184d-4ec5-a78a-427cdf5001ee admin admin] The token cache is being invalidate because project 456d72938ce040478b97e530dd78f32a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:29.254939 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-4e69fe5d-184d-4ec5-a78a-427cdf5001ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:29.255641 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-4e69fe5d-184d-4ec5-a78a-427cdf5001ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:29.260286 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1011/2032] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:28 2022] DELETE /identity/v3/projects/456d72938ce040478b97e530dd78f32a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:29.261080 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69fe5d-184d-4ec5-a78a-427cdf5001ee admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:29.263064 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-4e69fe5d-184d-4ec5-a78a-427cdf5001ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:29.266494 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a653ad-c3ef-41ec-bd1e-68dd0eeef011 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:29.271855 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214bb360-6aba-45c0-8d03-893a05a0b9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:29.272531 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bb360-6aba-45c0-8d03-893a05a0b9f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:29.272822 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bb360-6aba-45c0-8d03-893a05a0b9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:29.273097 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bb360-6aba-45c0-8d03-893a05a0b9f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:29.273825 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214bb360-6aba-45c0-8d03-893a05a0b9f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:29.275769 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214bb360-6aba-45c0-8d03-893a05a0b9f9 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:29.327801 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69fe5d-184d-4ec5-a78a-427cdf5001ee admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:29.336583 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e34ec6-e02f-4969-b713-dee397d236aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:29.337504 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e34ec6-e02f-4969-b713-dee397d236aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:29.337787 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e34ec6-e02f-4969-b713-dee397d236aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:29.338062 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e34ec6-e02f-4969-b713-dee397d236aa admin admin] PATH_INFO: `/v3/users/60295c5fae1c4a7aa44e20432a81de6c` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:29.339316 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e34ec6-e02f-4969-b713-dee397d236aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=60295c5fae1c4a7aa44e20432a81de6c)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:29.341215 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e34ec6-e02f-4969-b713-dee397d236aa admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:29.361268 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1022/2033] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:29 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:21:29.362372 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214bb360-6aba-45c0-8d03-893a05a0b9f9 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:29.364071 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-214bb360-6aba-45c0-8d03-893a05a0b9f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:29.376239 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214bb360-6aba-45c0-8d03-893a05a0b9f9 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:29.380791 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da149c69-2ef2-41e2-a503-fbe30ce1309e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:29.381474 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da149c69-2ef2-41e2-a503-fbe30ce1309e admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:29.381761 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da149c69-2ef2-41e2-a503-fbe30ce1309e admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:29.382050 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da149c69-2ef2-41e2-a503-fbe30ce1309e admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:29.382755 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da149c69-2ef2-41e2-a503-fbe30ce1309e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:29.384335 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da149c69-2ef2-41e2-a503-fbe30ce1309e admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:29.394088 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1023/2034] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:29.397970 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da149c69-2ef2-41e2-a503-fbe30ce1309e admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:29.408659 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da149c69-2ef2-41e2-a503-fbe30ce1309e admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:29.413257 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161499e-0a3a-4339-ad08-b7a45e3da0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:29.413949 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161499e-0a3a-4339-ad08-b7a45e3da0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:29.414233 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161499e-0a3a-4339-ad08-b7a45e3da0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:29.414591 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161499e-0a3a-4339-ad08-b7a45e3da0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:29.415297 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161499e-0a3a-4339-ad08-b7a45e3da0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:29.416834 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161499e-0a3a-4339-ad08-b7a45e3da0d3 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:29.427190 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1024/2035] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:21:29.431021 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161499e-0a3a-4339-ad08-b7a45e3da0d3 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:29.441190 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161499e-0a3a-4339-ad08-b7a45e3da0d3 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:29.445930 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4e251-d6ba-4395-9707-de75e4766710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:29.446809 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4e251-d6ba-4395-9707-de75e4766710 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:29.447091 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4e251-d6ba-4395-9707-de75e4766710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:29.447488 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4e251-d6ba-4395-9707-de75e4766710 admin admin] PATH_INFO: `/v3/projects/8c4ed2d69982450796568b5b0be558e2/users/27ab10fcac174064b6cfc6611bb12025/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:29.462641 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4e251-d6ba-4395-9707-de75e4766710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c4ed2d69982450796568b5b0be558e2, user_id=27ab10fcac174064b6cfc6611bb12025, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:29.465368 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4e251-d6ba-4395-9707-de75e4766710 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:29.545528 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-78e34ec6-e02f-4969-b713-dee397d236aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60295c5fae1c4a7aa44e20432a81de6c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:29.555284 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1025/2036] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:29 2022] PUT /identity/v3/projects/8c4ed2d69982450796568b5b0be558e2/users/27ab10fcac174064b6cfc6611bb12025/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:29.565842 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28d332-7792-463a-920c-cdcdd27c4c08 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:29.566135 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28d332-7792-463a-920c-cdcdd27c4c08 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:29.566423 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28d332-7792-463a-920c-cdcdd27c4c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:29.594065 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-4d28d332-7792-463a-920c-cdcdd27c4c08 None None] MFA Rules not processed for user `27ab10fcac174064b6cfc6611bb12025`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:29.595413 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-4d28d332-7792-463a-920c-cdcdd27c4c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:29.605708 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-78e34ec6-e02f-4969-b713-dee397d236aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60295c5fae1c4a7aa44e20432a81de6c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:29.606692 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-78e34ec6-e02f-4969-b713-dee397d236aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60295c5fae1c4a7aa44e20432a81de6c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:29.614580 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-78e34ec6-e02f-4969-b713-dee397d236aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60295c5fae1c4a7aa44e20432a81de6c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:29.626365 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-78e34ec6-e02f-4969-b713-dee397d236aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60295c5fae1c4a7aa44e20432a81de6c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:29.632582 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1012/2037] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:29 2022] DELETE /identity/v3/users/60295c5fae1c4a7aa44e20432a81de6c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:29.662269 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1026/2038] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:21:29.667162 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e34ec6-e02f-4969-b713-dee397d236aa admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:29.668709 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-78e34ec6-e02f-4969-b713-dee397d236aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:29.757443 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e34ec6-e02f-4969-b713-dee397d236aa admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:29.762075 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5f05d-a218-4b86-b8c7-2ec066a759b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:29.762735 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5f05d-a218-4b86-b8c7-2ec066a759b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:29.763024 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5f05d-a218-4b86-b8c7-2ec066a759b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:29.763302 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5f05d-a218-4b86-b8c7-2ec066a759b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:29.764006 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5f05d-a218-4b86-b8c7-2ec066a759b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:29.766602 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5f05d-a218-4b86-b8c7-2ec066a759b3 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:29.833347 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1013/2039] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:29 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:29.835353 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28d332-7792-463a-920c-cdcdd27c4c08 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:29.913603 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28d332-7792-463a-920c-cdcdd27c4c08 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:29.974380 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848aefff-32ab-437c-be3f-1aab7f7b96c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:29.975062 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848aefff-32ab-437c-be3f-1aab7f7b96c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:29.975353 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848aefff-32ab-437c-be3f-1aab7f7b96c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:29.975659 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848aefff-32ab-437c-be3f-1aab7f7b96c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:29.976352 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848aefff-32ab-437c-be3f-1aab7f7b96c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:29.978394 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848aefff-32ab-437c-be3f-1aab7f7b96c0 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:30.089876 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5f05d-a218-4b86-b8c7-2ec066a759b3 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:30.091623 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-65b5f05d-a218-4b86-b8c7-2ec066a759b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:30.104991 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5f05d-a218-4b86-b8c7-2ec066a759b3 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:30.110850 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382c656-35ea-43ad-90d7-272b49275fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:30.111722 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382c656-35ea-43ad-90d7-272b49275fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:30.112010 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382c656-35ea-43ad-90d7-272b49275fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:30.112291 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382c656-35ea-43ad-90d7-272b49275fbb admin admin] PATH_INFO: `/v3/projects/e8acb66c364a4127be9fa133563bf2b3` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:30.113526 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382c656-35ea-43ad-90d7-272b49275fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8acb66c364a4127be9fa133563bf2b3)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:30.115571 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382c656-35ea-43ad-90d7-272b49275fbb admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:30.159436 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1027/2040] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:29 2022] POST /identity/v3/users => generated 293 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:30.164434 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848aefff-32ab-437c-be3f-1aab7f7b96c0 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:30.171433 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848aefff-32ab-437c-be3f-1aab7f7b96c0 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:30.176327 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e14c1-ca0b-43f5-8407-7b4b7983e7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:30.177021 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e14c1-ca0b-43f5-8407-7b4b7983e7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:30.177339 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e14c1-ca0b-43f5-8407-7b4b7983e7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:30.177629 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e14c1-ca0b-43f5-8407-7b4b7983e7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:30.178363 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e14c1-ca0b-43f5-8407-7b4b7983e7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:30.179989 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e14c1-ca0b-43f5-8407-7b4b7983e7b2 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:30.191767 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1028/2041] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:30.195693 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e14c1-ca0b-43f5-8407-7b4b7983e7b2 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:30.207655 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e14c1-ca0b-43f5-8407-7b4b7983e7b2 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:30.222224 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b382c656-35ea-43ad-90d7-272b49275fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8acb66c364a4127be9fa133563bf2b3', 'request_id': 'req-b382c656-35ea-43ad-90d7-272b49275fbb'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:30.272106 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5372a64-9e7d-42f8-bf6b-6837634f5ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:30.272905 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5372a64-9e7d-42f8-bf6b-6837634f5ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:30.273191 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5372a64-9e7d-42f8-bf6b-6837634f5ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:30.273496 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5372a64-9e7d-42f8-bf6b-6837634f5ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:30.274277 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5372a64-9e7d-42f8-bf6b-6837634f5ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:30.276086 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5372a64-9e7d-42f8-bf6b-6837634f5ab7 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:30.281567 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b382c656-35ea-43ad-90d7-272b49275fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8acb66c364a4127be9fa133563bf2b3', 'request_id': 'req-b382c656-35ea-43ad-90d7-272b49275fbb'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:30.291262 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1029/2042] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:30.291762 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b382c656-35ea-43ad-90d7-272b49275fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8acb66c364a4127be9fa133563bf2b3', 'request_id': 'req-b382c656-35ea-43ad-90d7-272b49275fbb'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:30.292690 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5372a64-9e7d-42f8-bf6b-6837634f5ab7 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:30.308623 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5372a64-9e7d-42f8-bf6b-6837634f5ab7 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:30.308721 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b382c656-35ea-43ad-90d7-272b49275fbb admin admin] The token cache is being invalidate because project e8acb66c364a4127be9fa133563bf2b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:30.308721 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b382c656-35ea-43ad-90d7-272b49275fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:30.308721 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b382c656-35ea-43ad-90d7-272b49275fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:30.309240 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1014/2043] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:30 2022] DELETE /identity/v3/projects/e8acb66c364a4127be9fa133563bf2b3 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:30.314495 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4d4a7-222d-4806-aa28-a86245ac0487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:30.314764 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76c79d-d2d9-4848-9ffb-cd9efa8f9d9f None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:30.315021 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76c79d-d2d9-4848-9ffb-cd9efa8f9d9f None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:30.315295 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76c79d-d2d9-4848-9ffb-cd9efa8f9d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:30.315395 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4d4a7-222d-4806-aa28-a86245ac0487 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:30.315667 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4d4a7-222d-4806-aa28-a86245ac0487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:30.316098 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4d4a7-222d-4806-aa28-a86245ac0487 admin admin] PATH_INFO: `/v3/projects/fb9ff164b31942c8a8ce43b9e74aabb7/users/37a6600757c4480cab5efa197a9a0821/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:30.332616 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4d4a7-222d-4806-aa28-a86245ac0487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb9ff164b31942c8a8ce43b9e74aabb7, user_id=37a6600757c4480cab5efa197a9a0821, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:30.334213 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-ef76c79d-d2d9-4848-9ffb-cd9efa8f9d9f None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:30.336955 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4d4a7-222d-4806-aa28-a86245ac0487 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:30.337062 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-ef76c79d-d2d9-4848-9ffb-cd9efa8f9d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:30.344914 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1015/2044] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:21:30.352532 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1b97f-dac0-4463-94e5-4cbaf0b1fdfe None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:30.352893 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1b97f-dac0-4463-94e5-4cbaf0b1fdfe None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:30.359941 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1b97f-dac0-4463-94e5-4cbaf0b1fdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:30.371841 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-34d1b97f-dac0-4463-94e5-4cbaf0b1fdfe None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:30.373031 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-34d1b97f-dac0-4463-94e5-4cbaf0b1fdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:30.382888 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1016/2045] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:21:30.385107 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1b97f-dac0-4463-94e5-4cbaf0b1fdfe None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:30.395122 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1b97f-dac0-4463-94e5-4cbaf0b1fdfe None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:30.399877 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f5d47-d6d3-4fa8-8cea-410c6badc5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:30.400535 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f5d47-d6d3-4fa8-8cea-410c6badc5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:30.400822 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f5d47-d6d3-4fa8-8cea-410c6badc5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:30.401104 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f5d47-d6d3-4fa8-8cea-410c6badc5c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:30.401870 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f5d47-d6d3-4fa8-8cea-410c6badc5c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:21:30.402184 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f5d47-d6d3-4fa8-8cea-410c6badc5c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:30.403760 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f5d47-d6d3-4fa8-8cea-410c6badc5c0 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:30.417461 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1017/2046] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:21:30.420793 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f5d47-d6d3-4fa8-8cea-410c6badc5c0 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:30.430932 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f5d47-d6d3-4fa8-8cea-410c6badc5c0 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:30.435685 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9def8-4df2-48ec-9437-790d9d873547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:30.436409 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9def8-4df2-48ec-9437-790d9d873547 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:30.440654 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9def8-4df2-48ec-9437-790d9d873547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:30.440654 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9def8-4df2-48ec-9437-790d9d873547 admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:30.440654 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9def8-4df2-48ec-9437-790d9d873547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:30.440654 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9def8-4df2-48ec-9437-790d9d873547 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:30.441054 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1030/2047] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:30 2022] PUT /identity/v3/projects/fb9ff164b31942c8a8ce43b9e74aabb7/users/37a6600757c4480cab5efa197a9a0821/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:30.452675 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161c3f8-acb7-477b-902a-7f01fd0d5f30 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:30.453002 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161c3f8-acb7-477b-902a-7f01fd0d5f30 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:30.453285 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161c3f8-acb7-477b-902a-7f01fd0d5f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:30.480232 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-0161c3f8-acb7-477b-902a-7f01fd0d5f30 None None] MFA Rules not processed for user `37a6600757c4480cab5efa197a9a0821`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:30.481549 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-0161c3f8-acb7-477b-902a-7f01fd0d5f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:30.557128 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1018/2048] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:30 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:21:30.561079 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9def8-4df2-48ec-9437-790d9d873547 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:30.576367 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1031/2049] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:21:30.578343 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161c3f8-acb7-477b-902a-7f01fd0d5f30 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:30.580858 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-0161c3f8-acb7-477b-902a-7f01fd0d5f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:30.630458 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9def8-4df2-48ec-9437-790d9d873547 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:30.635345 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e183f3-5e7a-4ed9-966e-1553d7af93cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:30.636117 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e183f3-5e7a-4ed9-966e-1553d7af93cc admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:30.636465 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e183f3-5e7a-4ed9-966e-1553d7af93cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:30.637411 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e183f3-5e7a-4ed9-966e-1553d7af93cc admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:30.637699 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e183f3-5e7a-4ed9-966e-1553d7af93cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:30.640300 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e183f3-5e7a-4ed9-966e-1553d7af93cc admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:30.664755 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161c3f8-acb7-477b-902a-7f01fd0d5f30 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:30.669419 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93f015-78b9-4634-aca8-25b23534cf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:30.670079 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93f015-78b9-4634-aca8-25b23534cf96 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:30.670366 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93f015-78b9-4634-aca8-25b23534cf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:30.670646 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93f015-78b9-4634-aca8-25b23534cf96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:30.671973 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93f015-78b9-4634-aca8-25b23534cf96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:30.673931 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93f015-78b9-4634-aca8-25b23534cf96 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:30.714331 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1019/2050] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:30 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:30.718968 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e183f3-5e7a-4ed9-966e-1553d7af93cc admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:30.728349 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e183f3-5e7a-4ed9-966e-1553d7af93cc admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:30.733097 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76fb6c-18fc-4ece-b140-7a00ad3b63f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:30.734663 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76fb6c-18fc-4ece-b140-7a00ad3b63f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:30.734966 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76fb6c-18fc-4ece-b140-7a00ad3b63f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:30.735250 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76fb6c-18fc-4ece-b140-7a00ad3b63f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:30.736111 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76fb6c-18fc-4ece-b140-7a00ad3b63f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:30.738564 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76fb6c-18fc-4ece-b140-7a00ad3b63f2 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:30.746592 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1032/2051] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:30 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:21:30.750783 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93f015-78b9-4634-aca8-25b23534cf96 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:30.752003 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1020/2052] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:21:30.755906 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76fb6c-18fc-4ece-b140-7a00ad3b63f2 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:30.773518 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76fb6c-18fc-4ece-b140-7a00ad3b63f2 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:30.826030 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93f015-78b9-4634-aca8-25b23534cf96 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:30.831494 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b50283-a2b3-4b3f-a808-35294da87538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:30.832178 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b50283-a2b3-4b3f-a808-35294da87538 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:30.832468 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b50283-a2b3-4b3f-a808-35294da87538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:30.832748 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b50283-a2b3-4b3f-a808-35294da87538 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:30.833796 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b50283-a2b3-4b3f-a808-35294da87538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:30.835746 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b50283-a2b3-4b3f-a808-35294da87538 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:30.836260 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0dd96-d4f7-432e-abae-199b08723850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:30.836988 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0dd96-d4f7-432e-abae-199b08723850 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:30.837241 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0dd96-d4f7-432e-abae-199b08723850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:30.837960 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0dd96-d4f7-432e-abae-199b08723850 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:30.838320 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0dd96-d4f7-432e-abae-199b08723850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:30.840077 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0dd96-d4f7-432e-abae-199b08723850 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:30.851743 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1021/2053] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:21:30.855797 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0dd96-d4f7-432e-abae-199b08723850 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:30.866504 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0dd96-d4f7-432e-abae-199b08723850 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:30.871541 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6c02b-0c43-4c6e-b1db-89c1fc14aff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:30.872398 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6c02b-0c43-4c6e-b1db-89c1fc14aff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:30.872686 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6c02b-0c43-4c6e-b1db-89c1fc14aff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:30.873058 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6c02b-0c43-4c6e-b1db-89c1fc14aff9 admin admin] PATH_INFO: `/v3/projects/64ab5a95cd334437bce4c3095064e0aa/users/7fb235ed3ac745e786ce1035492c3883/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:30.888663 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6c02b-0c43-4c6e-b1db-89c1fc14aff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ab5a95cd334437bce4c3095064e0aa, user_id=7fb235ed3ac745e786ce1035492c3883, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:30.891480 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6c02b-0c43-4c6e-b1db-89c1fc14aff9 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:30.923250 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1033/2054] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:30 2022] POST /identity/v3/users => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:21:30.927233 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b50283-a2b3-4b3f-a808-35294da87538 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:30.939371 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b50283-a2b3-4b3f-a808-35294da87538 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:30.943378 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5c52c-3455-4d93-b2dd-69972a4de95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:30.944051 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5c52c-3455-4d93-b2dd-69972a4de95b admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:30.944342 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5c52c-3455-4d93-b2dd-69972a4de95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:30.944842 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5c52c-3455-4d93-b2dd-69972a4de95b admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:30.945819 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5c52c-3455-4d93-b2dd-69972a4de95b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:30.947564 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5c52c-3455-4d93-b2dd-69972a4de95b admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:30.957499 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1022/2055] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:30 2022] PUT /identity/v3/projects/64ab5a95cd334437bce4c3095064e0aa/users/7fb235ed3ac745e786ce1035492c3883/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:30.961331 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1034/2056] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:30.968993 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6c02b-0c43-4c6e-b1db-89c1fc14aff9 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:30.970143 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a4c14-bcec-4108-be24-e5605fcf1312 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:30.970449 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a4c14-bcec-4108-be24-e5605fcf1312 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:30.970738 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a4c14-bcec-4108-be24-e5605fcf1312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:31.003199 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-679a4c14-bcec-4108-be24-e5605fcf1312 None None] MFA Rules not processed for user `7fb235ed3ac745e786ce1035492c3883`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:31.004442 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-679a4c14-bcec-4108-be24-e5605fcf1312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:31.040449 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6c02b-0c43-4c6e-b1db-89c1fc14aff9 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:31.045649 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed874ae-bd7f-4c5d-ab64-cea589d5d8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:31.046718 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed874ae-bd7f-4c5d-ab64-cea589d5d8f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:31.047061 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed874ae-bd7f-4c5d-ab64-cea589d5d8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:31.047288 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed874ae-bd7f-4c5d-ab64-cea589d5d8f4 admin admin] PATH_INFO: `/v3/projects/d6015b8ef9d44897815b9216ad8e24fb/users/7883aa3229004fc582025e57119af7d4/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:31.064211 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed874ae-bd7f-4c5d-ab64-cea589d5d8f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6015b8ef9d44897815b9216ad8e24fb, user_id=7883aa3229004fc582025e57119af7d4, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:31.067100 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed874ae-bd7f-4c5d-ab64-cea589d5d8f4 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:31.070740 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1035/2057] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:31.082026 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a4c14-bcec-4108-be24-e5605fcf1312 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:31.083386 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-679a4c14-bcec-4108-be24-e5605fcf1312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:31.132673 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1023/2058] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:30 2022] PUT /identity/v3/projects/d6015b8ef9d44897815b9216ad8e24fb/users/7883aa3229004fc582025e57119af7d4/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:31.136738 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed874ae-bd7f-4c5d-ab64-cea589d5d8f4 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:31.149110 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a4c14-bcec-4108-be24-e5605fcf1312 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:31.202953 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee33149-5fe2-4d55-9534-e9e04280f396 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b169395c92c4fbfbbe4fd14a235f81f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:31.203332 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed874ae-bd7f-4c5d-ab64-cea589d5d8f4 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:31.203904 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee33149-5fe2-4d55-9534-e9e04280f396 service glance] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:31.204712 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee33149-5fe2-4d55-9534-e9e04280f396 service glance] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:31.205071 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee33149-5fe2-4d55-9534-e9e04280f396 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:31.208983 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92f682-be85-4dcf-8c3c-c4e3c87e1396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:31.209786 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92f682-be85-4dcf-8c3c-c4e3c87e1396 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:31.210154 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92f682-be85-4dcf-8c3c-c4e3c87e1396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:31.210564 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92f682-be85-4dcf-8c3c-c4e3c87e1396 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:31.211413 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92f682-be85-4dcf-8c3c-c4e3c87e1396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:31.213163 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92f682-be85-4dcf-8c3c-c4e3c87e1396 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:31.229006 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1024/2059] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:21:31.230207 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92f682-be85-4dcf-8c3c-c4e3c87e1396 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:31.242279 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92f682-be85-4dcf-8c3c-c4e3c87e1396 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:31.247314 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a5fa0-52ad-4a32-b7fd-1ddb02051ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:31.248209 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a5fa0-52ad-4a32-b7fd-1ddb02051ba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:31.248478 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a5fa0-52ad-4a32-b7fd-1ddb02051ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:31.248781 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a5fa0-52ad-4a32-b7fd-1ddb02051ba7 admin admin] PATH_INFO: `/v3/projects/d6015b8ef9d44897815b9216ad8e24fb/users/7883aa3229004fc582025e57119af7d4/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:31.251808 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a5fa0-52ad-4a32-b7fd-1ddb02051ba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6015b8ef9d44897815b9216ad8e24fb, user_id=7883aa3229004fc582025e57119af7d4, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:31.258160 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a5fa0-52ad-4a32-b7fd-1ddb02051ba7 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:31.266500 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1025/2060] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:31 2022] PUT /identity/v3/projects/d6015b8ef9d44897815b9216ad8e24fb/users/7883aa3229004fc582025e57119af7d4/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:31.277715 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecd8cb-e7e5-45d0-a019-5f1c22eb809c None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:31.278084 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecd8cb-e7e5-45d0-a019-5f1c22eb809c None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:31.278376 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecd8cb-e7e5-45d0-a019-5f1c22eb809c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:31.283705 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee33149-5fe2-4d55-9534-e9e04280f396 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:31.285381 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee33149-5fe2-4d55-9534-e9e04280f396 service glance] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:31.295588 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1036/2061] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:21:31.311154 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-5fecd8cb-e7e5-45d0-a019-5f1c22eb809c None None] MFA Rules not processed for user `7883aa3229004fc582025e57119af7d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:31.313429 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-5fecd8cb-e7e5-45d0-a019-5f1c22eb809c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:31.400251 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1026/2062] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:31.429662 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee33149-5fe2-4d55-9534-e9e04280f396 service glance] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:31.429662 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-8ee33149-5fe2-4d55-9534-e9e04280f396 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:31.486258 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee33149-5fe2-4d55-9534-e9e04280f396 service glance] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:31.539578 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a073c-52e3-4618-bd36-ae36e07b2049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:31.540258 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a073c-52e3-4618-bd36-ae36e07b2049 service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:31.540530 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a073c-52e3-4618-bd36-ae36e07b2049 service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:31.540830 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a073c-52e3-4618-bd36-ae36e07b2049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:31.542943 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-fd2a073c-52e3-4618-bd36-ae36e07b2049 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:31.601986 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a073c-52e3-4618-bd36-ae36e07b2049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:31.603420 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a073c-52e3-4618-bd36-ae36e07b2049 service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:31.612893 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1037/2063] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:21:35.725553 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecd8cb-e7e5-45d0-a019-5f1c22eb809c None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:35.727054 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-5fecd8cb-e7e5-45d0-a019-5f1c22eb809c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:35.746047 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecd8cb-e7e5-45d0-a019-5f1c22eb809c None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:35.751163 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c168dc-1094-4761-b7b7-413e53d481c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:35.751937 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c168dc-1094-4761-b7b7-413e53d481c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:35.752310 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c168dc-1094-4761-b7b7-413e53d481c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:35.752676 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c168dc-1094-4761-b7b7-413e53d481c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:35.809964 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c168dc-1094-4761-b7b7-413e53d481c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:35.812224 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c168dc-1094-4761-b7b7-413e53d481c5 service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:35.821462 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1027/2064] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:21:35.849939 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a073c-52e3-4618-bd36-ae36e07b2049 service cinder] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:35.852436 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-fd2a073c-52e3-4618-bd36-ae36e07b2049 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:35.934706 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a073c-52e3-4618-bd36-ae36e07b2049 service cinder] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:35.939758 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d719ad-47bb-43b3-8710-d861b9f11358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:35.940611 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d719ad-47bb-43b3-8710-d861b9f11358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:35.941247 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d719ad-47bb-43b3-8710-d861b9f11358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:35.941247 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d719ad-47bb-43b3-8710-d861b9f11358 admin admin] PATH_INFO: `/v3/users/e9b1953683564ef8bd80ff638b4e3b9a` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:35.942460 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d719ad-47bb-43b3-8710-d861b9f11358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9b1953683564ef8bd80ff638b4e3b9a)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:35.944419 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d719ad-47bb-43b3-8710-d861b9f11358 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:36.122630 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-22d719ad-47bb-43b3-8710-d861b9f11358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9b1953683564ef8bd80ff638b4e3b9a'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:36.177046 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-22d719ad-47bb-43b3-8710-d861b9f11358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9b1953683564ef8bd80ff638b4e3b9a'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:36.177821 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-22d719ad-47bb-43b3-8710-d861b9f11358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9b1953683564ef8bd80ff638b4e3b9a'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:36.178614 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-22d719ad-47bb-43b3-8710-d861b9f11358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9b1953683564ef8bd80ff638b4e3b9a'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:36.188750 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-22d719ad-47bb-43b3-8710-d861b9f11358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9b1953683564ef8bd80ff638b4e3b9a'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:36.210181 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1038/2065] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:35 2022] DELETE /identity/v3/users/e9b1953683564ef8bd80ff638b4e3b9a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:36.214649 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecb3fe-4f2a-4038-a66d-d4b5ef6bd1b5 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:36.214944 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecb3fe-4f2a-4038-a66d-d4b5ef6bd1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:36.215225 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecb3fe-4f2a-4038-a66d-d4b5ef6bd1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:36.232444 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-0aecb3fe-4f2a-4038-a66d-d4b5ef6bd1b5 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:36.234273 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-0aecb3fe-4f2a-4038-a66d-d4b5ef6bd1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:36.309282 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1028/2066] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:36.319888 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d719ad-47bb-43b3-8710-d861b9f11358 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:36.321677 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-22d719ad-47bb-43b3-8710-d861b9f11358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:36.381898 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d719ad-47bb-43b3-8710-d861b9f11358 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:36.385747 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1ee35-634d-4476-8dad-8bb84bb33f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:36.386417 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1ee35-634d-4476-8dad-8bb84bb33f58 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:36.386703 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1ee35-634d-4476-8dad-8bb84bb33f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:36.387131 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1ee35-634d-4476-8dad-8bb84bb33f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:36.397213 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1ee35-634d-4476-8dad-8bb84bb33f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:36.398738 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1ee35-634d-4476-8dad-8bb84bb33f58 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:36.413420 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1039/2067] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:21:36.785234 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecb3fe-4f2a-4038-a66d-d4b5ef6bd1b5 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:36.786814 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-0aecb3fe-4f2a-4038-a66d-d4b5ef6bd1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:36.799955 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecb3fe-4f2a-4038-a66d-d4b5ef6bd1b5 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:36.805070 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4166a-f60b-4652-b9bd-88f6affd3147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:36.806303 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4166a-f60b-4652-b9bd-88f6affd3147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:36.806816 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4166a-f60b-4652-b9bd-88f6affd3147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:36.807400 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4166a-f60b-4652-b9bd-88f6affd3147 admin admin] PATH_INFO: `/v3/projects/07b47d6ec8974ed189fd838adf30badf` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:36.809048 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4166a-f60b-4652-b9bd-88f6affd3147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07b47d6ec8974ed189fd838adf30badf)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:36.812364 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4166a-f60b-4652-b9bd-88f6affd3147 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:36.958164 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8cf4166a-f60b-4652-b9bd-88f6affd3147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07b47d6ec8974ed189fd838adf30badf', 'request_id': 'req-8cf4166a-f60b-4652-b9bd-88f6affd3147'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:37.064133 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8cf4166a-f60b-4652-b9bd-88f6affd3147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07b47d6ec8974ed189fd838adf30badf', 'request_id': 'req-8cf4166a-f60b-4652-b9bd-88f6affd3147'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:37.071020 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8cf4166a-f60b-4652-b9bd-88f6affd3147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07b47d6ec8974ed189fd838adf30badf', 'request_id': 'req-8cf4166a-f60b-4652-b9bd-88f6affd3147'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:37.091360 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8cf4166a-f60b-4652-b9bd-88f6affd3147 admin admin] The token cache is being invalidate because project 07b47d6ec8974ed189fd838adf30badf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:37.097745 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8cf4166a-f60b-4652-b9bd-88f6affd3147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:37.098990 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8cf4166a-f60b-4652-b9bd-88f6affd3147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:37.101740 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1029/2068] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:36 2022] DELETE /identity/v3/projects/07b47d6ec8974ed189fd838adf30badf => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:37.105663 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1ee35-634d-4476-8dad-8bb84bb33f58 service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:37.121159 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1ee35-634d-4476-8dad-8bb84bb33f58 service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:37.205455 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42489f42-a333-4ea7-b463-5e499c3634e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:37.206636 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42489f42-a333-4ea7-b463-5e499c3634e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:37.206935 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42489f42-a333-4ea7-b463-5e499c3634e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:37.207221 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42489f42-a333-4ea7-b463-5e499c3634e9 admin admin] PATH_INFO: `/v3/users/647c4aa44db541e488d5840b2b411204` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:37.210799 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42489f42-a333-4ea7-b463-5e499c3634e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=647c4aa44db541e488d5840b2b411204)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:37.213174 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42489f42-a333-4ea7-b463-5e499c3634e9 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:37.337844 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4166a-f60b-4652-b9bd-88f6affd3147 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:37.339287 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-8cf4166a-f60b-4652-b9bd-88f6affd3147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:37.413701 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4166a-f60b-4652-b9bd-88f6affd3147 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:37.415385 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-42489f42-a333-4ea7-b463-5e499c3634e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '647c4aa44db541e488d5840b2b411204'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:37.417924 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942fec8-74e5-491b-ba58-d21d8e3d6c18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:37.418949 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942fec8-74e5-491b-ba58-d21d8e3d6c18 service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:37.419246 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942fec8-74e5-491b-ba58-d21d8e3d6c18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:37.419529 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942fec8-74e5-491b-ba58-d21d8e3d6c18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:37.430107 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-7942fec8-74e5-491b-ba58-d21d8e3d6c18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:37.498263 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-42489f42-a333-4ea7-b463-5e499c3634e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '647c4aa44db541e488d5840b2b411204'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:37.504797 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-42489f42-a333-4ea7-b463-5e499c3634e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '647c4aa44db541e488d5840b2b411204'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:37.504797 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-42489f42-a333-4ea7-b463-5e499c3634e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '647c4aa44db541e488d5840b2b411204'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:37.515660 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-42489f42-a333-4ea7-b463-5e499c3634e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '647c4aa44db541e488d5840b2b411204'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:37.517017 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942fec8-74e5-491b-ba58-d21d8e3d6c18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:37.518517 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942fec8-74e5-491b-ba58-d21d8e3d6c18 service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:37.528458 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1030/2069] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:21:37.533550 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1040/2070] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:37 2022] DELETE /identity/v3/users/647c4aa44db541e488d5840b2b411204 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:37.979539 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942fec8-74e5-491b-ba58-d21d8e3d6c18 service cinder] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:37.984251 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-7942fec8-74e5-491b-ba58-d21d8e3d6c18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:38.007799 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942fec8-74e5-491b-ba58-d21d8e3d6c18 service cinder] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:38.064432 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69353526-9590-49f1-952a-cfa0a74731a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:38.065319 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69353526-9590-49f1-952a-cfa0a74731a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:38.065616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69353526-9590-49f1-952a-cfa0a74731a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:38.065899 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69353526-9590-49f1-952a-cfa0a74731a6 admin admin] PATH_INFO: `/v3/projects/41ee23ff52d247698d1ccc4b6fc53692` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:38.067114 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69353526-9590-49f1-952a-cfa0a74731a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41ee23ff52d247698d1ccc4b6fc53692)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:38.069135 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69353526-9590-49f1-952a-cfa0a74731a6 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:38.178606 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-69353526-9590-49f1-952a-cfa0a74731a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41ee23ff52d247698d1ccc4b6fc53692', 'request_id': 'req-69353526-9590-49f1-952a-cfa0a74731a6'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:38.268479 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-69353526-9590-49f1-952a-cfa0a74731a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41ee23ff52d247698d1ccc4b6fc53692', 'request_id': 'req-69353526-9590-49f1-952a-cfa0a74731a6'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:38.274308 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-69353526-9590-49f1-952a-cfa0a74731a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41ee23ff52d247698d1ccc4b6fc53692', 'request_id': 'req-69353526-9590-49f1-952a-cfa0a74731a6'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:38.286208 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-69353526-9590-49f1-952a-cfa0a74731a6 admin admin] The token cache is being invalidate because project 41ee23ff52d247698d1ccc4b6fc53692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:38.286499 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-69353526-9590-49f1-952a-cfa0a74731a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:38.287283 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-69353526-9590-49f1-952a-cfa0a74731a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:38.289270 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1031/2071] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:37 2022] DELETE /identity/v3/projects/41ee23ff52d247698d1ccc4b6fc53692 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:38.294664 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bda37d-cdd4-46ff-84b1-9580866105cc None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:38.295276 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bda37d-cdd4-46ff-84b1-9580866105cc None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:38.296054 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bda37d-cdd4-46ff-84b1-9580866105cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:38.316349 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-71bda37d-cdd4-46ff-84b1-9580866105cc None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:38.317732 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-71bda37d-cdd4-46ff-84b1-9580866105cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:38.380689 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1041/2072] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:38.388547 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a18f35-91e2-4aac-9f28-f34775edf099 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:38.388929 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a18f35-91e2-4aac-9f28-f34775edf099 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:38.389213 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a18f35-91e2-4aac-9f28-f34775edf099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:38.409341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-82a18f35-91e2-4aac-9f28-f34775edf099 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:38.410547 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-82a18f35-91e2-4aac-9f28-f34775edf099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:38.418793 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1032/2073] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:21:38.423849 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bda37d-cdd4-46ff-84b1-9580866105cc None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:38.442758 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bda37d-cdd4-46ff-84b1-9580866105cc None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:38.443267 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244395e2-c2d2-4d06-ae6c-d25087fcbb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:38.443942 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244395e2-c2d2-4d06-ae6c-d25087fcbb17 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:38.444222 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244395e2-c2d2-4d06-ae6c-d25087fcbb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:38.444504 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244395e2-c2d2-4d06-ae6c-d25087fcbb17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:38.445232 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244395e2-c2d2-4d06-ae6c-d25087fcbb17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:21:38.445583 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244395e2-c2d2-4d06-ae6c-d25087fcbb17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:38.447183 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244395e2-c2d2-4d06-ae6c-d25087fcbb17 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:38.464770 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1042/2074] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:21:38.466447 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a18f35-91e2-4aac-9f28-f34775edf099 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:38.478125 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a18f35-91e2-4aac-9f28-f34775edf099 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:38.483019 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda60a0-138b-4c4e-96d6-7884cddcacc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:38.483784 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda60a0-138b-4c4e-96d6-7884cddcacc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:38.484191 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda60a0-138b-4c4e-96d6-7884cddcacc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:38.484478 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda60a0-138b-4c4e-96d6-7884cddcacc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:38.485173 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda60a0-138b-4c4e-96d6-7884cddcacc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:38.487212 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda60a0-138b-4c4e-96d6-7884cddcacc7 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:38.581326 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1033/2075] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:38 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:21:38.584326 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244395e2-c2d2-4d06-ae6c-d25087fcbb17 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:38.595774 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244395e2-c2d2-4d06-ae6c-d25087fcbb17 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:38.653094 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e4f19-924e-46f4-b284-3b2163d823cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:38.654116 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e4f19-924e-46f4-b284-3b2163d823cc admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:38.654404 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e4f19-924e-46f4-b284-3b2163d823cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:38.655446 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e4f19-924e-46f4-b284-3b2163d823cc admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:38.656210 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e4f19-924e-46f4-b284-3b2163d823cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:38.658570 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e4f19-924e-46f4-b284-3b2163d823cc admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:38.734903 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1043/2076] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:38 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:21:38.738846 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda60a0-138b-4c4e-96d6-7884cddcacc7 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:38.751627 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda60a0-138b-4c4e-96d6-7884cddcacc7 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:38.756606 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c52d3-c666-45eb-a276-542b70e31027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:38.757505 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c52d3-c666-45eb-a276-542b70e31027 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:38.758534 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c52d3-c666-45eb-a276-542b70e31027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:38.758534 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c52d3-c666-45eb-a276-542b70e31027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:38.759063 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c52d3-c666-45eb-a276-542b70e31027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:38.760855 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c52d3-c666-45eb-a276-542b70e31027 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:38.774285 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1034/2077] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:38.777852 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e4f19-924e-46f4-b284-3b2163d823cc admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:38.794175 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e4f19-924e-46f4-b284-3b2163d823cc admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:38.798203 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b50b10-a279-423e-b0c3-e66615cb2933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:38.805136 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b50b10-a279-423e-b0c3-e66615cb2933 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:38.805136 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b50b10-a279-423e-b0c3-e66615cb2933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:38.805136 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b50b10-a279-423e-b0c3-e66615cb2933 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:38.805136 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b50b10-a279-423e-b0c3-e66615cb2933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:38.807689 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b50b10-a279-423e-b0c3-e66615cb2933 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:38.819916 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1044/2078] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:38.823899 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c52d3-c666-45eb-a276-542b70e31027 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:38.835914 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c52d3-c666-45eb-a276-542b70e31027 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:38.841919 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16a053-a108-4384-946b-b27d491eb7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:38.843403 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16a053-a108-4384-946b-b27d491eb7fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:38.847411 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16a053-a108-4384-946b-b27d491eb7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:38.847411 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16a053-a108-4384-946b-b27d491eb7fd admin admin] PATH_INFO: `/v3/projects/c5201bb0cc75420e8fd9b8af2c5840ad/users/536e1772be514dafb6a96aa344f8f1bb/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:38.870233 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16a053-a108-4384-946b-b27d491eb7fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5201bb0cc75420e8fd9b8af2c5840ad, user_id=536e1772be514dafb6a96aa344f8f1bb, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:38.870233 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16a053-a108-4384-946b-b27d491eb7fd admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:38.966531 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1035/2079] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:38 2022] PUT /identity/v3/projects/c5201bb0cc75420e8fd9b8af2c5840ad/users/536e1772be514dafb6a96aa344f8f1bb/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:38.972100 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60c8b1-b943-4ad0-a658-758a30376750 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:38.972396 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60c8b1-b943-4ad0-a658-758a30376750 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:38.972684 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60c8b1-b943-4ad0-a658-758a30376750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:38.992833 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-dc60c8b1-b943-4ad0-a658-758a30376750 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:38.994079 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-dc60c8b1-b943-4ad0-a658-758a30376750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:39.053150 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1045/2080] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:21:39.064402 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16a053-a108-4384-946b-b27d491eb7fd admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:39.066221 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-7d16a053-a108-4384-946b-b27d491eb7fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:39.123074 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16a053-a108-4384-946b-b27d491eb7fd admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:39.127714 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06aad4-8ff0-496a-a5f6-b75a0e652379 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:39.130575 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06aad4-8ff0-496a-a5f6-b75a0e652379 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:39.130575 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06aad4-8ff0-496a-a5f6-b75a0e652379 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:39.130575 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06aad4-8ff0-496a-a5f6-b75a0e652379 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:39.141072 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06aad4-8ff0-496a-a5f6-b75a0e652379 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:39.142563 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06aad4-8ff0-496a-a5f6-b75a0e652379 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:39.152745 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1036/2081] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:21:39.834884 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60c8b1-b943-4ad0-a658-758a30376750 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:39.836598 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-dc60c8b1-b943-4ad0-a658-758a30376750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:39.861009 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60c8b1-b943-4ad0-a658-758a30376750 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:39.892403 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6229a923-0bfe-4f5e-a58d-9c29d636a38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:39.893426 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229a923-0bfe-4f5e-a58d-9c29d636a38f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:39.893720 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229a923-0bfe-4f5e-a58d-9c29d636a38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:39.894006 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229a923-0bfe-4f5e-a58d-9c29d636a38f admin admin] PATH_INFO: `/v3/users/7efc4dc80777436894ac3fcfbe071157` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:39.896505 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6229a923-0bfe-4f5e-a58d-9c29d636a38f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7efc4dc80777436894ac3fcfbe071157)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:39.898889 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6229a923-0bfe-4f5e-a58d-9c29d636a38f admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:40.080006 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6229a923-0bfe-4f5e-a58d-9c29d636a38f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7efc4dc80777436894ac3fcfbe071157'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:40.172166 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6229a923-0bfe-4f5e-a58d-9c29d636a38f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7efc4dc80777436894ac3fcfbe071157'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:40.173117 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6229a923-0bfe-4f5e-a58d-9c29d636a38f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7efc4dc80777436894ac3fcfbe071157'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:40.173620 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6229a923-0bfe-4f5e-a58d-9c29d636a38f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7efc4dc80777436894ac3fcfbe071157'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:40.181196 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6229a923-0bfe-4f5e-a58d-9c29d636a38f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7efc4dc80777436894ac3fcfbe071157'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:40.200503 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1046/2082] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:39 2022] DELETE /identity/v3/users/7efc4dc80777436894ac3fcfbe071157 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:40.205394 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae840fbb-8839-4413-b66d-88d20611ab2c None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:40.205896 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae840fbb-8839-4413-b66d-88d20611ab2c None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:40.205976 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae840fbb-8839-4413-b66d-88d20611ab2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:40.223296 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-ae840fbb-8839-4413-b66d-88d20611ab2c None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:40.224499 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-ae840fbb-8839-4413-b66d-88d20611ab2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:40.283443 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1037/2083] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:40.292872 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6229a923-0bfe-4f5e-a58d-9c29d636a38f admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:40.294306 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-6229a923-0bfe-4f5e-a58d-9c29d636a38f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:40.365981 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6229a923-0bfe-4f5e-a58d-9c29d636a38f admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:40.369810 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaea2a8-8cab-4a7b-b449-8473dabaa9f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:40.370461 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaea2a8-8cab-4a7b-b449-8473dabaa9f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:40.370752 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaea2a8-8cab-4a7b-b449-8473dabaa9f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:40.371033 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaea2a8-8cab-4a7b-b449-8473dabaa9f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:40.380698 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaea2a8-8cab-4a7b-b449-8473dabaa9f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:40.382195 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaea2a8-8cab-4a7b-b449-8473dabaa9f8 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:40.393241 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1047/2084] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:21:40.517747 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b50ab0-48ac-48ef-9ffc-3dcc1062f43b None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:40.518162 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b50ab0-48ac-48ef-9ffc-3dcc1062f43b None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:40.518405 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b50ab0-48ac-48ef-9ffc-3dcc1062f43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:40.545051 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-55b50ab0-48ac-48ef-9ffc-3dcc1062f43b None None] MFA Rules not processed for user `536e1772be514dafb6a96aa344f8f1bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:40.546368 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-55b50ab0-48ac-48ef-9ffc-3dcc1062f43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:40.676027 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1038/2085] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:40.683682 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaea2a8-8cab-4a7b-b449-8473dabaa9f8 service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:40.685281 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-5aaea2a8-8cab-4a7b-b449-8473dabaa9f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:40.701696 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaea2a8-8cab-4a7b-b449-8473dabaa9f8 service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:40.707376 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ac2c4-8839-4535-9d6d-c6643dd9137f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:40.708043 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ac2c4-8839-4535-9d6d-c6643dd9137f admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:40.708325 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ac2c4-8839-4535-9d6d-c6643dd9137f admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:40.708635 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ac2c4-8839-4535-9d6d-c6643dd9137f admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:40.709619 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ac2c4-8839-4535-9d6d-c6643dd9137f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:40.711527 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ac2c4-8839-4535-9d6d-c6643dd9137f admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:40.779664 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1048/2086] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:40 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:40.784157 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b50ab0-48ac-48ef-9ffc-3dcc1062f43b None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:40.798690 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b50ab0-48ac-48ef-9ffc-3dcc1062f43b None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:40.865407 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2672431-be5b-4722-a9cc-f23810c269e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:40.866177 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2672431-be5b-4722-a9cc-f23810c269e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:40.866529 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2672431-be5b-4722-a9cc-f23810c269e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:40.866884 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2672431-be5b-4722-a9cc-f23810c269e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:40.867657 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2672431-be5b-4722-a9cc-f23810c269e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:40.869612 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2672431-be5b-4722-a9cc-f23810c269e3 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:40.879993 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ac2c4-8839-4535-9d6d-c6643dd9137f admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:40.881970 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-2c7ac2c4-8839-4535-9d6d-c6643dd9137f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:40.897710 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ac2c4-8839-4535-9d6d-c6643dd9137f admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:40.903405 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe02fe3-f35e-4c22-a55a-75b982cd8d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:40.904358 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe02fe3-f35e-4c22-a55a-75b982cd8d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:40.904674 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe02fe3-f35e-4c22-a55a-75b982cd8d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:40.905489 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe02fe3-f35e-4c22-a55a-75b982cd8d7e admin admin] PATH_INFO: `/v3/projects/5517914e520f417481d625314e3478b2` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:40.906434 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe02fe3-f35e-4c22-a55a-75b982cd8d7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5517914e520f417481d625314e3478b2)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:40.908720 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe02fe3-f35e-4c22-a55a-75b982cd8d7e admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:40.954975 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1039/2087] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:40 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:40.958966 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2672431-be5b-4722-a9cc-f23810c269e3 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:40.968666 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2672431-be5b-4722-a9cc-f23810c269e3 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:40.973497 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff4d49-e954-4781-b5b9-129fdd7ef716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:40.981693 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff4d49-e954-4781-b5b9-129fdd7ef716 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:40.981693 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff4d49-e954-4781-b5b9-129fdd7ef716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:40.981693 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff4d49-e954-4781-b5b9-129fdd7ef716 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:40.981693 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff4d49-e954-4781-b5b9-129fdd7ef716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:40.981693 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff4d49-e954-4781-b5b9-129fdd7ef716 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:40.987688 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1040/2088] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:21:40.991812 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff4d49-e954-4781-b5b9-129fdd7ef716 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:41.001854 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff4d49-e954-4781-b5b9-129fdd7ef716 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:41.006389 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6680bd8-2f60-490d-aa23-e543f925a1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:41.008891 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6680bd8-2f60-490d-aa23-e543f925a1c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:41.008891 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6680bd8-2f60-490d-aa23-e543f925a1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:41.008891 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6680bd8-2f60-490d-aa23-e543f925a1c0 admin admin] PATH_INFO: `/v3/projects/f1a4b9943a19442f8d660033054c7ae3/users/c8ffbc6b63954f3b863a39f851419ac0/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:41.023693 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6680bd8-2f60-490d-aa23-e543f925a1c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a4b9943a19442f8d660033054c7ae3, user_id=c8ffbc6b63954f3b863a39f851419ac0, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:41.026465 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6680bd8-2f60-490d-aa23-e543f925a1c0 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:41.091806 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1041/2089] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:40 2022] PUT /identity/v3/projects/f1a4b9943a19442f8d660033054c7ae3/users/c8ffbc6b63954f3b863a39f851419ac0/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:41.099261 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6680bd8-2f60-490d-aa23-e543f925a1c0 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:41.100572 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-efe02fe3-f35e-4c22-a55a-75b982cd8d7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5517914e520f417481d625314e3478b2', 'request_id': 'req-efe02fe3-f35e-4c22-a55a-75b982cd8d7e'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:41.105937 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-efe02fe3-f35e-4c22-a55a-75b982cd8d7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5517914e520f417481d625314e3478b2', 'request_id': 'req-efe02fe3-f35e-4c22-a55a-75b982cd8d7e'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:41.113307 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-efe02fe3-f35e-4c22-a55a-75b982cd8d7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5517914e520f417481d625314e3478b2', 'request_id': 'req-efe02fe3-f35e-4c22-a55a-75b982cd8d7e'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:41.182955 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6680bd8-2f60-490d-aa23-e543f925a1c0 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:41.206744 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-efe02fe3-f35e-4c22-a55a-75b982cd8d7e admin admin] The token cache is being invalidate because project 5517914e520f417481d625314e3478b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:41.207152 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-efe02fe3-f35e-4c22-a55a-75b982cd8d7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:41.208130 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-efe02fe3-f35e-4c22-a55a-75b982cd8d7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:41.211708 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1049/2090] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:40 2022] DELETE /identity/v3/projects/5517914e520f417481d625314e3478b2 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:41.215457 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe02fe3-f35e-4c22-a55a-75b982cd8d7e admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:41.216855 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-efe02fe3-f35e-4c22-a55a-75b982cd8d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:41.261671 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4884d-2530-479e-bc0a-d5168682dced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:41.262347 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4884d-2530-479e-bc0a-d5168682dced admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:41.262584 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4884d-2530-479e-bc0a-d5168682dced admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:41.262869 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4884d-2530-479e-bc0a-d5168682dced admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:41.263859 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4884d-2530-479e-bc0a-d5168682dced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:41.266017 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4884d-2530-479e-bc0a-d5168682dced admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:41.276338 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1042/2091] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:21:41.281771 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4884d-2530-479e-bc0a-d5168682dced admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:41.283014 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9cd4884d-2530-479e-bc0a-d5168682dced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:41.294022 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe02fe3-f35e-4c22-a55a-75b982cd8d7e admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:41.295990 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4884d-2530-479e-bc0a-d5168682dced admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:41.299756 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01890c2-14ea-41ac-86b9-d63d8858156f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:41.300638 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01890c2-14ea-41ac-86b9-d63d8858156f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:41.301050 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01890c2-14ea-41ac-86b9-d63d8858156f admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:41.301517 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01890c2-14ea-41ac-86b9-d63d8858156f admin admin] PATH_INFO: `/v3/users/fb752d118e724e06803ae6677c33d57f` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:41.301635 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439fec2-ec72-4b90-a4e0-672633fbd4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:41.302573 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439fec2-ec72-4b90-a4e0-672633fbd4fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:41.302866 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439fec2-ec72-4b90-a4e0-672633fbd4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:41.303141 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439fec2-ec72-4b90-a4e0-672633fbd4fd admin admin] PATH_INFO: `/v3/projects/f1a4b9943a19442f8d660033054c7ae3/users/c8ffbc6b63954f3b863a39f851419ac0/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:41.303536 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01890c2-14ea-41ac-86b9-d63d8858156f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb752d118e724e06803ae6677c33d57f)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:41.305148 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439fec2-ec72-4b90-a4e0-672633fbd4fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a4b9943a19442f8d660033054c7ae3, user_id=c8ffbc6b63954f3b863a39f851419ac0, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:41.305852 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01890c2-14ea-41ac-86b9-d63d8858156f admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:41.307931 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439fec2-ec72-4b90-a4e0-672633fbd4fd admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:41.320419 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1043/2092] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:41 2022] PUT /identity/v3/projects/f1a4b9943a19442f8d660033054c7ae3/users/c8ffbc6b63954f3b863a39f851419ac0/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:41.630390 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-b01890c2-14ea-41ac-86b9-d63d8858156f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb752d118e724e06803ae6677c33d57f'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:41.687655 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-b01890c2-14ea-41ac-86b9-d63d8858156f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb752d118e724e06803ae6677c33d57f'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:41.688289 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-b01890c2-14ea-41ac-86b9-d63d8858156f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb752d118e724e06803ae6677c33d57f'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:41.689106 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-b01890c2-14ea-41ac-86b9-d63d8858156f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb752d118e724e06803ae6677c33d57f'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:41.697825 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-b01890c2-14ea-41ac-86b9-d63d8858156f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb752d118e724e06803ae6677c33d57f'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:41.720826 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1050/2093] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:41 2022] DELETE /identity/v3/users/fb752d118e724e06803ae6677c33d57f => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:42.140287 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439fec2-ec72-4b90-a4e0-672633fbd4fd admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:42.142382 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-6439fec2-ec72-4b90-a4e0-672633fbd4fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:42.253000 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439fec2-ec72-4b90-a4e0-672633fbd4fd admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:42.296739 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01890c2-14ea-41ac-86b9-d63d8858156f admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:42.298433 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b01890c2-14ea-41ac-86b9-d63d8858156f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:42.329077 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590c785-6bec-4973-a456-16d76ad2a586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:42.337889 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590c785-6bec-4973-a456-16d76ad2a586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:42.337889 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590c785-6bec-4973-a456-16d76ad2a586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:42.337889 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590c785-6bec-4973-a456-16d76ad2a586 admin admin] PATH_INFO: `/v3/users/9aab530a2811437a99d54a61d9d53af9` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:42.337889 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590c785-6bec-4973-a456-16d76ad2a586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aab530a2811437a99d54a61d9d53af9)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:42.337889 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590c785-6bec-4973-a456-16d76ad2a586 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:42.387741 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01890c2-14ea-41ac-86b9-d63d8858156f admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:42.393104 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c42b9-4e63-4184-909c-78f2ca9b39d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:42.394051 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c42b9-4e63-4184-909c-78f2ca9b39d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:42.401215 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c42b9-4e63-4184-909c-78f2ca9b39d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:42.401215 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c42b9-4e63-4184-909c-78f2ca9b39d7 admin admin] PATH_INFO: `/v3/users/27ab10fcac174064b6cfc6611bb12025` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:42.401215 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c42b9-4e63-4184-909c-78f2ca9b39d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27ab10fcac174064b6cfc6611bb12025)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:42.401215 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c42b9-4e63-4184-909c-78f2ca9b39d7 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:42.556065 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f590c785-6bec-4973-a456-16d76ad2a586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aab530a2811437a99d54a61d9d53af9'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:42.612912 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fe6c42b9-4e63-4184-909c-78f2ca9b39d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27ab10fcac174064b6cfc6611bb12025'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:42.616924 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f590c785-6bec-4973-a456-16d76ad2a586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aab530a2811437a99d54a61d9d53af9'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:42.617597 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f590c785-6bec-4973-a456-16d76ad2a586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aab530a2811437a99d54a61d9d53af9'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:42.625384 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f590c785-6bec-4973-a456-16d76ad2a586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aab530a2811437a99d54a61d9d53af9'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:42.637434 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f590c785-6bec-4973-a456-16d76ad2a586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aab530a2811437a99d54a61d9d53af9'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:42.643617 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1044/2094] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:42 2022] DELETE /identity/v3/users/9aab530a2811437a99d54a61d9d53af9 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:42.644408 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590c785-6bec-4973-a456-16d76ad2a586 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:42.645786 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-f590c785-6bec-4973-a456-16d76ad2a586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:42.680142 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fe6c42b9-4e63-4184-909c-78f2ca9b39d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27ab10fcac174064b6cfc6611bb12025'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:42.681054 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fe6c42b9-4e63-4184-909c-78f2ca9b39d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27ab10fcac174064b6cfc6611bb12025'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:42.681767 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fe6c42b9-4e63-4184-909c-78f2ca9b39d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27ab10fcac174064b6cfc6611bb12025'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:42.692098 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fe6c42b9-4e63-4184-909c-78f2ca9b39d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27ab10fcac174064b6cfc6611bb12025'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:42.714962 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1051/2095] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:42 2022] DELETE /identity/v3/users/27ab10fcac174064b6cfc6611bb12025 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:42.719421 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590c785-6bec-4973-a456-16d76ad2a586 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:42.721447 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0162a67-d618-4b77-b803-c935dc41cc0a None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:42.722048 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0162a67-d618-4b77-b803-c935dc41cc0a None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:42.722048 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0162a67-d618-4b77-b803-c935dc41cc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:42.744260 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-b0162a67-d618-4b77-b803-c935dc41cc0a None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:42.745629 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b0162a67-d618-4b77-b803-c935dc41cc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:42.825904 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38740d8a-07df-4cc6-9829-94f33879514e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:42.830957 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38740d8a-07df-4cc6-9829-94f33879514e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:42.831268 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38740d8a-07df-4cc6-9829-94f33879514e admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:42.831553 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38740d8a-07df-4cc6-9829-94f33879514e admin admin] PATH_INFO: `/v3/projects/765d322488f348299538ad2e3605f012` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:42.835050 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38740d8a-07df-4cc6-9829-94f33879514e admin admin] RBAC: Authorizing `identity:delete_project(project_id=765d322488f348299538ad2e3605f012)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:42.837139 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38740d8a-07df-4cc6-9829-94f33879514e admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:42.867767 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1052/2096] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:42.869009 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38981346-b7d3-4bae-8874-620a584029f9 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:42.869317 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38981346-b7d3-4bae-8874-620a584029f9 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:42.869612 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38981346-b7d3-4bae-8874-620a584029f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:42.911534 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-38981346-b7d3-4bae-8874-620a584029f9 None None] MFA Rules not processed for user `c8ffbc6b63954f3b863a39f851419ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:42.913956 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-38981346-b7d3-4bae-8874-620a584029f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:42.943694 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-38740d8a-07df-4cc6-9829-94f33879514e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '765d322488f348299538ad2e3605f012', 'request_id': 'req-38740d8a-07df-4cc6-9829-94f33879514e'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:43.000767 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-38740d8a-07df-4cc6-9829-94f33879514e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '765d322488f348299538ad2e3605f012', 'request_id': 'req-38740d8a-07df-4cc6-9829-94f33879514e'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:43.000984 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1053/2097] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:43.005608 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38981346-b7d3-4bae-8874-620a584029f9 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:43.005608 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-38981346-b7d3-4bae-8874-620a584029f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:43.010322 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-38740d8a-07df-4cc6-9829-94f33879514e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '765d322488f348299538ad2e3605f012', 'request_id': 'req-38740d8a-07df-4cc6-9829-94f33879514e'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:43.024257 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-38740d8a-07df-4cc6-9829-94f33879514e admin admin] The token cache is being invalidate because project 765d322488f348299538ad2e3605f012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:43.024707 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-38740d8a-07df-4cc6-9829-94f33879514e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:43.025483 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-38740d8a-07df-4cc6-9829-94f33879514e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:43.027238 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1045/2098] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:42 2022] DELETE /identity/v3/projects/765d322488f348299538ad2e3605f012 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:43.028073 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38740d8a-07df-4cc6-9829-94f33879514e admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:43.029497 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-38740d8a-07df-4cc6-9829-94f33879514e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:43.068388 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38981346-b7d3-4bae-8874-620a584029f9 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:43.072835 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36722b2f-77f0-4251-8b7f-3cf4034a5d31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:43.073510 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36722b2f-77f0-4251-8b7f-3cf4034a5d31 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:43.073794 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36722b2f-77f0-4251-8b7f-3cf4034a5d31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:43.074071 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36722b2f-77f0-4251-8b7f-3cf4034a5d31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:43.075836 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-36722b2f-77f0-4251-8b7f-3cf4034a5d31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:43.100122 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38740d8a-07df-4cc6-9829-94f33879514e admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:43.104866 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5497dd-9df4-4d14-87f9-7e46e93e9db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:43.105774 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5497dd-9df4-4d14-87f9-7e46e93e9db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:43.106064 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5497dd-9df4-4d14-87f9-7e46e93e9db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:43.106343 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5497dd-9df4-4d14-87f9-7e46e93e9db4 admin admin] PATH_INFO: `/v3/projects/331c9c75e5db410a8aab2a0dedf24117` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:43.108061 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5497dd-9df4-4d14-87f9-7e46e93e9db4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=331c9c75e5db410a8aab2a0dedf24117)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:43.110025 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5497dd-9df4-4d14-87f9-7e46e93e9db4 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:43.142629 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36722b2f-77f0-4251-8b7f-3cf4034a5d31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:43.144007 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36722b2f-77f0-4251-8b7f-3cf4034a5d31 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:43.153268 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1054/2099] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:21:43.154060 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36722b2f-77f0-4251-8b7f-3cf4034a5d31 service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:43.155866 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-36722b2f-77f0-4251-8b7f-3cf4034a5d31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:43.223229 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36722b2f-77f0-4251-8b7f-3cf4034a5d31 service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:43.223620 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-ed5497dd-9df4-4d14-87f9-7e46e93e9db4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '331c9c75e5db410a8aab2a0dedf24117', 'request_id': 'req-ed5497dd-9df4-4d14-87f9-7e46e93e9db4'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:43.281013 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709b4b7-0b63-4dd1-b7cf-cd98d31cfce7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:43.281698 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709b4b7-0b63-4dd1-b7cf-cd98d31cfce7 service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:43.281981 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709b4b7-0b63-4dd1-b7cf-cd98d31cfce7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:43.282265 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709b4b7-0b63-4dd1-b7cf-cd98d31cfce7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:43.284160 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b709b4b7-0b63-4dd1-b7cf-cd98d31cfce7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:43.298500 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-ed5497dd-9df4-4d14-87f9-7e46e93e9db4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '331c9c75e5db410a8aab2a0dedf24117', 'request_id': 'req-ed5497dd-9df4-4d14-87f9-7e46e93e9db4'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:43.304764 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-ed5497dd-9df4-4d14-87f9-7e46e93e9db4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '331c9c75e5db410a8aab2a0dedf24117', 'request_id': 'req-ed5497dd-9df4-4d14-87f9-7e46e93e9db4'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:43.318818 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-ed5497dd-9df4-4d14-87f9-7e46e93e9db4 admin admin] The token cache is being invalidate because project 331c9c75e5db410a8aab2a0dedf24117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:43.319178 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-ed5497dd-9df4-4d14-87f9-7e46e93e9db4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:43.319789 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-ed5497dd-9df4-4d14-87f9-7e46e93e9db4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:43.324842 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1046/2100] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:43 2022] DELETE /identity/v3/projects/331c9c75e5db410a8aab2a0dedf24117 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:43.324842 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cfc05-6c6c-4c29-b4ac-0ae267c334e9 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:43.324842 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cfc05-6c6c-4c29-b4ac-0ae267c334e9 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:43.324842 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cfc05-6c6c-4c29-b4ac-0ae267c334e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:43.349203 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709b4b7-0b63-4dd1-b7cf-cd98d31cfce7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:43.351352 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709b4b7-0b63-4dd1-b7cf-cd98d31cfce7 service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:43.352988 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-686cfc05-6c6c-4c29-b4ac-0ae267c334e9 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:43.354234 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-686cfc05-6c6c-4c29-b4ac-0ae267c334e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:43.361788 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1055/2101] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:21:43.363246 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d10426-1962-4325-aa7c-c0d43a76e024 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:43.363544 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d10426-1962-4325-aa7c-c0d43a76e024 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:43.363831 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d10426-1962-4325-aa7c-c0d43a76e024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:43.385920 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-f5d10426-1962-4325-aa7c-c0d43a76e024 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:43.387259 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-f5d10426-1962-4325-aa7c-c0d43a76e024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:43.450020 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1047/2102] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:43.460438 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782387e6-9732-4151-9d99-1791c6def144 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:43.460741 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782387e6-9732-4151-9d99-1791c6def144 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:43.461138 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782387e6-9732-4151-9d99-1791c6def144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:43.491225 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-782387e6-9732-4151-9d99-1791c6def144 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:43.492837 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-782387e6-9732-4151-9d99-1791c6def144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:43.502837 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1056/2103] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:43.503003 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1048/2104] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:43.511494 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d10426-1962-4325-aa7c-c0d43a76e024 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:43.512078 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8bdf3-cee0-4342-b134-5d0a35e60223 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:43.512393 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8bdf3-cee0-4342-b134-5d0a35e60223 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:43.512768 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8bdf3-cee0-4342-b134-5d0a35e60223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:43.523338 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d10426-1962-4325-aa7c-c0d43a76e024 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:43.532179 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-1ef8bdf3-cee0-4342-b134-5d0a35e60223 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:43.533605 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-1ef8bdf3-cee0-4342-b134-5d0a35e60223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:43.534275 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c683b06-1aa1-437b-a23e-de4c687bd1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:43.535119 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c683b06-1aa1-437b-a23e-de4c687bd1ef admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:43.535320 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c683b06-1aa1-437b-a23e-de4c687bd1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:43.535854 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c683b06-1aa1-437b-a23e-de4c687bd1ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:43.536682 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c683b06-1aa1-437b-a23e-de4c687bd1ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:21:43.537130 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c683b06-1aa1-437b-a23e-de4c687bd1ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:43.538894 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c683b06-1aa1-437b-a23e-de4c687bd1ef admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:43.542005 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1049/2105] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:43.547397 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8bdf3-cee0-4342-b134-5d0a35e60223 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:43.557557 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1057/2106] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:21:43.558409 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8bdf3-cee0-4342-b134-5d0a35e60223 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:43.558733 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c683b06-1aa1-437b-a23e-de4c687bd1ef admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:43.565746 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef394ab-1640-4aba-b117-ebca3631cb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:43.566812 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef394ab-1640-4aba-b117-ebca3631cb23 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:43.567174 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef394ab-1640-4aba-b117-ebca3631cb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:43.567521 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef394ab-1640-4aba-b117-ebca3631cb23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:43.568269 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef394ab-1640-4aba-b117-ebca3631cb23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:21:43.568588 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef394ab-1640-4aba-b117-ebca3631cb23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:43.570240 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef394ab-1640-4aba-b117-ebca3631cb23 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:43.571740 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c683b06-1aa1-437b-a23e-de4c687bd1ef admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:43.579271 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eebca4-229b-43e8-984c-c056f67207bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:43.584146 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eebca4-229b-43e8-984c-c056f67207bf admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:43.584146 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eebca4-229b-43e8-984c-c056f67207bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:43.584146 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eebca4-229b-43e8-984c-c056f67207bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:43.584146 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eebca4-229b-43e8-984c-c056f67207bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:43.584146 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eebca4-229b-43e8-984c-c056f67207bf admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:43.584808 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1050/2107] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:21:43.589130 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef394ab-1640-4aba-b117-ebca3631cb23 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:43.599289 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef394ab-1640-4aba-b117-ebca3631cb23 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:43.607692 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1be24-5663-48b8-b920-9a4d3db345b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:43.607692 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1be24-5663-48b8-b920-9a4d3db345b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:43.607692 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1be24-5663-48b8-b920-9a4d3db345b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:43.607692 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1be24-5663-48b8-b920-9a4d3db345b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:43.608133 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1be24-5663-48b8-b920-9a4d3db345b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:43.608133 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1be24-5663-48b8-b920-9a4d3db345b4 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:43.704656 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1058/2108] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:43 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:21:43.705530 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eebca4-229b-43e8-984c-c056f67207bf admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:43.707103 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-f4eebca4-229b-43e8-984c-c056f67207bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:43.752718 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1051/2109] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:43 2022] POST /identity/v3/projects => generated 371 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:21:43.753873 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1be24-5663-48b8-b920-9a4d3db345b4 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:43.773163 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eebca4-229b-43e8-984c-c056f67207bf admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:43.837040 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1be24-5663-48b8-b920-9a4d3db345b4 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:43.847524 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a75a2-a26f-4de6-b786-26af110a0923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:43.848055 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801352f-4312-4ebc-abfb-db3bdb3aa2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:43.848391 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a75a2-a26f-4de6-b786-26af110a0923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:43.848707 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a75a2-a26f-4de6-b786-26af110a0923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:43.848816 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801352f-4312-4ebc-abfb-db3bdb3aa2d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:43.848977 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a75a2-a26f-4de6-b786-26af110a0923 admin admin] PATH_INFO: `/v3/projects/8c4ed2d69982450796568b5b0be558e2` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:43.849086 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801352f-4312-4ebc-abfb-db3bdb3aa2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:43.849270 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801352f-4312-4ebc-abfb-db3bdb3aa2d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:43.850015 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801352f-4312-4ebc-abfb-db3bdb3aa2d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:43.850511 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a75a2-a26f-4de6-b786-26af110a0923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c4ed2d69982450796568b5b0be558e2)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:43.851943 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801352f-4312-4ebc-abfb-db3bdb3aa2d3 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:43.852172 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a75a2-a26f-4de6-b786-26af110a0923 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:43.943040 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1052/2110] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:43 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:43.943857 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801352f-4312-4ebc-abfb-db3bdb3aa2d3 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:43.954174 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801352f-4312-4ebc-abfb-db3bdb3aa2d3 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:43.958733 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c6d2e-7314-46e5-8a23-d3533890175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:43.959386 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c6d2e-7314-46e5-8a23-d3533890175d admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:43.959671 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c6d2e-7314-46e5-8a23-d3533890175d admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:43.959950 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c6d2e-7314-46e5-8a23-d3533890175d admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:43.960631 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c6d2e-7314-46e5-8a23-d3533890175d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:43.962670 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c6d2e-7314-46e5-8a23-d3533890175d admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:43.993124 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6a5a75a2-a26f-4de6-b786-26af110a0923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c4ed2d69982450796568b5b0be558e2', 'request_id': 'req-6a5a75a2-a26f-4de6-b786-26af110a0923'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:44.000663 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6a5a75a2-a26f-4de6-b786-26af110a0923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c4ed2d69982450796568b5b0be558e2', 'request_id': 'req-6a5a75a2-a26f-4de6-b786-26af110a0923'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:44.007322 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6a5a75a2-a26f-4de6-b786-26af110a0923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c4ed2d69982450796568b5b0be558e2', 'request_id': 'req-6a5a75a2-a26f-4de6-b786-26af110a0923'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:44.063105 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1053/2111] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:43 2022] POST /identity/v3/users => generated 286 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:44.064108 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c6d2e-7314-46e5-8a23-d3533890175d admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:44.074543 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c6d2e-7314-46e5-8a23-d3533890175d admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:44.091161 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6a5a75a2-a26f-4de6-b786-26af110a0923 admin admin] The token cache is being invalidate because project 8c4ed2d69982450796568b5b0be558e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:44.091524 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6a5a75a2-a26f-4de6-b786-26af110a0923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:44.093042 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6a5a75a2-a26f-4de6-b786-26af110a0923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:44.094962 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1059/2112] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:43 2022] DELETE /identity/v3/projects/8c4ed2d69982450796568b5b0be558e2 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:44.098339 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a75a2-a26f-4de6-b786-26af110a0923 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:44.098339 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-6a5a75a2-a26f-4de6-b786-26af110a0923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:44.140125 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213216e-6b89-4e27-92e7-6c3dbc287a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:44.140682 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213216e-6b89-4e27-92e7-6c3dbc287a65 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:44.140972 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213216e-6b89-4e27-92e7-6c3dbc287a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:44.141280 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213216e-6b89-4e27-92e7-6c3dbc287a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:44.142020 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213216e-6b89-4e27-92e7-6c3dbc287a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:44.143619 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213216e-6b89-4e27-92e7-6c3dbc287a65 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:44.154627 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1054/2113] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:44.155562 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213216e-6b89-4e27-92e7-6c3dbc287a65 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:44.157326 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-6213216e-6b89-4e27-92e7-6c3dbc287a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:44.169799 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a75a2-a26f-4de6-b786-26af110a0923 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:44.170702 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213216e-6b89-4e27-92e7-6c3dbc287a65 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:44.175366 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc6d68-677b-4a01-976b-c0a8852631c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:44.176402 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cefd0a-fb28-4bc8-a47a-19406b8a1585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:44.176549 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc6d68-677b-4a01-976b-c0a8852631c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:44.176741 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc6d68-677b-4a01-976b-c0a8852631c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:44.176972 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc6d68-677b-4a01-976b-c0a8852631c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:44.177359 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cefd0a-fb28-4bc8-a47a-19406b8a1585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:44.177657 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cefd0a-fb28-4bc8-a47a-19406b8a1585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:44.177756 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc6d68-677b-4a01-976b-c0a8852631c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:44.177940 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cefd0a-fb28-4bc8-a47a-19406b8a1585 admin admin] PATH_INFO: `/v3/users/37a6600757c4480cab5efa197a9a0821` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:44.179249 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cefd0a-fb28-4bc8-a47a-19406b8a1585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37a6600757c4480cab5efa197a9a0821)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:44.179371 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc6d68-677b-4a01-976b-c0a8852631c3 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:44.181209 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cefd0a-fb28-4bc8-a47a-19406b8a1585 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:44.199279 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1060/2114] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:44.199279 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc6d68-677b-4a01-976b-c0a8852631c3 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:44.199279 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-cdbc6d68-677b-4a01-976b-c0a8852631c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:44.207582 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc6d68-677b-4a01-976b-c0a8852631c3 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:44.215085 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684930e-304c-48e7-a6a8-09b82d9e5b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:44.215768 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684930e-304c-48e7-a6a8-09b82d9e5b9a admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:44.216048 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684930e-304c-48e7-a6a8-09b82d9e5b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:44.217782 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684930e-304c-48e7-a6a8-09b82d9e5b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:44.217782 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684930e-304c-48e7-a6a8-09b82d9e5b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:44.219236 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684930e-304c-48e7-a6a8-09b82d9e5b9a admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:44.229627 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1061/2115] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:44.230467 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684930e-304c-48e7-a6a8-09b82d9e5b9a admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:44.240668 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684930e-304c-48e7-a6a8-09b82d9e5b9a admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:44.245272 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ce32e0-e8ab-4d50-b063-c9e671517f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:44.246437 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce32e0-e8ab-4d50-b063-c9e671517f85 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:44.246437 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce32e0-e8ab-4d50-b063-c9e671517f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:44.246608 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce32e0-e8ab-4d50-b063-c9e671517f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:44.247206 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ce32e0-e8ab-4d50-b063-c9e671517f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:44.248866 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ce32e0-e8ab-4d50-b063-c9e671517f85 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:44.258630 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1062/2116] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:44.263636 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ce32e0-e8ab-4d50-b063-c9e671517f85 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:44.268809 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ce32e0-e8ab-4d50-b063-c9e671517f85 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:44.273715 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5f8df-b2dc-4573-ac01-e0df82cd7a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:44.274578 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5f8df-b2dc-4573-ac01-e0df82cd7a68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:44.274846 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5f8df-b2dc-4573-ac01-e0df82cd7a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:44.275124 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5f8df-b2dc-4573-ac01-e0df82cd7a68 admin admin] PATH_INFO: `/v3/projects/421b54cdd049421cad2446abc5a98ad5/users/72d59f19060c4c2dafe59b6f9553c868/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:44.290824 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5f8df-b2dc-4573-ac01-e0df82cd7a68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=421b54cdd049421cad2446abc5a98ad5, user_id=72d59f19060c4c2dafe59b6f9553c868, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:44.294784 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5f8df-b2dc-4573-ac01-e0df82cd7a68 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:44.315678 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-15cefd0a-fb28-4bc8-a47a-19406b8a1585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37a6600757c4480cab5efa197a9a0821'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:44.360683 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1063/2117] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:44 2022] PUT /identity/v3/projects/421b54cdd049421cad2446abc5a98ad5/users/72d59f19060c4c2dafe59b6f9553c868/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:44.361552 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5f8df-b2dc-4573-ac01-e0df82cd7a68 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:44.382959 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-15cefd0a-fb28-4bc8-a47a-19406b8a1585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37a6600757c4480cab5efa197a9a0821'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:44.383645 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-15cefd0a-fb28-4bc8-a47a-19406b8a1585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37a6600757c4480cab5efa197a9a0821'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:44.391678 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-15cefd0a-fb28-4bc8-a47a-19406b8a1585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37a6600757c4480cab5efa197a9a0821'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:44.405858 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-15cefd0a-fb28-4bc8-a47a-19406b8a1585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37a6600757c4480cab5efa197a9a0821'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:44.415432 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1055/2118] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:44 2022] DELETE /identity/v3/users/37a6600757c4480cab5efa197a9a0821 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:44.415432 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2e0be-f9c1-4b06-9217-76c6b2a6265a None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:44.415432 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2e0be-f9c1-4b06-9217-76c6b2a6265a None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:44.415432 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2e0be-f9c1-4b06-9217-76c6b2a6265a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:44.436431 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5f8df-b2dc-4573-ac01-e0df82cd7a68 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:44.447725 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-d3b2e0be-f9c1-4b06-9217-76c6b2a6265a None None] MFA Rules not processed for user `72d59f19060c4c2dafe59b6f9553c868`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:44.456671 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-d3b2e0be-f9c1-4b06-9217-76c6b2a6265a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:44.526930 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597715f-c79c-44aa-ae3e-eeac27e8459e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:44.527903 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597715f-c79c-44aa-ae3e-eeac27e8459e admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:44.528192 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597715f-c79c-44aa-ae3e-eeac27e8459e admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:44.528470 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597715f-c79c-44aa-ae3e-eeac27e8459e admin admin] PATH_INFO: `/v3/projects/0d0ac7345e5e44dbb29b844d7bcc99fe/users/df585f25650d4fb2aec3bcea7b71f1cf/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:44.534530 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1056/2119] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:44.539015 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2e0be-f9c1-4b06-9217-76c6b2a6265a None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:44.540365 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-d3b2e0be-f9c1-4b06-9217-76c6b2a6265a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:44.548028 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597715f-c79c-44aa-ae3e-eeac27e8459e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d0ac7345e5e44dbb29b844d7bcc99fe, user_id=df585f25650d4fb2aec3bcea7b71f1cf, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:44.551397 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597715f-c79c-44aa-ae3e-eeac27e8459e admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:44.554076 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2e0be-f9c1-4b06-9217-76c6b2a6265a None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:44.560092 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc390d-8b02-4591-85a8-f9f5b090ce98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:44.560092 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc390d-8b02-4591-85a8-f9f5b090ce98 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:44.560323 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc390d-8b02-4591-85a8-f9f5b090ce98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:44.560410 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc390d-8b02-4591-85a8-f9f5b090ce98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:44.561421 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc390d-8b02-4591-85a8-f9f5b090ce98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:44.563339 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc390d-8b02-4591-85a8-f9f5b090ce98 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:44.658758 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1064/2120] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:44 2022] PUT /identity/v3/projects/0d0ac7345e5e44dbb29b844d7bcc99fe/users/df585f25650d4fb2aec3bcea7b71f1cf/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:44.669431 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097955c-0def-4313-9dfa-6a4bdbb1631e None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:44.671321 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097955c-0def-4313-9dfa-6a4bdbb1631e None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:44.671321 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097955c-0def-4313-9dfa-6a4bdbb1631e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:44.696099 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1057/2121] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:44 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:21:44.700355 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc390d-8b02-4591-85a8-f9f5b090ce98 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:44.705452 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-b097955c-0def-4313-9dfa-6a4bdbb1631e None None] MFA Rules not processed for user `df585f25650d4fb2aec3bcea7b71f1cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:44.706883 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b097955c-0def-4313-9dfa-6a4bdbb1631e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:44.773046 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc390d-8b02-4591-85a8-f9f5b090ce98 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:44.790117 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fe7ea-d6fd-4566-b4ad-d1bd06992460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:44.790998 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fe7ea-d6fd-4566-b4ad-d1bd06992460 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:44.791291 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fe7ea-d6fd-4566-b4ad-d1bd06992460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:44.791576 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fe7ea-d6fd-4566-b4ad-d1bd06992460 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:44.792420 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fe7ea-d6fd-4566-b4ad-d1bd06992460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:44.794675 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fe7ea-d6fd-4566-b4ad-d1bd06992460 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:44.798104 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1065/2122] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:21:44.802597 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097955c-0def-4313-9dfa-6a4bdbb1631e None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:44.804228 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b097955c-0def-4313-9dfa-6a4bdbb1631e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:44.818859 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097955c-0def-4313-9dfa-6a4bdbb1631e None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:44.823834 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312672a5-0daf-47b0-a5da-0c9de07bb5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:44.832761 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312672a5-0daf-47b0-a5da-0c9de07bb5fc admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:44.832761 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312672a5-0daf-47b0-a5da-0c9de07bb5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:44.832761 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312672a5-0daf-47b0-a5da-0c9de07bb5fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:44.832761 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312672a5-0daf-47b0-a5da-0c9de07bb5fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:44.832761 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312672a5-0daf-47b0-a5da-0c9de07bb5fc admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:44.851770 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1058/2123] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:44 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:21:44.855577 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fe7ea-d6fd-4566-b4ad-d1bd06992460 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:44.866386 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fe7ea-d6fd-4566-b4ad-d1bd06992460 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:44.871257 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f13494-276e-415f-8157-7988f9d1d2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:44.872054 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f13494-276e-415f-8157-7988f9d1d2ad admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:44.872353 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f13494-276e-415f-8157-7988f9d1d2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:44.872635 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f13494-276e-415f-8157-7988f9d1d2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:44.873657 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f13494-276e-415f-8157-7988f9d1d2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:44.875229 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f13494-276e-415f-8157-7988f9d1d2ad admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:44.888407 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1059/2124] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:21:44.889596 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f13494-276e-415f-8157-7988f9d1d2ad admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:44.899937 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f13494-276e-415f-8157-7988f9d1d2ad admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:44.905312 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3392c-8705-4b1c-b135-66f3f2ed89b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:44.905999 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3392c-8705-4b1c-b135-66f3f2ed89b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:44.906284 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3392c-8705-4b1c-b135-66f3f2ed89b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:44.906563 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3392c-8705-4b1c-b135-66f3f2ed89b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:44.907293 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3392c-8705-4b1c-b135-66f3f2ed89b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:44.909008 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3392c-8705-4b1c-b135-66f3f2ed89b1 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:44.929879 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1060/2125] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:44.929879 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3392c-8705-4b1c-b135-66f3f2ed89b1 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:44.931017 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-e8a3392c-8705-4b1c-b135-66f3f2ed89b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:44.937227 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1066/2126] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:44 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:44.938176 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312672a5-0daf-47b0-a5da-0c9de07bb5fc admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:44.949861 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3392c-8705-4b1c-b135-66f3f2ed89b1 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:45.002573 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312672a5-0daf-47b0-a5da-0c9de07bb5fc admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:45.007340 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5a0ca-eb11-4b3e-99d8-fd09ab76fb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:45.007517 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79138628-5433-4d6c-a4ff-78adf1f307e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:45.008231 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5a0ca-eb11-4b3e-99d8-fd09ab76fb12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:45.008408 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79138628-5433-4d6c-a4ff-78adf1f307e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:45.008500 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5a0ca-eb11-4b3e-99d8-fd09ab76fb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:45.008694 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79138628-5433-4d6c-a4ff-78adf1f307e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:45.008816 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5a0ca-eb11-4b3e-99d8-fd09ab76fb12 admin admin] PATH_INFO: `/v3/projects/24c1095ad6c842d497eabf4c5b258ebd/users/4cae2ed3172a4a5d8d8383bbf1568ce3/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:45.008977 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79138628-5433-4d6c-a4ff-78adf1f307e9 admin admin] PATH_INFO: `/v3/projects/fb9ff164b31942c8a8ce43b9e74aabb7` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:45.010381 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79138628-5433-4d6c-a4ff-78adf1f307e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb9ff164b31942c8a8ce43b9e74aabb7)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:45.012372 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79138628-5433-4d6c-a4ff-78adf1f307e9 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:45.025804 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5a0ca-eb11-4b3e-99d8-fd09ab76fb12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24c1095ad6c842d497eabf4c5b258ebd, user_id=4cae2ed3172a4a5d8d8383bbf1568ce3, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:45.030196 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5a0ca-eb11-4b3e-99d8-fd09ab76fb12 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:45.108637 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1067/2127] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:44 2022] PUT /identity/v3/projects/24c1095ad6c842d497eabf4c5b258ebd/users/4cae2ed3172a4a5d8d8383bbf1568ce3/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:45.109555 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5a0ca-eb11-4b3e-99d8-fd09ab76fb12 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:45.142317 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-79138628-5433-4d6c-a4ff-78adf1f307e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb9ff164b31942c8a8ce43b9e74aabb7', 'request_id': 'req-79138628-5433-4d6c-a4ff-78adf1f307e9'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:45.171778 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5a0ca-eb11-4b3e-99d8-fd09ab76fb12 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:45.205359 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-79138628-5433-4d6c-a4ff-78adf1f307e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb9ff164b31942c8a8ce43b9e74aabb7', 'request_id': 'req-79138628-5433-4d6c-a4ff-78adf1f307e9'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:45.212244 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-79138628-5433-4d6c-a4ff-78adf1f307e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb9ff164b31942c8a8ce43b9e74aabb7', 'request_id': 'req-79138628-5433-4d6c-a4ff-78adf1f307e9'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:45.224667 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-79138628-5433-4d6c-a4ff-78adf1f307e9 admin admin] The token cache is being invalidate because project fb9ff164b31942c8a8ce43b9e74aabb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:45.225035 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-79138628-5433-4d6c-a4ff-78adf1f307e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:45.225631 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-79138628-5433-4d6c-a4ff-78adf1f307e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:45.227809 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdfb94-12e1-4dd6-80d3-59624edd2c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:45.228294 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1061/2128] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:44 2022] DELETE /identity/v3/projects/fb9ff164b31942c8a8ce43b9e74aabb7 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:45.229030 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdfb94-12e1-4dd6-80d3-59624edd2c75 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:45.229404 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdfb94-12e1-4dd6-80d3-59624edd2c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:45.229690 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdfb94-12e1-4dd6-80d3-59624edd2c75 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:45.229971 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79138628-5433-4d6c-a4ff-78adf1f307e9 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:45.230591 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfdfb94-12e1-4dd6-80d3-59624edd2c75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:45.232617 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-79138628-5433-4d6c-a4ff-78adf1f307e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:45.232747 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfdfb94-12e1-4dd6-80d3-59624edd2c75 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:45.295837 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79138628-5433-4d6c-a4ff-78adf1f307e9 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:45.299407 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232bd1bf-f25c-4ef5-a4eb-f40aec404e3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:45.300075 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bd1bf-f25c-4ef5-a4eb-f40aec404e3a service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:45.300359 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bd1bf-f25c-4ef5-a4eb-f40aec404e3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:45.300632 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bd1bf-f25c-4ef5-a4eb-f40aec404e3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:45.302459 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-232bd1bf-f25c-4ef5-a4eb-f40aec404e3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:45.358020 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1068/2129] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:45 2022] POST /identity/v3/users => generated 292 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:45.358020 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3097b3-cc94-4b11-b6f5-c4788728c6bf None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:45.358020 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3097b3-cc94-4b11-b6f5-c4788728c6bf None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:45.358020 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3097b3-cc94-4b11-b6f5-c4788728c6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:45.367117 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232bd1bf-f25c-4ef5-a4eb-f40aec404e3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:45.368553 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232bd1bf-f25c-4ef5-a4eb-f40aec404e3a service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:45.378737 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1062/2130] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:21:45.379548 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232bd1bf-f25c-4ef5-a4eb-f40aec404e3a service cinder] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:45.380909 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-232bd1bf-f25c-4ef5-a4eb-f40aec404e3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:45.385002 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-7a3097b3-cc94-4b11-b6f5-c4788728c6bf None None] MFA Rules not processed for user `4cae2ed3172a4a5d8d8383bbf1568ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:45.386431 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-7a3097b3-cc94-4b11-b6f5-c4788728c6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:45.395773 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232bd1bf-f25c-4ef5-a4eb-f40aec404e3a service cinder] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:45.402351 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7f65f-5c33-4136-87c5-1a384b60592a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:45.403417 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7f65f-5c33-4136-87c5-1a384b60592a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:45.405692 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7f65f-5c33-4136-87c5-1a384b60592a admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:45.405984 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7f65f-5c33-4136-87c5-1a384b60592a admin admin] PATH_INFO: `/v3/users/7883aa3229004fc582025e57119af7d4` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:45.407262 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7f65f-5c33-4136-87c5-1a384b60592a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7883aa3229004fc582025e57119af7d4)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:45.409186 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7f65f-5c33-4136-87c5-1a384b60592a admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:45.456100 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1069/2131] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:45.457726 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3097b3-cc94-4b11-b6f5-c4788728c6bf None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:45.459011 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-7a3097b3-cc94-4b11-b6f5-c4788728c6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:45.472514 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3097b3-cc94-4b11-b6f5-c4788728c6bf None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:45.477092 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5ab4a-65da-4b1e-8779-9aad1e3ba0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:45.477808 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5ab4a-65da-4b1e-8779-9aad1e3ba0ba admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:45.478092 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5ab4a-65da-4b1e-8779-9aad1e3ba0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:45.478370 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5ab4a-65da-4b1e-8779-9aad1e3ba0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:45.479101 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5ab4a-65da-4b1e-8779-9aad1e3ba0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:45.480686 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5ab4a-65da-4b1e-8779-9aad1e3ba0ba admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:45.494566 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1070/2132] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:45.494566 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5ab4a-65da-4b1e-8779-9aad1e3ba0ba admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:45.494566 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-dac5ab4a-65da-4b1e-8779-9aad1e3ba0ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:45.506930 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5ab4a-65da-4b1e-8779-9aad1e3ba0ba admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:45.514351 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bfa8b8-ad58-4c84-8835-4ef1ba053f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:45.514351 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfa8b8-ad58-4c84-8835-4ef1ba053f4c admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:45.514351 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfa8b8-ad58-4c84-8835-4ef1ba053f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:45.514351 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfa8b8-ad58-4c84-8835-4ef1ba053f4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:45.514672 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bfa8b8-ad58-4c84-8835-4ef1ba053f4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:45.515609 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bfa8b8-ad58-4c84-8835-4ef1ba053f4c admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:45.613880 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1071/2133] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:45 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:45.617704 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bfa8b8-ad58-4c84-8835-4ef1ba053f4c admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:45.688764 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bfa8b8-ad58-4c84-8835-4ef1ba053f4c admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:45.693470 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8430f-9cfc-48ad-a415-43e01696462e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:45.694368 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8430f-9cfc-48ad-a415-43e01696462e admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:45.694652 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8430f-9cfc-48ad-a415-43e01696462e admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:45.694932 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8430f-9cfc-48ad-a415-43e01696462e admin admin] PATH_INFO: `/v3/projects/78b50271c86f4643986f7ea869c97a2d/users/69a90e5f1ebc44faa7ef6f1369696c88/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:45.710519 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8430f-9cfc-48ad-a415-43e01696462e admin admin] RBAC: Authorizing `identity:create_grant(project_id=78b50271c86f4643986f7ea869c97a2d, user_id=69a90e5f1ebc44faa7ef6f1369696c88, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:45.713199 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8430f-9cfc-48ad-a415-43e01696462e admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:45.776437 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-14b7f65f-5c33-4136-87c5-1a384b60592a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7883aa3229004fc582025e57119af7d4'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:45.800621 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1072/2134] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:45 2022] PUT /identity/v3/projects/78b50271c86f4643986f7ea869c97a2d/users/69a90e5f1ebc44faa7ef6f1369696c88/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:45.801463 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8430f-9cfc-48ad-a415-43e01696462e admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:45.862711 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-14b7f65f-5c33-4136-87c5-1a384b60592a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7883aa3229004fc582025e57119af7d4'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:45.863247 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-14b7f65f-5c33-4136-87c5-1a384b60592a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7883aa3229004fc582025e57119af7d4'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:45.863377 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8430f-9cfc-48ad-a415-43e01696462e admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:45.868115 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094735e-3dcb-4162-ba9a-c95411bafc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:45.868791 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094735e-3dcb-4162-ba9a-c95411bafc99 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:45.869102 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094735e-3dcb-4162-ba9a-c95411bafc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:45.869376 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094735e-3dcb-4162-ba9a-c95411bafc99 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:45.870084 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094735e-3dcb-4162-ba9a-c95411bafc99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:45.871267 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-14b7f65f-5c33-4136-87c5-1a384b60592a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7883aa3229004fc582025e57119af7d4'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:45.872085 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094735e-3dcb-4162-ba9a-c95411bafc99 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:45.885598 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-14b7f65f-5c33-4136-87c5-1a384b60592a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7883aa3229004fc582025e57119af7d4'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:45.892266 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1063/2135] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:45 2022] DELETE /identity/v3/users/7883aa3229004fc582025e57119af7d4 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:45.893213 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7f65f-5c33-4136-87c5-1a384b60592a admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:45.894627 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-14b7f65f-5c33-4136-87c5-1a384b60592a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:45.940499 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1073/2136] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:45 2022] POST /identity/v3/users => generated 295 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:45.949033 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094735e-3dcb-4162-ba9a-c95411bafc99 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:45.952564 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-6094735e-3dcb-4162-ba9a-c95411bafc99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:45.967439 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094735e-3dcb-4162-ba9a-c95411bafc99 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:45.972178 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7f65f-5c33-4136-87c5-1a384b60592a admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:45.974512 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab563a11-d414-495c-a7d0-c08cdb892c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:45.975789 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab563a11-d414-495c-a7d0-c08cdb892c26 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:45.976155 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab563a11-d414-495c-a7d0-c08cdb892c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:45.976489 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab563a11-d414-495c-a7d0-c08cdb892c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:45.977228 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6fd9e1-a0f5-4a99-8152-e434f9181732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:45.977379 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab563a11-d414-495c-a7d0-c08cdb892c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:45.977958 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fd9e1-a0f5-4a99-8152-e434f9181732 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:45.982033 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fd9e1-a0f5-4a99-8152-e434f9181732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:45.982033 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fd9e1-a0f5-4a99-8152-e434f9181732 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:45.982236 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab563a11-d414-495c-a7d0-c08cdb892c26 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:45.982324 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6fd9e1-a0f5-4a99-8152-e434f9181732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:45.982324 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6fd9e1-a0f5-4a99-8152-e434f9181732 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:45.991144 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1074/2137] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:45.995175 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1064/2138] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:45.999574 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6fd9e1-a0f5-4a99-8152-e434f9181732 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:46.000303 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab563a11-d414-495c-a7d0-c08cdb892c26 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:46.012471 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6fd9e1-a0f5-4a99-8152-e434f9181732 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:46.016444 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab563a11-d414-495c-a7d0-c08cdb892c26 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:46.018339 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28a93b-89c2-44f0-9f3f-4ecec58f3e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:46.020018 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28a93b-89c2-44f0-9f3f-4ecec58f3e4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:46.020318 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28a93b-89c2-44f0-9f3f-4ecec58f3e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:46.020599 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28a93b-89c2-44f0-9f3f-4ecec58f3e4b admin admin] PATH_INFO: `/v3/projects/78b50271c86f4643986f7ea869c97a2d/users/69a90e5f1ebc44faa7ef6f1369696c88/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:46.021025 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18cbb62-576d-4cee-aaae-6b7de61eff1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:46.021935 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cbb62-576d-4cee-aaae-6b7de61eff1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:46.022246 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cbb62-576d-4cee-aaae-6b7de61eff1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:46.022490 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cbb62-576d-4cee-aaae-6b7de61eff1b admin admin] PATH_INFO: `/v3/projects/880d7e66b3a544869450b7dd3eadf60e/users/8e3361321d8c4d3b8ae7fc857d811a4f/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:46.023108 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd28a93b-89c2-44f0-9f3f-4ecec58f3e4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=78b50271c86f4643986f7ea869c97a2d, user_id=69a90e5f1ebc44faa7ef6f1369696c88, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:46.025952 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd28a93b-89c2-44f0-9f3f-4ecec58f3e4b admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:46.037559 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1065/2139] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:45 2022] PUT /identity/v3/projects/78b50271c86f4643986f7ea869c97a2d/users/69a90e5f1ebc44faa7ef6f1369696c88/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:46.046994 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18cbb62-576d-4cee-aaae-6b7de61eff1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=880d7e66b3a544869450b7dd3eadf60e, user_id=8e3361321d8c4d3b8ae7fc857d811a4f, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:46.046994 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18cbb62-576d-4cee-aaae-6b7de61eff1b admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:46.049254 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045e23c-ee6c-4bb8-8e61-4f1bc9094e5e None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:46.049584 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045e23c-ee6c-4bb8-8e61-4f1bc9094e5e None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:46.049866 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045e23c-ee6c-4bb8-8e61-4f1bc9094e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:46.077812 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-a045e23c-ee6c-4bb8-8e61-4f1bc9094e5e None None] MFA Rules not processed for user `69a90e5f1ebc44faa7ef6f1369696c88`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:46.079086 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-a045e23c-ee6c-4bb8-8e61-4f1bc9094e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:46.151216 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1066/2140] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:46 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:21:46.154154 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1075/2141] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:45 2022] PUT /identity/v3/projects/880d7e66b3a544869450b7dd3eadf60e/users/8e3361321d8c4d3b8ae7fc857d811a4f/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:46.157919 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045e23c-ee6c-4bb8-8e61-4f1bc9094e5e None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:46.166866 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18cbb62-576d-4cee-aaae-6b7de61eff1b admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:46.168963 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-d18cbb62-576d-4cee-aaae-6b7de61eff1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:46.230327 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045e23c-ee6c-4bb8-8e61-4f1bc9094e5e None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:46.241886 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18cbb62-576d-4cee-aaae-6b7de61eff1b admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:46.246048 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ea8bf-6bc8-49c0-a466-86e7fdfbbe1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:46.246694 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ea8bf-6bc8-49c0-a466-86e7fdfbbe1b service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:46.246976 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ea8bf-6bc8-49c0-a466-86e7fdfbbe1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:46.247251 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ea8bf-6bc8-49c0-a466-86e7fdfbbe1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:46.308393 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337373ab-6c37-4104-9233-0abdd4200744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:46.309521 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337373ab-6c37-4104-9233-0abdd4200744 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:46.309836 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337373ab-6c37-4104-9233-0abdd4200744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:46.310182 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337373ab-6c37-4104-9233-0abdd4200744 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:46.311023 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337373ab-6c37-4104-9233-0abdd4200744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:46.312992 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337373ab-6c37-4104-9233-0abdd4200744 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:46.319093 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ea8bf-6bc8-49c0-a466-86e7fdfbbe1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:46.320515 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ea8bf-6bc8-49c0-a466-86e7fdfbbe1b service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:46.325602 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1067/2142] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:46.328380 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337373ab-6c37-4104-9233-0abdd4200744 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:46.332451 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-337373ab-6c37-4104-9233-0abdd4200744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:46.332698 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1076/2143] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:46 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:21:46.333542 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ea8bf-6bc8-49c0-a466-86e7fdfbbe1b service cinder] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:46.345649 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ea8bf-6bc8-49c0-a466-86e7fdfbbe1b service cinder] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:46.347524 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337373ab-6c37-4104-9233-0abdd4200744 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:46.352929 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe198ecf-7c16-49ba-9415-1fc78e05cb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:46.356299 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe198ecf-7c16-49ba-9415-1fc78e05cb85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:46.356299 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe198ecf-7c16-49ba-9415-1fc78e05cb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:46.356299 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe198ecf-7c16-49ba-9415-1fc78e05cb85 admin admin] PATH_INFO: `/v3/projects/d6015b8ef9d44897815b9216ad8e24fb` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:46.356299 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe198ecf-7c16-49ba-9415-1fc78e05cb85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6015b8ef9d44897815b9216ad8e24fb)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:46.357969 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe198ecf-7c16-49ba-9415-1fc78e05cb85 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:46.364449 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e1852-21a6-4e0e-b799-a2f17052e390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:46.365844 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e1852-21a6-4e0e-b799-a2f17052e390 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:46.366283 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e1852-21a6-4e0e-b799-a2f17052e390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:46.366884 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e1852-21a6-4e0e-b799-a2f17052e390 admin admin] PATH_INFO: `/v3/projects/880d7e66b3a544869450b7dd3eadf60e/users/8e3361321d8c4d3b8ae7fc857d811a4f/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:46.368919 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e1852-21a6-4e0e-b799-a2f17052e390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=880d7e66b3a544869450b7dd3eadf60e, user_id=8e3361321d8c4d3b8ae7fc857d811a4f, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:46.371666 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e1852-21a6-4e0e-b799-a2f17052e390 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:46.390011 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1077/2144] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:46 2022] PUT /identity/v3/projects/880d7e66b3a544869450b7dd3eadf60e/users/8e3361321d8c4d3b8ae7fc857d811a4f/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:46.400631 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8beca0-9141-476b-bd2d-a2466ba96129 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:46.400968 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8beca0-9141-476b-bd2d-a2466ba96129 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:46.401247 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8beca0-9141-476b-bd2d-a2466ba96129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:46.427261 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-ec8beca0-9141-476b-bd2d-a2466ba96129 None None] MFA Rules not processed for user `8e3361321d8c4d3b8ae7fc857d811a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:46.428496 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-ec8beca0-9141-476b-bd2d-a2466ba96129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:46.497233 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1078/2145] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:21:46.512071 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8beca0-9141-476b-bd2d-a2466ba96129 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:46.554013 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-fe198ecf-7c16-49ba-9415-1fc78e05cb85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6015b8ef9d44897815b9216ad8e24fb', 'request_id': 'req-fe198ecf-7c16-49ba-9415-1fc78e05cb85'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:46.571791 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8beca0-9141-476b-bd2d-a2466ba96129 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:46.624686 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d2a04-75e8-49f2-b035-c9147472d5c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:46.625762 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d2a04-75e8-49f2-b035-c9147472d5c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:46.626235 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d2a04-75e8-49f2-b035-c9147472d5c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:46.626699 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d2a04-75e8-49f2-b035-c9147472d5c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:46.629460 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-163d2a04-75e8-49f2-b035-c9147472d5c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:46.667913 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-fe198ecf-7c16-49ba-9415-1fc78e05cb85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6015b8ef9d44897815b9216ad8e24fb', 'request_id': 'req-fe198ecf-7c16-49ba-9415-1fc78e05cb85'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:46.674016 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-fe198ecf-7c16-49ba-9415-1fc78e05cb85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6015b8ef9d44897815b9216ad8e24fb', 'request_id': 'req-fe198ecf-7c16-49ba-9415-1fc78e05cb85'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:46.685942 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-fe198ecf-7c16-49ba-9415-1fc78e05cb85 admin admin] The token cache is being invalidate because project d6015b8ef9d44897815b9216ad8e24fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:46.686272 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-fe198ecf-7c16-49ba-9415-1fc78e05cb85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:46.687176 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-fe198ecf-7c16-49ba-9415-1fc78e05cb85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:46.688902 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1068/2146] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:46 2022] DELETE /identity/v3/projects/d6015b8ef9d44897815b9216ad8e24fb => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:21:46.689530 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe198ecf-7c16-49ba-9415-1fc78e05cb85 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:46.690890 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-fe198ecf-7c16-49ba-9415-1fc78e05cb85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:46.691460 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d2a04-75e8-49f2-b035-c9147472d5c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:46.692984 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d2a04-75e8-49f2-b035-c9147472d5c5 service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:46.703295 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe198ecf-7c16-49ba-9415-1fc78e05cb85 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:46.703475 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1079/2147] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:21:46.706562 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7bafc-7ac6-49c6-908c-3c5e7b339dda None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:46.706910 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7bafc-7ac6-49c6-908c-3c5e7b339dda None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:46.707086 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d120b2-345e-441a-ae90-8f5475798e98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:46.707217 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7bafc-7ac6-49c6-908c-3c5e7b339dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:46.707687 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d120b2-345e-441a-ae90-8f5475798e98 service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:46.707973 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d120b2-345e-441a-ae90-8f5475798e98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:46.708255 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d120b2-345e-441a-ae90-8f5475798e98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:46.710166 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-55d120b2-345e-441a-ae90-8f5475798e98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:46.730824 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-0ab7bafc-7ac6-49c6-908c-3c5e7b339dda None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:46.732032 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-0ab7bafc-7ac6-49c6-908c-3c5e7b339dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:46.775405 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d120b2-345e-441a-ae90-8f5475798e98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:46.776860 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d120b2-345e-441a-ae90-8f5475798e98 service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:46.787216 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1069/2148] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:21:46.802462 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1080/2149] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:46.818476 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baf213-19ff-49ce-bc79-5544de39994a None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:46.818811 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baf213-19ff-49ce-bc79-5544de39994a None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:46.819065 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baf213-19ff-49ce-bc79-5544de39994a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:46.840685 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-f3baf213-19ff-49ce-bc79-5544de39994a None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:46.842119 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-f3baf213-19ff-49ce-bc79-5544de39994a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:46.859079 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1070/2150] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:46.859702 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7bafc-7ac6-49c6-908c-3c5e7b339dda None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:46.870599 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7bafc-7ac6-49c6-908c-3c5e7b339dda None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:46.876961 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fe0a6-d991-43a5-9a50-55b3f0913274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:46.877971 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fe0a6-d991-43a5-9a50-55b3f0913274 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:46.878199 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fe0a6-d991-43a5-9a50-55b3f0913274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:46.878490 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fe0a6-d991-43a5-9a50-55b3f0913274 admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:46.879228 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fe0a6-d991-43a5-9a50-55b3f0913274 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:21:46.879541 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fe0a6-d991-43a5-9a50-55b3f0913274 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:46.881163 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fe0a6-d991-43a5-9a50-55b3f0913274 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:46.901347 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1081/2151] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:21:46.902588 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3baf213-19ff-49ce-bc79-5544de39994a None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:46.912902 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3baf213-19ff-49ce-bc79-5544de39994a None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:46.917649 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49184107-0fca-43df-9cef-a180ce83c149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:46.918368 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49184107-0fca-43df-9cef-a180ce83c149 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:46.918589 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49184107-0fca-43df-9cef-a180ce83c149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:46.918863 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49184107-0fca-43df-9cef-a180ce83c149 admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:46.919574 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49184107-0fca-43df-9cef-a180ce83c149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:46.923012 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49184107-0fca-43df-9cef-a180ce83c149 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:47.081247 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1071/2152] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:46 2022] POST /identity/v3/projects => generated 399 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:21:47.085686 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fe0a6-d991-43a5-9a50-55b3f0913274 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:47.098202 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fe0a6-d991-43a5-9a50-55b3f0913274 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:47.162866 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfcc24-e572-4986-a7d4-10f2aba5c69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:47.163544 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfcc24-e572-4986-a7d4-10f2aba5c69a admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:47.163871 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfcc24-e572-4986-a7d4-10f2aba5c69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:47.164153 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfcc24-e572-4986-a7d4-10f2aba5c69a admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:47.164858 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfcc24-e572-4986-a7d4-10f2aba5c69a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:47.166798 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfcc24-e572-4986-a7d4-10f2aba5c69a admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:47.251310 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1082/2153] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:21:47 2022] POST /identity/v3/users => generated 300 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:21:47.252491 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49184107-0fca-43df-9cef-a180ce83c149 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:47.263834 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49184107-0fca-43df-9cef-a180ce83c149 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:47.273869 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b3f26-0615-4d02-a0ca-09d1e64e7ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:47.273869 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b3f26-0615-4d02-a0ca-09d1e64e7ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:47.273869 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b3f26-0615-4d02-a0ca-09d1e64e7ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:47.273869 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b3f26-0615-4d02-a0ca-09d1e64e7ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:47.274589 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b3f26-0615-4d02-a0ca-09d1e64e7ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:47.274589 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b3f26-0615-4d02-a0ca-09d1e64e7ad3 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:47.298845 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1072/2154] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:47.299669 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfcc24-e572-4986-a7d4-10f2aba5c69a admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:47.312221 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfcc24-e572-4986-a7d4-10f2aba5c69a admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:47.317034 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce073fa-a012-420b-b0bf-293a32760b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:47.317747 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce073fa-a012-420b-b0bf-293a32760b7e admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:47.318070 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce073fa-a012-420b-b0bf-293a32760b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:47.318380 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce073fa-a012-420b-b0bf-293a32760b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:47.319030 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce073fa-a012-420b-b0bf-293a32760b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:47.320630 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce073fa-a012-420b-b0bf-293a32760b7e admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:47.337021 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1083/2155] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:21:47.340013 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b3f26-0615-4d02-a0ca-09d1e64e7ad3 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:47.351487 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b3f26-0615-4d02-a0ca-09d1e64e7ad3 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:47.357739 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f35550-0bbe-4ac4-93d9-a10c428c0d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:47.359509 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f35550-0bbe-4ac4-93d9-a10c428c0d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:47.359896 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f35550-0bbe-4ac4-93d9-a10c428c0d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:47.360055 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f35550-0bbe-4ac4-93d9-a10c428c0d4f admin admin] PATH_INFO: `/v3/projects/4548dfefb1194ac6b087b7a331685536/users/a331bc7da9c0480dbbf0f81a138d329a/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:47.388062 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f35550-0bbe-4ac4-93d9-a10c428c0d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4548dfefb1194ac6b087b7a331685536, user_id=a331bc7da9c0480dbbf0f81a138d329a, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:47.391611 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f35550-0bbe-4ac4-93d9-a10c428c0d4f admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:47.532795 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1073/2156] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:21:47 2022] PUT /identity/v3/projects/4548dfefb1194ac6b087b7a331685536/users/a331bc7da9c0480dbbf0f81a138d329a/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:47.546262 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e044d-0ba2-4513-b9d3-07f4ca50ba23 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:47.546824 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e044d-0ba2-4513-b9d3-07f4ca50ba23 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:47.546938 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e044d-0ba2-4513-b9d3-07f4ca50ba23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:47.574284 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-f15e044d-0ba2-4513-b9d3-07f4ca50ba23 None None] MFA Rules not processed for user `a331bc7da9c0480dbbf0f81a138d329a`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:47.575504 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-f15e044d-0ba2-4513-b9d3-07f4ca50ba23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:47.645581 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1084/2157] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:47.652282 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f35550-0bbe-4ac4-93d9-a10c428c0d4f admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:47.653969 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-17f35550-0bbe-4ac4-93d9-a10c428c0d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:47.712180 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f35550-0bbe-4ac4-93d9-a10c428c0d4f admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:47.715772 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab1030-35a5-41c3-a1bf-87fcd5aed917 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:47.716399 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab1030-35a5-41c3-a1bf-87fcd5aed917 service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:47.717412 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab1030-35a5-41c3-a1bf-87fcd5aed917 service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:47.717659 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab1030-35a5-41c3-a1bf-87fcd5aed917 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:47.725939 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab1030-35a5-41c3-a1bf-87fcd5aed917 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:47.727380 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab1030-35a5-41c3-a1bf-87fcd5aed917 service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:47.736500 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1074/2158] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:21:48.792113 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e044d-0ba2-4513-b9d3-07f4ca50ba23 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:48.802654 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e044d-0ba2-4513-b9d3-07f4ca50ba23 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:48.806727 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5437c-48e2-46cb-a144-e508358f7acd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:48.807387 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5437c-48e2-46cb-a144-e508358f7acd service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:48.807685 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5437c-48e2-46cb-a144-e508358f7acd service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:48.807951 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5437c-48e2-46cb-a144-e508358f7acd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:48.809889 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-7ad5437c-48e2-46cb-a144-e508358f7acd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:48.876120 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5437c-48e2-46cb-a144-e508358f7acd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:48.877490 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5437c-48e2-46cb-a144-e508358f7acd service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:48.889898 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1085/2159] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:21:50.352470 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab1030-35a5-41c3-a1bf-87fcd5aed917 service cinder] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:50.362383 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab1030-35a5-41c3-a1bf-87fcd5aed917 service cinder] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:50.366657 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a8855-e601-437c-831d-107e1e91c913 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:50.367369 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a8855-e601-437c-831d-107e1e91c913 service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:50.367724 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a8855-e601-437c-831d-107e1e91c913 service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:50.368069 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a8855-e601-437c-831d-107e1e91c913 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:50.369986 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9e6a8855-e601-437c-831d-107e1e91c913 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:50.436182 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a8855-e601-437c-831d-107e1e91c913 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:50.438016 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a8855-e601-437c-831d-107e1e91c913 service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:50.447760 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1075/2160] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:21:58.628750 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5437c-48e2-46cb-a144-e508358f7acd service cinder] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:58.716178 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5437c-48e2-46cb-a144-e508358f7acd service cinder] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:58.721184 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab2125-6320-4601-9e68-7f6423ba2143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:58.722091 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab2125-6320-4601-9e68-7f6423ba2143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:58.722434 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab2125-6320-4601-9e68-7f6423ba2143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:58.722713 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab2125-6320-4601-9e68-7f6423ba2143 admin admin] PATH_INFO: `/v3/users/a331bc7da9c0480dbbf0f81a138d329a` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:58.723915 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab2125-6320-4601-9e68-7f6423ba2143 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a331bc7da9c0480dbbf0f81a138d329a)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:58.725944 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab2125-6320-4601-9e68-7f6423ba2143 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:58.910160 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-adab2125-6320-4601-9e68-7f6423ba2143 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a331bc7da9c0480dbbf0f81a138d329a'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:58.981758 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-adab2125-6320-4601-9e68-7f6423ba2143 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a331bc7da9c0480dbbf0f81a138d329a'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:58.982483 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-adab2125-6320-4601-9e68-7f6423ba2143 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a331bc7da9c0480dbbf0f81a138d329a'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:58.983097 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-adab2125-6320-4601-9e68-7f6423ba2143 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a331bc7da9c0480dbbf0f81a138d329a'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:58.991172 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-adab2125-6320-4601-9e68-7f6423ba2143 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a331bc7da9c0480dbbf0f81a138d329a'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:59.010135 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1086/2161] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:21:58 2022] DELETE /identity/v3/users/a331bc7da9c0480dbbf0f81a138d329a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:59.014921 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ebb5b-b6f6-48bd-944c-f5ab5d7ad21d None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:59.015395 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ebb5b-b6f6-48bd-944c-f5ab5d7ad21d None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:59.015641 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ebb5b-b6f6-48bd-944c-f5ab5d7ad21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:59.033613 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-dd8ebb5b-b6f6-48bd-944c-f5ab5d7ad21d None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:59.034807 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-dd8ebb5b-b6f6-48bd-944c-f5ab5d7ad21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:59.090948 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1076/2162] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:59.101770 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab2125-6320-4601-9e68-7f6423ba2143 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:59.103175 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-adab2125-6320-4601-9e68-7f6423ba2143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:59.162654 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab2125-6320-4601-9e68-7f6423ba2143 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:59.166803 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c3547-14b7-407c-9a21-82a7072ce1a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:59.167457 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c3547-14b7-407c-9a21-82a7072ce1a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:59.167742 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c3547-14b7-407c-9a21-82a7072ce1a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:59.168083 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c3547-14b7-407c-9a21-82a7072ce1a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:59.177900 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c3547-14b7-407c-9a21-82a7072ce1a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:59.179655 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c3547-14b7-407c-9a21-82a7072ce1a4 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:59.189481 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1087/2163] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:21:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:21:59.609051 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ebb5b-b6f6-48bd-944c-f5ab5d7ad21d None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:59.611399 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-dd8ebb5b-b6f6-48bd-944c-f5ab5d7ad21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:59.624227 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ebb5b-b6f6-48bd-944c-f5ab5d7ad21d None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:59.629901 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b96519-4b28-4e3f-b5ed-c93ab778d457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:59.630970 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b96519-4b28-4e3f-b5ed-c93ab778d457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:59.631266 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b96519-4b28-4e3f-b5ed-c93ab778d457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:59.631550 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b96519-4b28-4e3f-b5ed-c93ab778d457 admin admin] PATH_INFO: `/v3/projects/4548dfefb1194ac6b087b7a331685536` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:59.633009 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b96519-4b28-4e3f-b5ed-c93ab778d457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4548dfefb1194ac6b087b7a331685536)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:59.634998 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b96519-4b28-4e3f-b5ed-c93ab778d457 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:59.721173 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-16b96519-4b28-4e3f-b5ed-c93ab778d457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4548dfefb1194ac6b087b7a331685536', 'request_id': 'req-16b96519-4b28-4e3f-b5ed-c93ab778d457'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:59.775882 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-16b96519-4b28-4e3f-b5ed-c93ab778d457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4548dfefb1194ac6b087b7a331685536', 'request_id': 'req-16b96519-4b28-4e3f-b5ed-c93ab778d457'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:59.782284 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-16b96519-4b28-4e3f-b5ed-c93ab778d457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4548dfefb1194ac6b087b7a331685536', 'request_id': 'req-16b96519-4b28-4e3f-b5ed-c93ab778d457'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:59.794410 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-16b96519-4b28-4e3f-b5ed-c93ab778d457 admin admin] The token cache is being invalidate because project 4548dfefb1194ac6b087b7a331685536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:21:59.794707 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-16b96519-4b28-4e3f-b5ed-c93ab778d457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:59.795358 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-16b96519-4b28-4e3f-b5ed-c93ab778d457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:21:59.796967 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1077/2164] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:21:59 2022] DELETE /identity/v3/projects/4548dfefb1194ac6b087b7a331685536 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:21:59.802668 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1878320-3094-48f7-b40c-a4a47c24fad6 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:59.803099 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1878320-3094-48f7-b40c-a4a47c24fad6 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:59.803237 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1878320-3094-48f7-b40c-a4a47c24fad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:59.824416 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-f1878320-3094-48f7-b40c-a4a47c24fad6 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:59.825644 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-f1878320-3094-48f7-b40c-a4a47c24fad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:59.902965 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1088/2165] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:59.912405 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f24b04-5a7d-4dad-a2c8-ec8bd6227328 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:59.912704 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f24b04-5a7d-4dad-a2c8-ec8bd6227328 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:59.913232 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f24b04-5a7d-4dad-a2c8-ec8bd6227328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:59.934870 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-29f24b04-5a7d-4dad-a2c8-ec8bd6227328 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:21:59.936968 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-29f24b04-5a7d-4dad-a2c8-ec8bd6227328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:21:59.950144 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1078/2166] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:21:59.954986 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1878320-3094-48f7-b40c-a4a47c24fad6 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:21:59.966120 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1878320-3094-48f7-b40c-a4a47c24fad6 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:21:59.974044 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26358a2-201f-4c12-a253-6c5cf63d68cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:21:59.974712 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26358a2-201f-4c12-a253-6c5cf63d68cd admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:21:59.975052 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26358a2-201f-4c12-a253-6c5cf63d68cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:21:59.975331 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26358a2-201f-4c12-a253-6c5cf63d68cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:21:59.976059 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26358a2-201f-4c12-a253-6c5cf63d68cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:21:59.976383 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26358a2-201f-4c12-a253-6c5cf63d68cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:21:59.978110 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26358a2-201f-4c12-a253-6c5cf63d68cd admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:21:59.990578 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1089/2167] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:21:59.994907 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f24b04-5a7d-4dad-a2c8-ec8bd6227328 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:00.005425 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f24b04-5a7d-4dad-a2c8-ec8bd6227328 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:00.010084 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdda536-f9ba-4726-a2a0-78e55da84b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:00.013880 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdda536-f9ba-4726-a2a0-78e55da84b95 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:00.013880 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdda536-f9ba-4726-a2a0-78e55da84b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:00.013880 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdda536-f9ba-4726-a2a0-78e55da84b95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:00.013880 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdda536-f9ba-4726-a2a0-78e55da84b95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:00.013880 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdda536-f9ba-4726-a2a0-78e55da84b95 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:00.098718 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1079/2168] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:21:59 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:22:00.103019 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26358a2-201f-4c12-a253-6c5cf63d68cd admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:00.113637 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26358a2-201f-4c12-a253-6c5cf63d68cd admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:00.172853 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b967a-fe80-4797-bb93-73ef8ce9699d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:00.173680 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b967a-fe80-4797-bb93-73ef8ce9699d admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:00.173970 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b967a-fe80-4797-bb93-73ef8ce9699d admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:00.174253 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b967a-fe80-4797-bb93-73ef8ce9699d admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:00.175021 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b967a-fe80-4797-bb93-73ef8ce9699d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:00.177108 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b967a-fe80-4797-bb93-73ef8ce9699d admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:00.279702 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1090/2169] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:22:00 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:22:00.284517 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdda536-f9ba-4726-a2a0-78e55da84b95 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:00.294943 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdda536-f9ba-4726-a2a0-78e55da84b95 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:00.300703 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02456872-7712-4994-8415-8fd2ce5ca017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:00.301427 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02456872-7712-4994-8415-8fd2ce5ca017 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:00.301712 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02456872-7712-4994-8415-8fd2ce5ca017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:00.301989 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02456872-7712-4994-8415-8fd2ce5ca017 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:00.302718 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02456872-7712-4994-8415-8fd2ce5ca017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:00.304291 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02456872-7712-4994-8415-8fd2ce5ca017 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:00.315877 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1080/2170] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:22:00.320165 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b967a-fe80-4797-bb93-73ef8ce9699d admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:00.331537 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b967a-fe80-4797-bb93-73ef8ce9699d admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:00.344328 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a66e5-8396-4a50-a705-d8d2e9615626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:00.344328 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a66e5-8396-4a50-a705-d8d2e9615626 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:00.344328 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a66e5-8396-4a50-a705-d8d2e9615626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:00.344328 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a66e5-8396-4a50-a705-d8d2e9615626 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:00.345117 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a66e5-8396-4a50-a705-d8d2e9615626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:00.345117 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a66e5-8396-4a50-a705-d8d2e9615626 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:00.366108 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1091/2171] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:22:00.367285 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02456872-7712-4994-8415-8fd2ce5ca017 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:00.379376 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02456872-7712-4994-8415-8fd2ce5ca017 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:00.384195 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7d49c-8427-4dc1-adb0-cd805524a7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:00.385232 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7d49c-8427-4dc1-adb0-cd805524a7ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:00.385637 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7d49c-8427-4dc1-adb0-cd805524a7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:00.385817 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7d49c-8427-4dc1-adb0-cd805524a7ad admin admin] PATH_INFO: `/v3/projects/2edfa256a0874cc7afc8c01ea3e810be/users/411f7901d39449bc831859d0a5d98ef9/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:00.412999 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7d49c-8427-4dc1-adb0-cd805524a7ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=2edfa256a0874cc7afc8c01ea3e810be, user_id=411f7901d39449bc831859d0a5d98ef9, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:00.415843 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7d49c-8427-4dc1-adb0-cd805524a7ad admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:00.508514 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1081/2172] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:22:00 2022] PUT /identity/v3/projects/2edfa256a0874cc7afc8c01ea3e810be/users/411f7901d39449bc831859d0a5d98ef9/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:00.515501 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524f760-e9e7-487a-ae25-98ab7372735e None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:00.516455 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524f760-e9e7-487a-ae25-98ab7372735e None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:00.516817 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524f760-e9e7-487a-ae25-98ab7372735e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:00.535357 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-f524f760-e9e7-487a-ae25-98ab7372735e None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:00.536559 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-f524f760-e9e7-487a-ae25-98ab7372735e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:00.598265 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1092/2173] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:22:00.608484 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7d49c-8427-4dc1-adb0-cd805524a7ad admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:00.611935 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-f1e7d49c-8427-4dc1-adb0-cd805524a7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:00.627509 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524f760-e9e7-487a-ae25-98ab7372735e None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:00.633094 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-f524f760-e9e7-487a-ae25-98ab7372735e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:00.647052 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524f760-e9e7-487a-ae25-98ab7372735e None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:00.652403 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4a657-9a77-4ced-b1de-459e5f3d8398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:00.653283 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4a657-9a77-4ced-b1de-459e5f3d8398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:00.653596 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4a657-9a77-4ced-b1de-459e5f3d8398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:00.653878 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4a657-9a77-4ced-b1de-459e5f3d8398 admin admin] PATH_INFO: `/v3/users/7fb235ed3ac745e786ce1035492c3883` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:00.655123 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4a657-9a77-4ced-b1de-459e5f3d8398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb235ed3ac745e786ce1035492c3883)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:00.657827 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4a657-9a77-4ced-b1de-459e5f3d8398 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:00.682615 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7d49c-8427-4dc1-adb0-cd805524a7ad admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:00.690173 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6b3d3-9daa-4d2e-ad6a-293c4a2eae5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:00.690834 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6b3d3-9daa-4d2e-ad6a-293c4a2eae5a service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:00.691117 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6b3d3-9daa-4d2e-ad6a-293c4a2eae5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:00.691394 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6b3d3-9daa-4d2e-ad6a-293c4a2eae5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:00.700977 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6b3d3-9daa-4d2e-ad6a-293c4a2eae5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:00.702453 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6b3d3-9daa-4d2e-ad6a-293c4a2eae5a service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:00.712543 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1082/2174] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:22:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:22:00.828719 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-12d4a657-9a77-4ced-b1de-459e5f3d8398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb235ed3ac745e786ce1035492c3883'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:00.907594 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-12d4a657-9a77-4ced-b1de-459e5f3d8398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb235ed3ac745e786ce1035492c3883'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:00.908520 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-12d4a657-9a77-4ced-b1de-459e5f3d8398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb235ed3ac745e786ce1035492c3883'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:00.909171 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-12d4a657-9a77-4ced-b1de-459e5f3d8398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb235ed3ac745e786ce1035492c3883'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:00.917203 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-12d4a657-9a77-4ced-b1de-459e5f3d8398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb235ed3ac745e786ce1035492c3883'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:00.935190 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1093/2175] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:22:00 2022] DELETE /identity/v3/users/7fb235ed3ac745e786ce1035492c3883 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:22:00.940517 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f1020-a82b-462c-a9fc-53cec2cd9626 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:00.940882 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f1020-a82b-462c-a9fc-53cec2cd9626 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:00.941437 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f1020-a82b-462c-a9fc-53cec2cd9626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:00.960783 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-cb2f1020-a82b-462c-a9fc-53cec2cd9626 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:00.962374 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-cb2f1020-a82b-462c-a9fc-53cec2cd9626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:01.041642 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1083/2176] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:22:01.056082 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4a657-9a77-4ced-b1de-459e5f3d8398 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:01.057861 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-12d4a657-9a77-4ced-b1de-459e5f3d8398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:01.116125 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4a657-9a77-4ced-b1de-459e5f3d8398 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:01.119766 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db87897-5ed9-4c82-b68e-7f1e4f2474dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:01.120408 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db87897-5ed9-4c82-b68e-7f1e4f2474dd service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:01.120690 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db87897-5ed9-4c82-b68e-7f1e4f2474dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:01.120966 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db87897-5ed9-4c82-b68e-7f1e4f2474dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:01.129768 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db87897-5ed9-4c82-b68e-7f1e4f2474dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:01.131184 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db87897-5ed9-4c82-b68e-7f1e4f2474dd service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:01.140234 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1094/2177] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:22:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:22:01.595295 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f1020-a82b-462c-a9fc-53cec2cd9626 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:01.596739 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-cb2f1020-a82b-462c-a9fc-53cec2cd9626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:01.608418 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f1020-a82b-462c-a9fc-53cec2cd9626 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:01.615524 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed5579-9d1c-4b49-9ac7-e423467b4121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:01.616409 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed5579-9d1c-4b49-9ac7-e423467b4121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:01.616689 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed5579-9d1c-4b49-9ac7-e423467b4121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:01.616964 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed5579-9d1c-4b49-9ac7-e423467b4121 admin admin] PATH_INFO: `/v3/users/72d59f19060c4c2dafe59b6f9553c868` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:01.618216 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed5579-9d1c-4b49-9ac7-e423467b4121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72d59f19060c4c2dafe59b6f9553c868)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:01.620377 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed5579-9d1c-4b49-9ac7-e423467b4121 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:01.733409 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db87897-5ed9-4c82-b68e-7f1e4f2474dd service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:01.735144 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-4db87897-5ed9-4c82-b68e-7f1e4f2474dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:01.756047 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db87897-5ed9-4c82-b68e-7f1e4f2474dd service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:01.760949 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364514e-f1f9-44e5-aed6-56322fcba62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:01.761851 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364514e-f1f9-44e5-aed6-56322fcba62a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:01.762139 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364514e-f1f9-44e5-aed6-56322fcba62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:01.762431 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364514e-f1f9-44e5-aed6-56322fcba62a admin admin] PATH_INFO: `/v3/projects/64ab5a95cd334437bce4c3095064e0aa` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:01.763946 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364514e-f1f9-44e5-aed6-56322fcba62a admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ab5a95cd334437bce4c3095064e0aa)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:01.766427 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364514e-f1f9-44e5-aed6-56322fcba62a admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:01.802479 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-9bed5579-9d1c-4b49-9ac7-e423467b4121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72d59f19060c4c2dafe59b6f9553c868'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:01.873843 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-9bed5579-9d1c-4b49-9ac7-e423467b4121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72d59f19060c4c2dafe59b6f9553c868'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:01.874364 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-9bed5579-9d1c-4b49-9ac7-e423467b4121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72d59f19060c4c2dafe59b6f9553c868'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:01.885078 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-9bed5579-9d1c-4b49-9ac7-e423467b4121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72d59f19060c4c2dafe59b6f9553c868'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:01.893426 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3364514e-f1f9-44e5-aed6-56322fcba62a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ab5a95cd334437bce4c3095064e0aa', 'request_id': 'req-3364514e-f1f9-44e5-aed6-56322fcba62a'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:01.904455 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3364514e-f1f9-44e5-aed6-56322fcba62a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ab5a95cd334437bce4c3095064e0aa', 'request_id': 'req-3364514e-f1f9-44e5-aed6-56322fcba62a'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:01.910922 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-9bed5579-9d1c-4b49-9ac7-e423467b4121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72d59f19060c4c2dafe59b6f9553c868'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:01.915617 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3364514e-f1f9-44e5-aed6-56322fcba62a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ab5a95cd334437bce4c3095064e0aa', 'request_id': 'req-3364514e-f1f9-44e5-aed6-56322fcba62a'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:01.917712 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1084/2178] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:22:01 2022] DELETE /identity/v3/users/72d59f19060c4c2dafe59b6f9553c868 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:01.922758 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e967de-d992-42ff-8554-d80246e53caa None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:01.923060 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e967de-d992-42ff-8554-d80246e53caa None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:01.923349 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e967de-d992-42ff-8554-d80246e53caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:01.943020 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-61e967de-d992-42ff-8554-d80246e53caa None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:01.944226 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-61e967de-d992-42ff-8554-d80246e53caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:02.014900 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1085/2179] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:22:02.026472 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e967de-d992-42ff-8554-d80246e53caa None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:02.034323 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3364514e-f1f9-44e5-aed6-56322fcba62a admin admin] The token cache is being invalidate because project 64ab5a95cd334437bce4c3095064e0aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:22:02.034323 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3364514e-f1f9-44e5-aed6-56322fcba62a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:02.034323 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3364514e-f1f9-44e5-aed6-56322fcba62a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:02.034577 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-61e967de-d992-42ff-8554-d80246e53caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:02.034654 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1095/2180] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:22:01 2022] DELETE /identity/v3/projects/64ab5a95cd334437bce4c3095064e0aa => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:22:02.037879 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e10102-53fa-408e-bae4-fb93082cffc0 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:02.039209 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e10102-53fa-408e-bae4-fb93082cffc0 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:02.039660 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e10102-53fa-408e-bae4-fb93082cffc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:02.061858 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-84e10102-53fa-408e-bae4-fb93082cffc0 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:02.063376 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-84e10102-53fa-408e-bae4-fb93082cffc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:02.071750 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1096/2181] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:22:02.079192 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57594df3-b4c2-432e-b4e9-e71aeada53ea None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:02.079463 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57594df3-b4c2-432e-b4e9-e71aeada53ea None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:02.080389 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57594df3-b4c2-432e-b4e9-e71aeada53ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:02.100648 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-57594df3-b4c2-432e-b4e9-e71aeada53ea None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:02.107953 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-57594df3-b4c2-432e-b4e9-e71aeada53ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:02.113259 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e967de-d992-42ff-8554-d80246e53caa None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:02.121789 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727a90d-d147-4290-a12f-8674914527f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:02.122397 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727a90d-d147-4290-a12f-8674914527f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:02.122794 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727a90d-d147-4290-a12f-8674914527f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:02.123308 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727a90d-d147-4290-a12f-8674914527f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:02.133694 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1097/2182] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:22:02.134342 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-d727a90d-d147-4290-a12f-8674914527f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:02.138142 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57594df3-b4c2-432e-b4e9-e71aeada53ea None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:02.148624 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57594df3-b4c2-432e-b4e9-e71aeada53ea None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:02.154119 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2c936-9a95-43c1-bd8e-ef408ef4e061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:02.155070 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2c936-9a95-43c1-bd8e-ef408ef4e061 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:02.155516 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2c936-9a95-43c1-bd8e-ef408ef4e061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:02.155934 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2c936-9a95-43c1-bd8e-ef408ef4e061 admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:02.157487 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2c936-9a95-43c1-bd8e-ef408ef4e061 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:22:02.157954 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2c936-9a95-43c1-bd8e-ef408ef4e061 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:02.159860 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2c936-9a95-43c1-bd8e-ef408ef4e061 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:02.162271 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727a90d-d147-4290-a12f-8674914527f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:02.164047 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727a90d-d147-4290-a12f-8674914527f3 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:02.174846 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1098/2183] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:22:02.179816 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1086/2184] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:22:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:22:02.181534 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2c936-9a95-43c1-bd8e-ef408ef4e061 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:02.208108 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2c936-9a95-43c1-bd8e-ef408ef4e061 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:02.217064 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9226d-2484-4816-9c83-4ba3b6bde9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:02.218048 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9226d-2484-4816-9c83-4ba3b6bde9d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:02.220105 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9226d-2484-4816-9c83-4ba3b6bde9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:02.220599 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9226d-2484-4816-9c83-4ba3b6bde9d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:02.221485 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9226d-2484-4816-9c83-4ba3b6bde9d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:02.224048 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9226d-2484-4816-9c83-4ba3b6bde9d0 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:02.327140 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1099/2185] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:22:02 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:22:02.333747 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727a90d-d147-4290-a12f-8674914527f3 service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:02.345441 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727a90d-d147-4290-a12f-8674914527f3 service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:02.421093 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6dcf1-02d1-4d8b-ab4f-73f2735f2cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:02.422326 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6dcf1-02d1-4d8b-ab4f-73f2735f2cec admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:02.422615 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6dcf1-02d1-4d8b-ab4f-73f2735f2cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:02.422912 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6dcf1-02d1-4d8b-ab4f-73f2735f2cec admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:02.423706 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f6dcf1-02d1-4d8b-ab4f-73f2735f2cec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:02.425685 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f6dcf1-02d1-4d8b-ab4f-73f2735f2cec admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:02.526220 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1087/2186] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:22:02 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:22:02.530523 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9226d-2484-4816-9c83-4ba3b6bde9d0 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:02.543175 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9226d-2484-4816-9c83-4ba3b6bde9d0 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:02.550776 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a623f-b467-405a-9a96-307911e35216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:02.551468 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a623f-b467-405a-9a96-307911e35216 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:02.551755 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a623f-b467-405a-9a96-307911e35216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:02.552151 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a623f-b467-405a-9a96-307911e35216 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:02.557718 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a623f-b467-405a-9a96-307911e35216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:02.557718 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a623f-b467-405a-9a96-307911e35216 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:02.569956 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1100/2187] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:22:02.571797 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6dcf1-02d1-4d8b-ab4f-73f2735f2cec admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:02.591482 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6dcf1-02d1-4d8b-ab4f-73f2735f2cec admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:02.597552 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5debe-c85c-493d-bbdf-a81812c6a38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:02.598237 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5debe-c85c-493d-bbdf-a81812c6a38f admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:02.598496 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5debe-c85c-493d-bbdf-a81812c6a38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:02.598858 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5debe-c85c-493d-bbdf-a81812c6a38f admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:02.599594 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5debe-c85c-493d-bbdf-a81812c6a38f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:02.601440 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5debe-c85c-493d-bbdf-a81812c6a38f admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:02.620607 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1088/2188] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:22:02.629429 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a623f-b467-405a-9a96-307911e35216 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:02.641238 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a623f-b467-405a-9a96-307911e35216 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:02.649171 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba99c7-09af-41dd-80da-55edad72f18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:02.650192 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba99c7-09af-41dd-80da-55edad72f18d admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:02.650484 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba99c7-09af-41dd-80da-55edad72f18d admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:02.650761 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba99c7-09af-41dd-80da-55edad72f18d admin admin] PATH_INFO: `/v3/projects/07e3fca5275b42acb350be93689e8567/users/7c74937b21f34446806f690a03e6ce6d/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:02.671388 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba99c7-09af-41dd-80da-55edad72f18d admin admin] RBAC: Authorizing `identity:create_grant(project_id=07e3fca5275b42acb350be93689e8567, user_id=7c74937b21f34446806f690a03e6ce6d, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:02.676507 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba99c7-09af-41dd-80da-55edad72f18d admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:02.797913 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1101/2189] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:22:02 2022] PUT /identity/v3/projects/07e3fca5275b42acb350be93689e8567/users/7c74937b21f34446806f690a03e6ce6d/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:02.806625 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197afdec-7a6c-4aec-be0e-9c3a4e853a6e None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:02.807263 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197afdec-7a6c-4aec-be0e-9c3a4e853a6e None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:02.807766 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197afdec-7a6c-4aec-be0e-9c3a4e853a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:02.840345 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-197afdec-7a6c-4aec-be0e-9c3a4e853a6e None None] MFA Rules not processed for user `7c74937b21f34446806f690a03e6ce6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:02.841840 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-197afdec-7a6c-4aec-be0e-9c3a4e853a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:02.936085 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1089/2190] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:22:02.946744 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba99c7-09af-41dd-80da-55edad72f18d admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:02.949215 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-76ba99c7-09af-41dd-80da-55edad72f18d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:03.012061 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba99c7-09af-41dd-80da-55edad72f18d admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:03.015933 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d7232-37dc-4989-aa9a-b76116f3d577 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:03.016690 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d7232-37dc-4989-aa9a-b76116f3d577 service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:03.020344 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d7232-37dc-4989-aa9a-b76116f3d577 service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:03.020344 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d7232-37dc-4989-aa9a-b76116f3d577 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:03.026851 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d7232-37dc-4989-aa9a-b76116f3d577 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:03.028387 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d7232-37dc-4989-aa9a-b76116f3d577 service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:03.042152 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197afdec-7a6c-4aec-be0e-9c3a4e853a6e None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:03.043687 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-197afdec-7a6c-4aec-be0e-9c3a4e853a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:03.059548 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1102/2191] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:22:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:22:03.137588 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197afdec-7a6c-4aec-be0e-9c3a4e853a6e None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:03.142567 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d083a0a-1043-4d02-8663-d0cac0146a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:03.143626 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d083a0a-1043-4d02-8663-d0cac0146a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:03.143921 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d083a0a-1043-4d02-8663-d0cac0146a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:03.144345 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d083a0a-1043-4d02-8663-d0cac0146a3b admin admin] PATH_INFO: `/v3/projects/421b54cdd049421cad2446abc5a98ad5` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:03.145777 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d083a0a-1043-4d02-8663-d0cac0146a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=421b54cdd049421cad2446abc5a98ad5)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:03.147686 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d083a0a-1043-4d02-8663-d0cac0146a3b admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:03.275611 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8d083a0a-1043-4d02-8663-d0cac0146a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '421b54cdd049421cad2446abc5a98ad5', 'request_id': 'req-8d083a0a-1043-4d02-8663-d0cac0146a3b'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:03.388219 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8d083a0a-1043-4d02-8663-d0cac0146a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '421b54cdd049421cad2446abc5a98ad5', 'request_id': 'req-8d083a0a-1043-4d02-8663-d0cac0146a3b'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:03.411061 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8d083a0a-1043-4d02-8663-d0cac0146a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '421b54cdd049421cad2446abc5a98ad5', 'request_id': 'req-8d083a0a-1043-4d02-8663-d0cac0146a3b'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:03.434957 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8d083a0a-1043-4d02-8663-d0cac0146a3b admin admin] The token cache is being invalidate because project 421b54cdd049421cad2446abc5a98ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:22:03.435323 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8d083a0a-1043-4d02-8663-d0cac0146a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:03.437940 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8d083a0a-1043-4d02-8663-d0cac0146a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:03.449101 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1090/2192] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:22:03 2022] DELETE /identity/v3/projects/421b54cdd049421cad2446abc5a98ad5 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:03.451647 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d7232-37dc-4989-aa9a-b76116f3d577 service cinder] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:03.466975 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d7232-37dc-4989-aa9a-b76116f3d577 service cinder] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:03.600649 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae9c0c-fb05-4acc-a141-875159390f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:03.601655 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae9c0c-fb05-4acc-a141-875159390f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:03.601939 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae9c0c-fb05-4acc-a141-875159390f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:03.602217 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae9c0c-fb05-4acc-a141-875159390f5f admin admin] PATH_INFO: `/v3/users/4cae2ed3172a4a5d8d8383bbf1568ce3` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:03.604979 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae9c0c-fb05-4acc-a141-875159390f5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cae2ed3172a4a5d8d8383bbf1568ce3)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:03.607219 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae9c0c-fb05-4acc-a141-875159390f5f admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:03.902851 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a1ae9c0c-fb05-4acc-a141-875159390f5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cae2ed3172a4a5d8d8383bbf1568ce3'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:04.005233 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a1ae9c0c-fb05-4acc-a141-875159390f5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cae2ed3172a4a5d8d8383bbf1568ce3'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:04.006682 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a1ae9c0c-fb05-4acc-a141-875159390f5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cae2ed3172a4a5d8d8383bbf1568ce3'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:04.017018 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a1ae9c0c-fb05-4acc-a141-875159390f5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cae2ed3172a4a5d8d8383bbf1568ce3'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:04.017018 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a1ae9c0c-fb05-4acc-a141-875159390f5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cae2ed3172a4a5d8d8383bbf1568ce3'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:04.039903 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1103/2193] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:22:03 2022] DELETE /identity/v3/users/4cae2ed3172a4a5d8d8383bbf1568ce3 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:04.570510 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d083a0a-1043-4d02-8663-d0cac0146a3b admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:04.572713 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-8d083a0a-1043-4d02-8663-d0cac0146a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:04.596732 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d083a0a-1043-4d02-8663-d0cac0146a3b admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:04.694450 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fef70b-0f26-44b3-84e2-d32e4e8cc9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:04.696005 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fef70b-0f26-44b3-84e2-d32e4e8cc9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:04.696535 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fef70b-0f26-44b3-84e2-d32e4e8cc9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:04.696924 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fef70b-0f26-44b3-84e2-d32e4e8cc9ff admin admin] PATH_INFO: `/v3/projects/24c1095ad6c842d497eabf4c5b258ebd` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:04.698301 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fef70b-0f26-44b3-84e2-d32e4e8cc9ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=24c1095ad6c842d497eabf4c5b258ebd)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:04.700416 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fef70b-0f26-44b3-84e2-d32e4e8cc9ff admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:04.811938 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-84fef70b-0f26-44b3-84e2-d32e4e8cc9ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24c1095ad6c842d497eabf4c5b258ebd', 'request_id': 'req-84fef70b-0f26-44b3-84e2-d32e4e8cc9ff'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:04.885007 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-84fef70b-0f26-44b3-84e2-d32e4e8cc9ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24c1095ad6c842d497eabf4c5b258ebd', 'request_id': 'req-84fef70b-0f26-44b3-84e2-d32e4e8cc9ff'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:04.894447 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-84fef70b-0f26-44b3-84e2-d32e4e8cc9ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24c1095ad6c842d497eabf4c5b258ebd', 'request_id': 'req-84fef70b-0f26-44b3-84e2-d32e4e8cc9ff'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:04.938190 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-84fef70b-0f26-44b3-84e2-d32e4e8cc9ff admin admin] The token cache is being invalidate because project 24c1095ad6c842d497eabf4c5b258ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:22:04.938644 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-84fef70b-0f26-44b3-84e2-d32e4e8cc9ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:04.939489 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-84fef70b-0f26-44b3-84e2-d32e4e8cc9ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:04.947293 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1091/2194] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:22:04 2022] DELETE /identity/v3/projects/24c1095ad6c842d497eabf4c5b258ebd => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:04.951301 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae9c0c-fb05-4acc-a141-875159390f5f admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:04.953363 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a1ae9c0c-fb05-4acc-a141-875159390f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:04.969167 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae9c0c-fb05-4acc-a141-875159390f5f admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:05.086955 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7ce64-a700-4a9f-922e-bef5ebba7221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:05.088660 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7ce64-a700-4a9f-922e-bef5ebba7221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:05.089129 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7ce64-a700-4a9f-922e-bef5ebba7221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:05.089606 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7ce64-a700-4a9f-922e-bef5ebba7221 admin admin] PATH_INFO: `/v3/users/8e3361321d8c4d3b8ae7fc857d811a4f` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:05.091129 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7ce64-a700-4a9f-922e-bef5ebba7221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e3361321d8c4d3b8ae7fc857d811a4f)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:05.094332 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7ce64-a700-4a9f-922e-bef5ebba7221 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:05.281672 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-cff7ce64-a700-4a9f-922e-bef5ebba7221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e3361321d8c4d3b8ae7fc857d811a4f'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:05.331088 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-cff7ce64-a700-4a9f-922e-bef5ebba7221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e3361321d8c4d3b8ae7fc857d811a4f'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:05.332131 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-cff7ce64-a700-4a9f-922e-bef5ebba7221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e3361321d8c4d3b8ae7fc857d811a4f'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:05.332945 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-cff7ce64-a700-4a9f-922e-bef5ebba7221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e3361321d8c4d3b8ae7fc857d811a4f'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:05.342220 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-cff7ce64-a700-4a9f-922e-bef5ebba7221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e3361321d8c4d3b8ae7fc857d811a4f'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:05.362404 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1104/2195] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:22:04 2022] DELETE /identity/v3/users/8e3361321d8c4d3b8ae7fc857d811a4f => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:05.818716 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fef70b-0f26-44b3-84e2-d32e4e8cc9ff admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:05.820470 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-84fef70b-0f26-44b3-84e2-d32e4e8cc9ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:05.857543 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fef70b-0f26-44b3-84e2-d32e4e8cc9ff admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:05.942055 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78cf34-2c7d-4711-9389-c703884242f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:05.943139 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78cf34-2c7d-4711-9389-c703884242f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:05.943520 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78cf34-2c7d-4711-9389-c703884242f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:05.943989 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78cf34-2c7d-4711-9389-c703884242f2 admin admin] PATH_INFO: `/v3/projects/880d7e66b3a544869450b7dd3eadf60e` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:05.956925 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78cf34-2c7d-4711-9389-c703884242f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=880d7e66b3a544869450b7dd3eadf60e)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:05.956925 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78cf34-2c7d-4711-9389-c703884242f2 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:06.090567 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-eb78cf34-2c7d-4711-9389-c703884242f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '880d7e66b3a544869450b7dd3eadf60e', 'request_id': 'req-eb78cf34-2c7d-4711-9389-c703884242f2'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:06.159538 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-eb78cf34-2c7d-4711-9389-c703884242f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '880d7e66b3a544869450b7dd3eadf60e', 'request_id': 'req-eb78cf34-2c7d-4711-9389-c703884242f2'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:06.167797 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-eb78cf34-2c7d-4711-9389-c703884242f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '880d7e66b3a544869450b7dd3eadf60e', 'request_id': 'req-eb78cf34-2c7d-4711-9389-c703884242f2'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:06.181916 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-eb78cf34-2c7d-4711-9389-c703884242f2 admin admin] The token cache is being invalidate because project 880d7e66b3a544869450b7dd3eadf60e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:22:06.182368 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-eb78cf34-2c7d-4711-9389-c703884242f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:06.183205 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-eb78cf34-2c7d-4711-9389-c703884242f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:06.186229 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1092/2196] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:22:05 2022] DELETE /identity/v3/projects/880d7e66b3a544869450b7dd3eadf60e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:06.191872 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107d626-72d3-444d-b50a-45e68506e530 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:06.192668 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107d626-72d3-444d-b50a-45e68506e530 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:06.193084 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107d626-72d3-444d-b50a-45e68506e530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:06.226677 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-5107d626-72d3-444d-b50a-45e68506e530 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:06.227919 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-5107d626-72d3-444d-b50a-45e68506e530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:06.320117 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1105/2197] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:22:06.331398 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fd6c9-30e7-4c21-b57b-e00dce185092 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:06.331717 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fd6c9-30e7-4c21-b57b-e00dce185092 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:06.332002 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fd6c9-30e7-4c21-b57b-e00dce185092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:06.361177 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-ca7fd6c9-30e7-4c21-b57b-e00dce185092 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:06.362642 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-ca7fd6c9-30e7-4c21-b57b-e00dce185092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:06.384766 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1093/2198] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:22:06.386167 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5107d626-72d3-444d-b50a-45e68506e530 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:06.398775 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5107d626-72d3-444d-b50a-45e68506e530 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:06.412517 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53ea90-a761-4f10-80e1-098fcd76cd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:06.413492 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53ea90-a761-4f10-80e1-098fcd76cd57 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:06.413994 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53ea90-a761-4f10-80e1-098fcd76cd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:06.414485 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53ea90-a761-4f10-80e1-098fcd76cd57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:06.415451 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53ea90-a761-4f10-80e1-098fcd76cd57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:22:06.415995 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53ea90-a761-4f10-80e1-098fcd76cd57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:06.418805 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53ea90-a761-4f10-80e1-098fcd76cd57 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:06.438060 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1106/2199] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:22:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:22:06.442508 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fd6c9-30e7-4c21-b57b-e00dce185092 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:06.453678 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fd6c9-30e7-4c21-b57b-e00dce185092 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:06.458764 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf5836-a85d-4578-9917-f12b7eb9c56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:06.459444 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf5836-a85d-4578-9917-f12b7eb9c56d admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:06.459866 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf5836-a85d-4578-9917-f12b7eb9c56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:06.460096 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf5836-a85d-4578-9917-f12b7eb9c56d admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:06.460809 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf5836-a85d-4578-9917-f12b7eb9c56d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:06.463644 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf5836-a85d-4578-9917-f12b7eb9c56d admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:06.550410 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1094/2200] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:22:06 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:22:06.550634 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53ea90-a761-4f10-80e1-098fcd76cd57 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:06.565689 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53ea90-a761-4f10-80e1-098fcd76cd57 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:06.666359 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c43600-58d8-4a58-973b-5922dd24d028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:06.667064 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c43600-58d8-4a58-973b-5922dd24d028 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:06.667345 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c43600-58d8-4a58-973b-5922dd24d028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:06.667621 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c43600-58d8-4a58-973b-5922dd24d028 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:06.668323 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c43600-58d8-4a58-973b-5922dd24d028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:06.670496 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c43600-58d8-4a58-973b-5922dd24d028 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:06.754828 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1107/2201] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:22:06 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:22:06.759209 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf5836-a85d-4578-9917-f12b7eb9c56d admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:06.770480 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf5836-a85d-4578-9917-f12b7eb9c56d admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:06.776728 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15a196-3004-49d7-826d-75eca6a1ffce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:06.777458 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15a196-3004-49d7-826d-75eca6a1ffce admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:06.777717 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15a196-3004-49d7-826d-75eca6a1ffce admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:06.778001 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15a196-3004-49d7-826d-75eca6a1ffce admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:06.778801 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15a196-3004-49d7-826d-75eca6a1ffce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:06.780823 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15a196-3004-49d7-826d-75eca6a1ffce admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:06.794138 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1095/2202] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:22:06.798422 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c43600-58d8-4a58-973b-5922dd24d028 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:06.809496 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c43600-58d8-4a58-973b-5922dd24d028 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:06.815478 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c4a49-bffc-42d3-ae8a-32d9b6f13f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:06.816149 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c4a49-bffc-42d3-ae8a-32d9b6f13f5a admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:06.816435 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c4a49-bffc-42d3-ae8a-32d9b6f13f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:06.816732 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c4a49-bffc-42d3-ae8a-32d9b6f13f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:06.817509 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c4a49-bffc-42d3-ae8a-32d9b6f13f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:06.819319 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c4a49-bffc-42d3-ae8a-32d9b6f13f5a admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:06.834084 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1108/2203] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:22:06.835161 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15a196-3004-49d7-826d-75eca6a1ffce admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:06.846191 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15a196-3004-49d7-826d-75eca6a1ffce admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:06.854425 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15baa8bb-c42e-4012-9570-10e102b23adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:06.855655 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baa8bb-c42e-4012-9570-10e102b23adc admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:06.856162 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baa8bb-c42e-4012-9570-10e102b23adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:06.857066 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baa8bb-c42e-4012-9570-10e102b23adc admin admin] PATH_INFO: `/v3/projects/4fa1deb2c93e4fa697f73509496d004a/users/36eec2606934496eb8238f2b198a7762/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:06.880679 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15baa8bb-c42e-4012-9570-10e102b23adc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fa1deb2c93e4fa697f73509496d004a, user_id=36eec2606934496eb8238f2b198a7762, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:06.886052 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15baa8bb-c42e-4012-9570-10e102b23adc admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:06.964720 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1096/2204] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:22:06 2022] PUT /identity/v3/projects/4fa1deb2c93e4fa697f73509496d004a/users/36eec2606934496eb8238f2b198a7762/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:06.977652 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6436b-1f9d-4006-82aa-08ebf935f5b0 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:06.978003 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6436b-1f9d-4006-82aa-08ebf935f5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:06.978296 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6436b-1f9d-4006-82aa-08ebf935f5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:07.017792 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-b5c6436b-1f9d-4006-82aa-08ebf935f5b0 None None] MFA Rules not processed for user `36eec2606934496eb8238f2b198a7762`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:07.019012 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b5c6436b-1f9d-4006-82aa-08ebf935f5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:07.113787 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1109/2205] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:22:07.117870 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15baa8bb-c42e-4012-9570-10e102b23adc admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:07.117870 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-15baa8bb-c42e-4012-9570-10e102b23adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:07.228972 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15baa8bb-c42e-4012-9570-10e102b23adc admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:07.235565 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa41658-d28c-4ac8-bb13-af5f45f04185 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b169395c92c4fbfbbe4fd14a235f81f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:07.236502 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa41658-d28c-4ac8-bb13-af5f45f04185 service glance] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:07.240047 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa41658-d28c-4ac8-bb13-af5f45f04185 service glance] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:07.241709 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa41658-d28c-4ac8-bb13-af5f45f04185 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:07.283179 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa41658-d28c-4ac8-bb13-af5f45f04185 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:07.286767 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa41658-d28c-4ac8-bb13-af5f45f04185 service glance] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:07.324805 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1097/2206] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:22:07 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:22:07.574066 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6158f-f6bb-413d-91dc-1b07cc427337 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:07.575032 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6158f-f6bb-413d-91dc-1b07cc427337 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:07.575615 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6158f-f6bb-413d-91dc-1b07cc427337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:07.614197 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-17d6158f-f6bb-413d-91dc-1b07cc427337 None None] MFA Rules not processed for user `411f7901d39449bc831859d0a5d98ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:07.615944 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-17d6158f-f6bb-413d-91dc-1b07cc427337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:07.735436 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1110/2207] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:22:07.740015 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa41658-d28c-4ac8-bb13-af5f45f04185 service glance] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:07.742696 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-5aa41658-d28c-4ac8-bb13-af5f45f04185 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:07.858597 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa41658-d28c-4ac8-bb13-af5f45f04185 service glance] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:07.864417 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedb2b9-6565-47bf-80ff-235937d4ec98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:07.865188 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedb2b9-6565-47bf-80ff-235937d4ec98 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:07.865581 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedb2b9-6565-47bf-80ff-235937d4ec98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:07.866057 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedb2b9-6565-47bf-80ff-235937d4ec98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:07.866992 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fedb2b9-6565-47bf-80ff-235937d4ec98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:07.869001 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fedb2b9-6565-47bf-80ff-235937d4ec98 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:07.980767 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1098/2208] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:22:07 2022] POST /identity/v3/projects => generated 373 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:22:07.986095 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6158f-f6bb-413d-91dc-1b07cc427337 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:07.999161 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6158f-f6bb-413d-91dc-1b07cc427337 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:08.084071 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296dd22-bf87-44db-a3d1-6fef2abfed0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:08.087129 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296dd22-bf87-44db-a3d1-6fef2abfed0a admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:08.087129 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296dd22-bf87-44db-a3d1-6fef2abfed0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:08.087129 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296dd22-bf87-44db-a3d1-6fef2abfed0a admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:08.087129 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296dd22-bf87-44db-a3d1-6fef2abfed0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:08.088958 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296dd22-bf87-44db-a3d1-6fef2abfed0a admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:08.181794 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1111/2209] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:22:07 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:22:08.185915 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedb2b9-6565-47bf-80ff-235937d4ec98 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:08.197252 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedb2b9-6565-47bf-80ff-235937d4ec98 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:08.203259 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3645c-c5e4-427e-b2a0-a486b884d10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:08.203945 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3645c-c5e4-427e-b2a0-a486b884d10b admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:08.204236 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3645c-c5e4-427e-b2a0-a486b884d10b admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:08.204516 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3645c-c5e4-427e-b2a0-a486b884d10b admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:08.205250 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3645c-c5e4-427e-b2a0-a486b884d10b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:08.206925 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3645c-c5e4-427e-b2a0-a486b884d10b admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:08.218005 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1099/2210] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:22:08.222877 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296dd22-bf87-44db-a3d1-6fef2abfed0a admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:08.234613 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296dd22-bf87-44db-a3d1-6fef2abfed0a admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:08.239313 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5e877-1c93-4824-86fc-87c2b6887cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:08.240198 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5e877-1c93-4824-86fc-87c2b6887cf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:08.240484 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5e877-1c93-4824-86fc-87c2b6887cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:08.240762 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5e877-1c93-4824-86fc-87c2b6887cf3 admin admin] PATH_INFO: `/v3/projects/24043468612f42a688144ebaf9ce4c6b/users/f53e5c9cebdb405aacf39c5f1b0e3fb1/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:08.258454 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5e877-1c93-4824-86fc-87c2b6887cf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24043468612f42a688144ebaf9ce4c6b, user_id=f53e5c9cebdb405aacf39c5f1b0e3fb1, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:08.262142 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5e877-1c93-4824-86fc-87c2b6887cf3 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:08.338373 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1112/2211] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:22:08 2022] PUT /identity/v3/projects/24043468612f42a688144ebaf9ce4c6b/users/f53e5c9cebdb405aacf39c5f1b0e3fb1/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:22:08.342557 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3645c-c5e4-427e-b2a0-a486b884d10b admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:08.355085 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3645c-c5e4-427e-b2a0-a486b884d10b admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:08.410441 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5e877-1c93-4824-86fc-87c2b6887cf3 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:08.412440 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-34f5e877-1c93-4824-86fc-87c2b6887cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:08.451609 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f308fa2-8500-4bcc-8f1a-1823c4dc6b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:08.453100 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f308fa2-8500-4bcc-8f1a-1823c4dc6b97 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:08.453663 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f308fa2-8500-4bcc-8f1a-1823c4dc6b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:08.454176 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f308fa2-8500-4bcc-8f1a-1823c4dc6b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:08.455103 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f308fa2-8500-4bcc-8f1a-1823c4dc6b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:08.456767 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f308fa2-8500-4bcc-8f1a-1823c4dc6b97 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:08.467141 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1100/2212] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:22:08.478005 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f308fa2-8500-4bcc-8f1a-1823c4dc6b97 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:08.488610 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5e877-1c93-4824-86fc-87c2b6887cf3 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:08.488762 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f308fa2-8500-4bcc-8f1a-1823c4dc6b97 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:08.493247 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff1574-c962-4891-a865-c84b80049505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:08.493696 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654d8f9-b4ed-471d-9284-242f7fa60922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:08.494147 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff1574-c962-4891-a865-c84b80049505 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:08.494434 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff1574-c962-4891-a865-c84b80049505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:08.494582 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654d8f9-b4ed-471d-9284-242f7fa60922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:08.494708 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff1574-c962-4891-a865-c84b80049505 admin admin] PATH_INFO: `/v3/projects/24043468612f42a688144ebaf9ce4c6b/users/f53e5c9cebdb405aacf39c5f1b0e3fb1/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:08.494868 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654d8f9-b4ed-471d-9284-242f7fa60922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:08.495149 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654d8f9-b4ed-471d-9284-242f7fa60922 admin admin] PATH_INFO: `/v3/users/536e1772be514dafb6a96aa344f8f1bb` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:08.496443 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654d8f9-b4ed-471d-9284-242f7fa60922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=536e1772be514dafb6a96aa344f8f1bb)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:08.496701 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff1574-c962-4891-a865-c84b80049505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24043468612f42a688144ebaf9ce4c6b, user_id=f53e5c9cebdb405aacf39c5f1b0e3fb1, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:08.498767 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654d8f9-b4ed-471d-9284-242f7fa60922 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:08.501046 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff1574-c962-4891-a865-c84b80049505 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:08.537347 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1101/2213] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:22:08 2022] PUT /identity/v3/projects/24043468612f42a688144ebaf9ce4c6b/users/f53e5c9cebdb405aacf39c5f1b0e3fb1/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:22:08.719711 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-2654d8f9-b4ed-471d-9284-242f7fa60922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '536e1772be514dafb6a96aa344f8f1bb'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:08.782371 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-2654d8f9-b4ed-471d-9284-242f7fa60922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '536e1772be514dafb6a96aa344f8f1bb'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:08.783001 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-2654d8f9-b4ed-471d-9284-242f7fa60922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '536e1772be514dafb6a96aa344f8f1bb'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:08.783608 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-2654d8f9-b4ed-471d-9284-242f7fa60922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '536e1772be514dafb6a96aa344f8f1bb'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:08.793023 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-2654d8f9-b4ed-471d-9284-242f7fa60922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '536e1772be514dafb6a96aa344f8f1bb'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:08.825347 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1113/2214] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:22:08 2022] DELETE /identity/v3/users/536e1772be514dafb6a96aa344f8f1bb => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:09.146428 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff1574-c962-4891-a865-c84b80049505 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:09.150276 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-ddff1574-c962-4891-a865-c84b80049505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:09.242418 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff1574-c962-4891-a865-c84b80049505 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:09.313071 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f773268-8745-4953-b99c-d220c6623ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:09.314283 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f773268-8745-4953-b99c-d220c6623ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:09.314713 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f773268-8745-4953-b99c-d220c6623ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:09.315187 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f773268-8745-4953-b99c-d220c6623ce7 admin admin] PATH_INFO: `/v3/projects/c5201bb0cc75420e8fd9b8af2c5840ad` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:09.316432 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f773268-8745-4953-b99c-d220c6623ce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5201bb0cc75420e8fd9b8af2c5840ad)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:09.318730 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f773268-8745-4953-b99c-d220c6623ce7 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:09.452035 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-2f773268-8745-4953-b99c-d220c6623ce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5201bb0cc75420e8fd9b8af2c5840ad', 'request_id': 'req-2f773268-8745-4953-b99c-d220c6623ce7'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:09.549642 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-2f773268-8745-4953-b99c-d220c6623ce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5201bb0cc75420e8fd9b8af2c5840ad', 'request_id': 'req-2f773268-8745-4953-b99c-d220c6623ce7'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:09.559807 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-2f773268-8745-4953-b99c-d220c6623ce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5201bb0cc75420e8fd9b8af2c5840ad', 'request_id': 'req-2f773268-8745-4953-b99c-d220c6623ce7'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:09.572531 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-2f773268-8745-4953-b99c-d220c6623ce7 admin admin] The token cache is being invalidate because project c5201bb0cc75420e8fd9b8af2c5840ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:22:09.573077 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-2f773268-8745-4953-b99c-d220c6623ce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:09.574821 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-2f773268-8745-4953-b99c-d220c6623ce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:09.577034 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1102/2215] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:22:09 2022] DELETE /identity/v3/projects/c5201bb0cc75420e8fd9b8af2c5840ad => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:09.582537 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654d8f9-b4ed-471d-9284-242f7fa60922 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:09.603579 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654d8f9-b4ed-471d-9284-242f7fa60922 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:09.689918 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027217b-461b-4bd9-bf2b-81893aac6e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:09.691436 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027217b-461b-4bd9-bf2b-81893aac6e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:09.692216 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027217b-461b-4bd9-bf2b-81893aac6e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:09.692509 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027217b-461b-4bd9-bf2b-81893aac6e32 admin admin] PATH_INFO: `/v3/users/c8ffbc6b63954f3b863a39f851419ac0` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:09.694438 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027217b-461b-4bd9-bf2b-81893aac6e32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8ffbc6b63954f3b863a39f851419ac0)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:09.698153 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027217b-461b-4bd9-bf2b-81893aac6e32 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:09.914928 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7027217b-461b-4bd9-bf2b-81893aac6e32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8ffbc6b63954f3b863a39f851419ac0'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:09.987592 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7027217b-461b-4bd9-bf2b-81893aac6e32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8ffbc6b63954f3b863a39f851419ac0'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:09.988546 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7027217b-461b-4bd9-bf2b-81893aac6e32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8ffbc6b63954f3b863a39f851419ac0'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:09.989496 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7027217b-461b-4bd9-bf2b-81893aac6e32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8ffbc6b63954f3b863a39f851419ac0'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:10.007871 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7027217b-461b-4bd9-bf2b-81893aac6e32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8ffbc6b63954f3b863a39f851419ac0'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:10.050361 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1114/2216] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:22:09 2022] DELETE /identity/v3/users/c8ffbc6b63954f3b863a39f851419ac0 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:10.402397 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f773268-8745-4953-b99c-d220c6623ce7 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:10.407052 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-2f773268-8745-4953-b99c-d220c6623ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:10.431693 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f773268-8745-4953-b99c-d220c6623ce7 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:10.548392 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f8e66-8598-450a-8838-6503a89ae8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:10.549500 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f8e66-8598-450a-8838-6503a89ae8d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:10.549859 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f8e66-8598-450a-8838-6503a89ae8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:10.550236 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f8e66-8598-450a-8838-6503a89ae8d6 admin admin] PATH_INFO: `/v3/projects/f1a4b9943a19442f8d660033054c7ae3` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:10.551623 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f8e66-8598-450a-8838-6503a89ae8d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1a4b9943a19442f8d660033054c7ae3)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:10.553800 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f8e66-8598-450a-8838-6503a89ae8d6 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:10.721556 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-293f8e66-8598-450a-8838-6503a89ae8d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1a4b9943a19442f8d660033054c7ae3', 'request_id': 'req-293f8e66-8598-450a-8838-6503a89ae8d6'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:10.809957 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-293f8e66-8598-450a-8838-6503a89ae8d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1a4b9943a19442f8d660033054c7ae3', 'request_id': 'req-293f8e66-8598-450a-8838-6503a89ae8d6'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:10.820273 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-293f8e66-8598-450a-8838-6503a89ae8d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1a4b9943a19442f8d660033054c7ae3', 'request_id': 'req-293f8e66-8598-450a-8838-6503a89ae8d6'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:10.835592 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-293f8e66-8598-450a-8838-6503a89ae8d6 admin admin] The token cache is being invalidate because project f1a4b9943a19442f8d660033054c7ae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:22:10.836189 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-293f8e66-8598-450a-8838-6503a89ae8d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:10.837436 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-293f8e66-8598-450a-8838-6503a89ae8d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:10.843777 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1103/2217] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:22:10 2022] DELETE /identity/v3/projects/f1a4b9943a19442f8d660033054c7ae3 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:10.846559 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f640a0-7d4b-4afb-a8d0-453858c1eef4 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:10.846559 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f640a0-7d4b-4afb-a8d0-453858c1eef4 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:10.847200 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f640a0-7d4b-4afb-a8d0-453858c1eef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:10.875352 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-e9f640a0-7d4b-4afb-a8d0-453858c1eef4 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:10.875352 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e9f640a0-7d4b-4afb-a8d0-453858c1eef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:11.020719 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1115/2218] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:22:11.029428 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53fdd2-6865-4e56-b9cd-c870f4d9077c None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:11.029927 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53fdd2-6865-4e56-b9cd-c870f4d9077c None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:11.030288 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53fdd2-6865-4e56-b9cd-c870f4d9077c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:11.052572 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-7e53fdd2-6865-4e56-b9cd-c870f4d9077c None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:11.053935 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-7e53fdd2-6865-4e56-b9cd-c870f4d9077c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:11.067508 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1104/2219] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:22:11.069013 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f640a0-7d4b-4afb-a8d0-453858c1eef4 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:11.080097 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f640a0-7d4b-4afb-a8d0-453858c1eef4 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:11.086159 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a634e80-5af6-4278-9dfd-a33e96a77741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:11.087337 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a634e80-5af6-4278-9dfd-a33e96a77741 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:11.087707 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a634e80-5af6-4278-9dfd-a33e96a77741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:11.087993 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a634e80-5af6-4278-9dfd-a33e96a77741 admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:11.097560 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a634e80-5af6-4278-9dfd-a33e96a77741 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:22:11.097560 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a634e80-5af6-4278-9dfd-a33e96a77741 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:11.097560 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a634e80-5af6-4278-9dfd-a33e96a77741 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:11.109647 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1116/2220] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:22:11.113068 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53fdd2-6865-4e56-b9cd-c870f4d9077c None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:11.126738 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53fdd2-6865-4e56-b9cd-c870f4d9077c None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:11.135407 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d6c28-2131-4159-8eba-116784db319f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:11.136266 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d6c28-2131-4159-8eba-116784db319f admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:11.136621 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d6c28-2131-4159-8eba-116784db319f admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:11.137187 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d6c28-2131-4159-8eba-116784db319f admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:11.137938 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d6c28-2131-4159-8eba-116784db319f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:11.142514 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d6c28-2131-4159-8eba-116784db319f admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:11.267745 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1105/2221] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:22:11 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:22:11.272687 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a634e80-5af6-4278-9dfd-a33e96a77741 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:11.286035 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a634e80-5af6-4278-9dfd-a33e96a77741 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:11.365978 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9bdb7-38b2-4026-b49d-6c9d0496aeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:11.366800 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9bdb7-38b2-4026-b49d-6c9d0496aeb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:11.367177 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9bdb7-38b2-4026-b49d-6c9d0496aeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:11.367578 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9bdb7-38b2-4026-b49d-6c9d0496aeb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:11.368405 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9bdb7-38b2-4026-b49d-6c9d0496aeb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:11.370697 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9bdb7-38b2-4026-b49d-6c9d0496aeb1 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:11.455809 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1117/2222] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:22:11 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:22:11.457572 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d6c28-2131-4159-8eba-116784db319f admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:11.471993 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d6c28-2131-4159-8eba-116784db319f admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:11.481882 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556acd88-f891-4ae3-8b6d-2d9b428d86f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:11.483278 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556acd88-f891-4ae3-8b6d-2d9b428d86f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:11.484464 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556acd88-f891-4ae3-8b6d-2d9b428d86f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:11.484956 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556acd88-f891-4ae3-8b6d-2d9b428d86f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:11.485979 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556acd88-f891-4ae3-8b6d-2d9b428d86f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:11.488041 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556acd88-f891-4ae3-8b6d-2d9b428d86f4 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:11.520764 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1106/2223] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:22:11.525513 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9bdb7-38b2-4026-b49d-6c9d0496aeb1 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:11.549645 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9bdb7-38b2-4026-b49d-6c9d0496aeb1 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:11.567299 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03654c7-c8a0-464f-bd63-dc9e67d482b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:11.568135 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03654c7-c8a0-464f-bd63-dc9e67d482b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:11.568452 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03654c7-c8a0-464f-bd63-dc9e67d482b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:11.568759 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03654c7-c8a0-464f-bd63-dc9e67d482b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:11.569527 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03654c7-c8a0-464f-bd63-dc9e67d482b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:11.574772 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03654c7-c8a0-464f-bd63-dc9e67d482b4 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:11.607238 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1118/2224] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:22:11.613633 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556acd88-f891-4ae3-8b6d-2d9b428d86f4 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:11.629339 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556acd88-f891-4ae3-8b6d-2d9b428d86f4 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:11.636224 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd0699-6d9e-4542-9e0d-3b0abcb2a92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:11.637240 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd0699-6d9e-4542-9e0d-3b0abcb2a92e admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:11.637563 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd0699-6d9e-4542-9e0d-3b0abcb2a92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:11.638054 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd0699-6d9e-4542-9e0d-3b0abcb2a92e admin admin] PATH_INFO: `/v3/projects/2a979891a5054ec4add7aa9d48762700/users/95d7e0f9771c46b5bb652ac1bd5b3c81/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:11.662289 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd0699-6d9e-4542-9e0d-3b0abcb2a92e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a979891a5054ec4add7aa9d48762700, user_id=95d7e0f9771c46b5bb652ac1bd5b3c81, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:11.668447 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd0699-6d9e-4542-9e0d-3b0abcb2a92e admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:11.791169 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1107/2225] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:22:11 2022] PUT /identity/v3/projects/2a979891a5054ec4add7aa9d48762700/users/95d7e0f9771c46b5bb652ac1bd5b3c81/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:11.798157 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3a2cb-4028-482e-be7e-1b45b303b790 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:11.798559 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3a2cb-4028-482e-be7e-1b45b303b790 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:11.798961 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3a2cb-4028-482e-be7e-1b45b303b790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:11.866699 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-5be3a2cb-4028-482e-be7e-1b45b303b790 None None] MFA Rules not processed for user `95d7e0f9771c46b5bb652ac1bd5b3c81`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:11.871389 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-5be3a2cb-4028-482e-be7e-1b45b303b790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:12.012898 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd0699-6d9e-4542-9e0d-3b0abcb2a92e admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:12.036326 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1119/2226] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:22:12.221020 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd0699-6d9e-4542-9e0d-3b0abcb2a92e admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:12.236974 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803b38f-400f-482b-ab74-2ac4b885ca66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:12.237790 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803b38f-400f-482b-ab74-2ac4b885ca66 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:12.238087 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803b38f-400f-482b-ab74-2ac4b885ca66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:12.238371 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803b38f-400f-482b-ab74-2ac4b885ca66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:12.239192 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803b38f-400f-482b-ab74-2ac4b885ca66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:12.241141 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803b38f-400f-482b-ab74-2ac4b885ca66 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:12.382291 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1108/2227] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:22:12 2022] POST /identity/v3/projects => generated 385 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:22:12.386813 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3a2cb-4028-482e-be7e-1b45b303b790 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:12.400612 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3a2cb-4028-482e-be7e-1b45b303b790 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:12.513936 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628e963-2d46-4800-a13c-a0b6582c4fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:12.520628 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628e963-2d46-4800-a13c-a0b6582c4fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:12.520628 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628e963-2d46-4800-a13c-a0b6582c4fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:12.520628 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628e963-2d46-4800-a13c-a0b6582c4fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:12.520628 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628e963-2d46-4800-a13c-a0b6582c4fd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:12.524324 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628e963-2d46-4800-a13c-a0b6582c4fd8 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:12.616558 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1120/2228] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:22:12 2022] POST /identity/v3/users => generated 299 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:22:12.620818 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803b38f-400f-482b-ab74-2ac4b885ca66 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:12.635163 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803b38f-400f-482b-ab74-2ac4b885ca66 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:12.640852 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f3c87-a229-4dd7-90e6-a9735b75a3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:12.641819 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f3c87-a229-4dd7-90e6-a9735b75a3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:12.642259 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f3c87-a229-4dd7-90e6-a9735b75a3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:12.642686 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f3c87-a229-4dd7-90e6-a9735b75a3a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:12.643980 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f3c87-a229-4dd7-90e6-a9735b75a3a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:12.649088 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f3c87-a229-4dd7-90e6-a9735b75a3a6 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:12.683765 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1109/2229] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:22:12.684675 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628e963-2d46-4800-a13c-a0b6582c4fd8 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:12.697135 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628e963-2d46-4800-a13c-a0b6582c4fd8 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:12.703348 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702ff1a-ede2-4750-ad39-56256098d2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:12.704664 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702ff1a-ede2-4750-ad39-56256098d2a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:12.705132 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702ff1a-ede2-4750-ad39-56256098d2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:12.705598 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702ff1a-ede2-4750-ad39-56256098d2a7 admin admin] PATH_INFO: `/v3/projects/cc55c398470b4789bd1ba9a7edf8f8d7/users/6b7fe434d17a45eaa0bab8057e70c9b3/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:12.738914 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702ff1a-ede2-4750-ad39-56256098d2a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc55c398470b4789bd1ba9a7edf8f8d7, user_id=6b7fe434d17a45eaa0bab8057e70c9b3, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:12.742525 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702ff1a-ede2-4750-ad39-56256098d2a7 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:12.830754 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1121/2230] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:22:12 2022] PUT /identity/v3/projects/cc55c398470b4789bd1ba9a7edf8f8d7/users/6b7fe434d17a45eaa0bab8057e70c9b3/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:22:12.838608 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f3c87-a229-4dd7-90e6-a9735b75a3a6 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:12.856180 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f3c87-a229-4dd7-90e6-a9735b75a3a6 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:13.023510 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc91f6-bc57-4299-b013-f1eb2bfadc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:13.024423 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc91f6-bc57-4299-b013-f1eb2bfadc89 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:13.024866 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc91f6-bc57-4299-b013-f1eb2bfadc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:13.025321 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc91f6-bc57-4299-b013-f1eb2bfadc89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:13.026235 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc91f6-bc57-4299-b013-f1eb2bfadc89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:13.028016 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc91f6-bc57-4299-b013-f1eb2bfadc89 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:13.047899 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1110/2231] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:22:13.053261 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702ff1a-ede2-4750-ad39-56256098d2a7 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:13.065735 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702ff1a-ede2-4750-ad39-56256098d2a7 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:13.074790 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e02ce4-887c-45be-81e1-d9c135b083fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:13.078883 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e02ce4-887c-45be-81e1-d9c135b083fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:13.079538 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e02ce4-887c-45be-81e1-d9c135b083fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:13.080513 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e02ce4-887c-45be-81e1-d9c135b083fd admin admin] PATH_INFO: `/v3/projects/cc55c398470b4789bd1ba9a7edf8f8d7/users/6b7fe434d17a45eaa0bab8057e70c9b3/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:13.084001 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e02ce4-887c-45be-81e1-d9c135b083fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc55c398470b4789bd1ba9a7edf8f8d7, user_id=6b7fe434d17a45eaa0bab8057e70c9b3, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:13.087086 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e02ce4-887c-45be-81e1-d9c135b083fd admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:13.116674 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1122/2232] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:22:13 2022] PUT /identity/v3/projects/cc55c398470b4789bd1ba9a7edf8f8d7/users/6b7fe434d17a45eaa0bab8057e70c9b3/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:13.118752 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba1cf4-c168-4105-92b1-d9d7dc49e14e None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:13.119050 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba1cf4-c168-4105-92b1-d9d7dc49e14e None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:13.119329 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba1cf4-c168-4105-92b1-d9d7dc49e14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:13.202103 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-6fba1cf4-c168-4105-92b1-d9d7dc49e14e None None] MFA Rules not processed for user `6b7fe434d17a45eaa0bab8057e70c9b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:13.208295 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-6fba1cf4-c168-4105-92b1-d9d7dc49e14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:13.379655 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1111/2233] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:22:13.395584 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e02ce4-887c-45be-81e1-d9c135b083fd admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:13.398125 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-d3e02ce4-887c-45be-81e1-d9c135b083fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:13.488549 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e02ce4-887c-45be-81e1-d9c135b083fd admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:13.493512 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea25b0a-10a7-4d8d-aab0-181c6c06f159 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:13.494435 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea25b0a-10a7-4d8d-aab0-181c6c06f159 service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:13.495068 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea25b0a-10a7-4d8d-aab0-181c6c06f159 service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:13.495513 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea25b0a-10a7-4d8d-aab0-181c6c06f159 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:13.625771 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea25b0a-10a7-4d8d-aab0-181c6c06f159 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:13.628251 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea25b0a-10a7-4d8d-aab0-181c6c06f159 service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:13.690439 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1123/2234] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:22:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:22:14.962719 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba1cf4-c168-4105-92b1-d9d7dc49e14e None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:14.963192 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-6fba1cf4-c168-4105-92b1-d9d7dc49e14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:15.090672 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba1cf4-c168-4105-92b1-d9d7dc49e14e None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:15.097212 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aef4d8-518a-485e-ade4-c6e8bfb59b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:15.098144 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aef4d8-518a-485e-ade4-c6e8bfb59b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:15.098427 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aef4d8-518a-485e-ade4-c6e8bfb59b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:15.098707 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aef4d8-518a-485e-ade4-c6e8bfb59b04 admin admin] PATH_INFO: `/v3/users/7c74937b21f34446806f690a03e6ce6d` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:15.099962 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aef4d8-518a-485e-ade4-c6e8bfb59b04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c74937b21f34446806f690a03e6ce6d)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:15.102484 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aef4d8-518a-485e-ade4-c6e8bfb59b04 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:15.317502 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-36aef4d8-518a-485e-ade4-c6e8bfb59b04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c74937b21f34446806f690a03e6ce6d'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:15.422993 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-36aef4d8-518a-485e-ade4-c6e8bfb59b04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c74937b21f34446806f690a03e6ce6d'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:15.423621 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-36aef4d8-518a-485e-ade4-c6e8bfb59b04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c74937b21f34446806f690a03e6ce6d'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:15.433072 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-36aef4d8-518a-485e-ade4-c6e8bfb59b04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c74937b21f34446806f690a03e6ce6d'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:15.451406 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-36aef4d8-518a-485e-ade4-c6e8bfb59b04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c74937b21f34446806f690a03e6ce6d'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:15.464257 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1112/2235] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:22:14 2022] DELETE /identity/v3/users/7c74937b21f34446806f690a03e6ce6d => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:15.468541 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e71369-e8e8-4265-b332-dafd9c6b4e75 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:15.469426 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e71369-e8e8-4265-b332-dafd9c6b4e75 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:15.469716 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e71369-e8e8-4265-b332-dafd9c6b4e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:15.504350 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-b2e71369-e8e8-4265-b332-dafd9c6b4e75 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:15.533167 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b2e71369-e8e8-4265-b332-dafd9c6b4e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:15.699597 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1124/2236] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:22:15.711494 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aef4d8-518a-485e-ade4-c6e8bfb59b04 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:15.713060 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-36aef4d8-518a-485e-ade4-c6e8bfb59b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:15.780255 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed70e51-22a0-4307-b101-6e47dc18b499 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:15.781909 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed70e51-22a0-4307-b101-6e47dc18b499 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:15.785980 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed70e51-22a0-4307-b101-6e47dc18b499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:15.831261 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-6ed70e51-22a0-4307-b101-6e47dc18b499 None None] MFA Rules not processed for user `f53e5c9cebdb405aacf39c5f1b0e3fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:15.832972 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-6ed70e51-22a0-4307-b101-6e47dc18b499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:15.863519 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aef4d8-518a-485e-ade4-c6e8bfb59b04 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:15.882464 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0ad38-f854-4071-abb6-f88e71fe5ac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:15.883141 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0ad38-f854-4071-abb6-f88e71fe5ac8 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:15.883434 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0ad38-f854-4071-abb6-f88e71fe5ac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:15.883720 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0ad38-f854-4071-abb6-f88e71fe5ac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:15.900514 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0ad38-f854-4071-abb6-f88e71fe5ac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:15.902249 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0ad38-f854-4071-abb6-f88e71fe5ac8 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:15.925365 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1113/2237] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:22:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:22:16.017549 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1125/2238] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:22:16.030177 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0ad38-f854-4071-abb6-f88e71fe5ac8 service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:16.032419 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-1ef0ad38-f854-4071-abb6-f88e71fe5ac8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:16.162636 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0ad38-f854-4071-abb6-f88e71fe5ac8 service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:16.173503 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cf63e-2ad4-46e6-b6cf-caa454dae06b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:16.173503 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cf63e-2ad4-46e6-b6cf-caa454dae06b service nova] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:16.173503 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cf63e-2ad4-46e6-b6cf-caa454dae06b service nova] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:16.173503 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cf63e-2ad4-46e6-b6cf-caa454dae06b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:16.174727 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-f70cf63e-2ad4-46e6-b6cf-caa454dae06b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:16.273143 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70cf63e-2ad4-46e6-b6cf-caa454dae06b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:16.275772 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70cf63e-2ad4-46e6-b6cf-caa454dae06b service nova] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:16.291510 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1114/2239] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:22:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:22:16.521411 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed70e51-22a0-4307-b101-6e47dc18b499 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:16.522895 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-6ed70e51-22a0-4307-b101-6e47dc18b499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:16.538452 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed70e51-22a0-4307-b101-6e47dc18b499 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:16.550427 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dc321-dda3-4fb6-821d-ff3e3fd3963d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:16.552024 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dc321-dda3-4fb6-821d-ff3e3fd3963d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:16.552310 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dc321-dda3-4fb6-821d-ff3e3fd3963d admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:16.552589 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dc321-dda3-4fb6-821d-ff3e3fd3963d admin admin] PATH_INFO: `/v3/projects/07e3fca5275b42acb350be93689e8567` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:16.563388 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6dc321-dda3-4fb6-821d-ff3e3fd3963d admin admin] RBAC: Authorizing `identity:delete_project(project_id=07e3fca5275b42acb350be93689e8567)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:16.564702 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6dc321-dda3-4fb6-821d-ff3e3fd3963d admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:16.692169 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-da6dc321-dda3-4fb6-821d-ff3e3fd3963d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07e3fca5275b42acb350be93689e8567', 'request_id': 'req-da6dc321-dda3-4fb6-821d-ff3e3fd3963d'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:16.706085 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-da6dc321-dda3-4fb6-821d-ff3e3fd3963d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07e3fca5275b42acb350be93689e8567', 'request_id': 'req-da6dc321-dda3-4fb6-821d-ff3e3fd3963d'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:16.712384 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-da6dc321-dda3-4fb6-821d-ff3e3fd3963d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07e3fca5275b42acb350be93689e8567', 'request_id': 'req-da6dc321-dda3-4fb6-821d-ff3e3fd3963d'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:16.774999 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-da6dc321-dda3-4fb6-821d-ff3e3fd3963d admin admin] The token cache is being invalidate because project 07e3fca5275b42acb350be93689e8567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:22:16.775288 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-da6dc321-dda3-4fb6-821d-ff3e3fd3963d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:16.775915 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-da6dc321-dda3-4fb6-821d-ff3e3fd3963d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:16.777473 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1126/2240] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:22:16 2022] DELETE /identity/v3/projects/07e3fca5275b42acb350be93689e8567 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:16.784360 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8f7bc-39c0-4808-b921-74312ae8f279 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:16.784659 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8f7bc-39c0-4808-b921-74312ae8f279 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:16.784971 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8f7bc-39c0-4808-b921-74312ae8f279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:16.805183 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-a9e8f7bc-39c0-4808-b921-74312ae8f279 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:16.806559 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-a9e8f7bc-39c0-4808-b921-74312ae8f279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:16.872430 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1115/2241] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:22:16.881965 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b4013-d067-4507-b39f-891d2aa22c6f None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:16.882463 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b4013-d067-4507-b39f-891d2aa22c6f None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:16.882897 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b4013-d067-4507-b39f-891d2aa22c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:16.903445 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-342b4013-d067-4507-b39f-891d2aa22c6f None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:16.904647 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-342b4013-d067-4507-b39f-891d2aa22c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:16.914475 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1127/2242] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:22:16.920850 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8f7bc-39c0-4808-b921-74312ae8f279 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:16.933674 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8f7bc-39c0-4808-b921-74312ae8f279 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:16.940331 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c0bff-0af2-4b7d-8832-8b1570e7afb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:16.942096 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c0bff-0af2-4b7d-8832-8b1570e7afb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:16.945728 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c0bff-0af2-4b7d-8832-8b1570e7afb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:16.946069 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c0bff-0af2-4b7d-8832-8b1570e7afb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:16.950867 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c0bff-0af2-4b7d-8832-8b1570e7afb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:22:16.951243 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c0bff-0af2-4b7d-8832-8b1570e7afb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:16.953785 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c0bff-0af2-4b7d-8832-8b1570e7afb2 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:16.971224 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1116/2243] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:22:16.975286 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b4013-d067-4507-b39f-891d2aa22c6f None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:16.985569 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b4013-d067-4507-b39f-891d2aa22c6f None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:16.996457 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819beef-620a-40ef-bf64-b51ede44d8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:16.996457 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819beef-620a-40ef-bf64-b51ede44d8ab admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:16.996457 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819beef-620a-40ef-bf64-b51ede44d8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:16.996457 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819beef-620a-40ef-bf64-b51ede44d8ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:16.996764 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819beef-620a-40ef-bf64-b51ede44d8ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:16.996764 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819beef-620a-40ef-bf64-b51ede44d8ab admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:17.092476 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1128/2244] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:22:16 2022] POST /identity/v3/projects => generated 389 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:22:17.097171 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c0bff-0af2-4b7d-8832-8b1570e7afb2 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:17.107151 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c0bff-0af2-4b7d-8832-8b1570e7afb2 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:17.182961 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5bd8a-86c9-4985-9f5c-6fe678213d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:17.187383 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5bd8a-86c9-4985-9f5c-6fe678213d0d admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:17.187383 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5bd8a-86c9-4985-9f5c-6fe678213d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:17.187383 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5bd8a-86c9-4985-9f5c-6fe678213d0d admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:17.187383 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5bd8a-86c9-4985-9f5c-6fe678213d0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:17.188653 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5bd8a-86c9-4985-9f5c-6fe678213d0d admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:17.258713 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1117/2245] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:22:17 2022] POST /identity/v3/users => generated 295 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:22:17.262444 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819beef-620a-40ef-bf64-b51ede44d8ab admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:17.274485 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819beef-620a-40ef-bf64-b51ede44d8ab admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:17.279340 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea3277-9d1a-4c1e-af88-49ad7ca87b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:17.280208 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea3277-9d1a-4c1e-af88-49ad7ca87b9c admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:17.281052 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea3277-9d1a-4c1e-af88-49ad7ca87b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:17.281347 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea3277-9d1a-4c1e-af88-49ad7ca87b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:17.282083 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea3277-9d1a-4c1e-af88-49ad7ca87b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:17.283881 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea3277-9d1a-4c1e-af88-49ad7ca87b9c admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:17.296147 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1129/2246] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:22:17.306291 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5bd8a-86c9-4985-9f5c-6fe678213d0d admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:17.317110 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5bd8a-86c9-4985-9f5c-6fe678213d0d admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:17.321840 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da261c8-44b5-4c03-a188-49711afe9a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:17.322505 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da261c8-44b5-4c03-a188-49711afe9a9d admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:17.322810 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da261c8-44b5-4c03-a188-49711afe9a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:17.323144 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da261c8-44b5-4c03-a188-49711afe9a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:17.323896 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da261c8-44b5-4c03-a188-49711afe9a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:17.325518 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da261c8-44b5-4c03-a188-49711afe9a9d admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:17.338924 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1118/2247] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:22:17.340283 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea3277-9d1a-4c1e-af88-49ad7ca87b9c admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:17.352377 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea3277-9d1a-4c1e-af88-49ad7ca87b9c admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:17.363310 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b78d1-1ee9-47db-8250-987399dbe90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:17.365117 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b78d1-1ee9-47db-8250-987399dbe90d admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:17.365810 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b78d1-1ee9-47db-8250-987399dbe90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:17.366423 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b78d1-1ee9-47db-8250-987399dbe90d admin admin] PATH_INFO: `/v3/projects/2e8f246384fe4a8da35a0a199ee15bf5/users/919e08f6238e483a819631f5ae12c105/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:17.384163 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b78d1-1ee9-47db-8250-987399dbe90d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e8f246384fe4a8da35a0a199ee15bf5, user_id=919e08f6238e483a819631f5ae12c105, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:17.387479 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b78d1-1ee9-47db-8250-987399dbe90d admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:17.474040 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1130/2248] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:22:17 2022] PUT /identity/v3/projects/2e8f246384fe4a8da35a0a199ee15bf5/users/919e08f6238e483a819631f5ae12c105/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:22:17.476582 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212b8c1-5e31-4270-87dc-aa17ccbe0c82 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:17.476863 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212b8c1-5e31-4270-87dc-aa17ccbe0c82 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:17.477148 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212b8c1-5e31-4270-87dc-aa17ccbe0c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:17.506716 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-4212b8c1-5e31-4270-87dc-aa17ccbe0c82 None None] MFA Rules not processed for user `919e08f6238e483a819631f5ae12c105`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:17.508031 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-4212b8c1-5e31-4270-87dc-aa17ccbe0c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:17.610511 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1119/2249] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:22:17.621847 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b78d1-1ee9-47db-8250-987399dbe90d admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:17.626547 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-938b78d1-1ee9-47db-8250-987399dbe90d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:17.709839 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b78d1-1ee9-47db-8250-987399dbe90d admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:17.727244 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63618ef6-93f0-4cc4-9550-0409f1709e84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:17.728314 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63618ef6-93f0-4cc4-9550-0409f1709e84 service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:17.728888 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63618ef6-93f0-4cc4-9550-0409f1709e84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:17.729390 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63618ef6-93f0-4cc4-9550-0409f1709e84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:17.752878 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63618ef6-93f0-4cc4-9550-0409f1709e84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:17.763316 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63618ef6-93f0-4cc4-9550-0409f1709e84 service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:17.778442 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1131/2250] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:22:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:22:19.491624 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b6e37-e96c-417d-9857-13cab3832595 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:19.492627 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b6e37-e96c-417d-9857-13cab3832595 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:19.492946 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b6e37-e96c-417d-9857-13cab3832595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:19.517379 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-824b6e37-e96c-417d-9857-13cab3832595 None None] MFA Rules not processed for user `411f7901d39449bc831859d0a5d98ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:19.518760 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-824b6e37-e96c-417d-9857-13cab3832595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:19.603494 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1120/2251] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:22:21.806095 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63618ef6-93f0-4cc4-9550-0409f1709e84 service cinder] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:21.815354 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63618ef6-93f0-4cc4-9550-0409f1709e84 service cinder] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:21.819031 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dc03e-6852-454e-b08d-6936659420ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:21.819668 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dc03e-6852-454e-b08d-6936659420ce service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:21.819963 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dc03e-6852-454e-b08d-6936659420ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:21.820244 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dc03e-6852-454e-b08d-6936659420ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:21.822017 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a80dc03e-6852-454e-b08d-6936659420ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:21.885865 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80dc03e-6852-454e-b08d-6936659420ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:21.887324 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80dc03e-6852-454e-b08d-6936659420ce service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:21.898110 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1132/2252] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:22:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:22:38.992953 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b6e37-e96c-417d-9857-13cab3832595 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:38.994577 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-824b6e37-e96c-417d-9857-13cab3832595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:39.077337 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b6e37-e96c-417d-9857-13cab3832595 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:39.083034 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfe4f7-adbb-492f-bb49-07b934968063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:39.087395 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfe4f7-adbb-492f-bb49-07b934968063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:39.087782 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfe4f7-adbb-492f-bb49-07b934968063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:39.088085 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfe4f7-adbb-492f-bb49-07b934968063 admin admin] PATH_INFO: `/v3/users/95d7e0f9771c46b5bb652ac1bd5b3c81` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:39.090212 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfe4f7-adbb-492f-bb49-07b934968063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95d7e0f9771c46b5bb652ac1bd5b3c81)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:39.092205 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfe4f7-adbb-492f-bb49-07b934968063 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:39.315903 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-5fcfe4f7-adbb-492f-bb49-07b934968063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95d7e0f9771c46b5bb652ac1bd5b3c81'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:39.393912 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-5fcfe4f7-adbb-492f-bb49-07b934968063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95d7e0f9771c46b5bb652ac1bd5b3c81'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:39.394884 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-5fcfe4f7-adbb-492f-bb49-07b934968063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95d7e0f9771c46b5bb652ac1bd5b3c81'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:39.403050 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-5fcfe4f7-adbb-492f-bb49-07b934968063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95d7e0f9771c46b5bb652ac1bd5b3c81'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:39.440606 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-5fcfe4f7-adbb-492f-bb49-07b934968063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95d7e0f9771c46b5bb652ac1bd5b3c81'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:39.451621 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1121/2253] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:22:38 2022] DELETE /identity/v3/users/95d7e0f9771c46b5bb652ac1bd5b3c81 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:39.454762 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1328c-efa7-47db-8bbf-1eb95a05000f None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:39.455279 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1328c-efa7-47db-8bbf-1eb95a05000f None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:39.455398 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1328c-efa7-47db-8bbf-1eb95a05000f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:39.473663 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-1bd1328c-efa7-47db-8bbf-1eb95a05000f None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:39.475037 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-1bd1328c-efa7-47db-8bbf-1eb95a05000f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:39.553475 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1133/2254] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:22:39.564273 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfe4f7-adbb-492f-bb49-07b934968063 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:39.565734 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-5fcfe4f7-adbb-492f-bb49-07b934968063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:39.624296 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfe4f7-adbb-492f-bb49-07b934968063 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:39.628531 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c3d6f-3086-43a7-92d7-b0fa47095f25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:39.629177 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c3d6f-3086-43a7-92d7-b0fa47095f25 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:39.629489 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c3d6f-3086-43a7-92d7-b0fa47095f25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:39.629769 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c3d6f-3086-43a7-92d7-b0fa47095f25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:39.641947 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c3d6f-3086-43a7-92d7-b0fa47095f25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:39.642590 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c3d6f-3086-43a7-92d7-b0fa47095f25 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:39.653134 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1122/2255] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:22:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:22:40.344538 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1328c-efa7-47db-8bbf-1eb95a05000f None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:40.346130 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-1bd1328c-efa7-47db-8bbf-1eb95a05000f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:40.364551 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1328c-efa7-47db-8bbf-1eb95a05000f None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:40.366714 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386d2f3-7a33-4483-a888-bf80afd3b2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:40.367805 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386d2f3-7a33-4483-a888-bf80afd3b2ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:40.368260 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386d2f3-7a33-4483-a888-bf80afd3b2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:40.368875 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386d2f3-7a33-4483-a888-bf80afd3b2ef admin admin] PATH_INFO: `/v3/projects/2a979891a5054ec4add7aa9d48762700` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:40.371024 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386d2f3-7a33-4483-a888-bf80afd3b2ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a979891a5054ec4add7aa9d48762700)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:40.376522 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386d2f3-7a33-4483-a888-bf80afd3b2ef admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:40.490639 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7386d2f3-7a33-4483-a888-bf80afd3b2ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a979891a5054ec4add7aa9d48762700', 'request_id': 'req-7386d2f3-7a33-4483-a888-bf80afd3b2ef'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:40.499931 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7386d2f3-7a33-4483-a888-bf80afd3b2ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a979891a5054ec4add7aa9d48762700', 'request_id': 'req-7386d2f3-7a33-4483-a888-bf80afd3b2ef'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:40.508024 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7386d2f3-7a33-4483-a888-bf80afd3b2ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a979891a5054ec4add7aa9d48762700', 'request_id': 'req-7386d2f3-7a33-4483-a888-bf80afd3b2ef'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:40.579370 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7386d2f3-7a33-4483-a888-bf80afd3b2ef admin admin] The token cache is being invalidate because project 2a979891a5054ec4add7aa9d48762700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:22:40.579668 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7386d2f3-7a33-4483-a888-bf80afd3b2ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:40.584920 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7386d2f3-7a33-4483-a888-bf80afd3b2ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:40.589234 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1134/2256] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:22:40 2022] DELETE /identity/v3/projects/2a979891a5054ec4add7aa9d48762700 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:40.591380 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c3d6f-3086-43a7-92d7-b0fa47095f25 service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:40.620002 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c3d6f-3086-43a7-92d7-b0fa47095f25 service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:40.677934 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db29cdc-78f9-4ac7-b401-be1b577c7004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:40.678809 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db29cdc-78f9-4ac7-b401-be1b577c7004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:40.679097 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db29cdc-78f9-4ac7-b401-be1b577c7004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:40.679377 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db29cdc-78f9-4ac7-b401-be1b577c7004 admin admin] PATH_INFO: `/v3/users/6b7fe434d17a45eaa0bab8057e70c9b3` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:40.680579 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db29cdc-78f9-4ac7-b401-be1b577c7004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b7fe434d17a45eaa0bab8057e70c9b3)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:40.682517 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db29cdc-78f9-4ac7-b401-be1b577c7004 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:40.842509 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-5db29cdc-78f9-4ac7-b401-be1b577c7004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b7fe434d17a45eaa0bab8057e70c9b3'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:40.901648 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-5db29cdc-78f9-4ac7-b401-be1b577c7004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b7fe434d17a45eaa0bab8057e70c9b3'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:40.902603 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-5db29cdc-78f9-4ac7-b401-be1b577c7004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b7fe434d17a45eaa0bab8057e70c9b3'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:40.912847 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-5db29cdc-78f9-4ac7-b401-be1b577c7004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b7fe434d17a45eaa0bab8057e70c9b3'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:40.925081 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-5db29cdc-78f9-4ac7-b401-be1b577c7004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b7fe434d17a45eaa0bab8057e70c9b3'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:40.931212 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1123/2257] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:22:40 2022] DELETE /identity/v3/users/6b7fe434d17a45eaa0bab8057e70c9b3 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:41.361104 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386d2f3-7a33-4483-a888-bf80afd3b2ef admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:41.363575 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-7386d2f3-7a33-4483-a888-bf80afd3b2ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:41.384263 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386d2f3-7a33-4483-a888-bf80afd3b2ef admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:41.442602 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc8178-3b2a-4328-a565-e7be4ccc9518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:41.443480 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc8178-3b2a-4328-a565-e7be4ccc9518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:41.443757 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc8178-3b2a-4328-a565-e7be4ccc9518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:41.447660 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc8178-3b2a-4328-a565-e7be4ccc9518 admin admin] PATH_INFO: `/v3/projects/cc55c398470b4789bd1ba9a7edf8f8d7` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:41.447660 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc8178-3b2a-4328-a565-e7be4ccc9518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc55c398470b4789bd1ba9a7edf8f8d7)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:41.447660 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc8178-3b2a-4328-a565-e7be4ccc9518 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:41.553611 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f7cc8178-3b2a-4328-a565-e7be4ccc9518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc55c398470b4789bd1ba9a7edf8f8d7', 'request_id': 'req-f7cc8178-3b2a-4328-a565-e7be4ccc9518'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:41.558975 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f7cc8178-3b2a-4328-a565-e7be4ccc9518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc55c398470b4789bd1ba9a7edf8f8d7', 'request_id': 'req-f7cc8178-3b2a-4328-a565-e7be4ccc9518'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:41.565967 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f7cc8178-3b2a-4328-a565-e7be4ccc9518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc55c398470b4789bd1ba9a7edf8f8d7', 'request_id': 'req-f7cc8178-3b2a-4328-a565-e7be4ccc9518'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:41.643208 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f7cc8178-3b2a-4328-a565-e7be4ccc9518 admin admin] The token cache is being invalidate because project cc55c398470b4789bd1ba9a7edf8f8d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:22:41.643499 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f7cc8178-3b2a-4328-a565-e7be4ccc9518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:41.644114 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f7cc8178-3b2a-4328-a565-e7be4ccc9518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:41.645696 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1135/2258] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:22:41 2022] DELETE /identity/v3/projects/cc55c398470b4789bd1ba9a7edf8f8d7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:45.195059 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db29cdc-78f9-4ac7-b401-be1b577c7004 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:45.196496 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-5db29cdc-78f9-4ac7-b401-be1b577c7004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:45.247833 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db29cdc-78f9-4ac7-b401-be1b577c7004 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:45.304872 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9a6ec-ca54-46d4-9a81-ad88ef5e330e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:45.305784 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9a6ec-ca54-46d4-9a81-ad88ef5e330e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:45.306073 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9a6ec-ca54-46d4-9a81-ad88ef5e330e admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:45.306351 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9a6ec-ca54-46d4-9a81-ad88ef5e330e admin admin] PATH_INFO: `/v3/users/919e08f6238e483a819631f5ae12c105` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:45.307573 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9a6ec-ca54-46d4-9a81-ad88ef5e330e admin admin] RBAC: Authorizing `identity:delete_user(user_id=919e08f6238e483a819631f5ae12c105)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:45.309565 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9a6ec-ca54-46d4-9a81-ad88ef5e330e admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:45.538315 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-34b9a6ec-ca54-46d4-9a81-ad88ef5e330e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '919e08f6238e483a819631f5ae12c105'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:45.611062 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-34b9a6ec-ca54-46d4-9a81-ad88ef5e330e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '919e08f6238e483a819631f5ae12c105'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:45.611919 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-34b9a6ec-ca54-46d4-9a81-ad88ef5e330e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '919e08f6238e483a819631f5ae12c105'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:45.619520 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-34b9a6ec-ca54-46d4-9a81-ad88ef5e330e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '919e08f6238e483a819631f5ae12c105'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:45.632711 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-34b9a6ec-ca54-46d4-9a81-ad88ef5e330e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '919e08f6238e483a819631f5ae12c105'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:45.639126 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1124/2259] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:22:45 2022] DELETE /identity/v3/users/919e08f6238e483a819631f5ae12c105 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:45.643960 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2908eb4-bcf1-4927-98c6-6011a8ffac59 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:45.644865 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2908eb4-bcf1-4927-98c6-6011a8ffac59 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:45.645198 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2908eb4-bcf1-4927-98c6-6011a8ffac59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:45.664983 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-c2908eb4-bcf1-4927-98c6-6011a8ffac59 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:45.666469 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-c2908eb4-bcf1-4927-98c6-6011a8ffac59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:45.730934 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1136/2260] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:22:45.745681 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9a6ec-ca54-46d4-9a81-ad88ef5e330e admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:45.747164 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-34b9a6ec-ca54-46d4-9a81-ad88ef5e330e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:45.860446 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9a6ec-ca54-46d4-9a81-ad88ef5e330e admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:45.864182 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d7a01-fd48-4f1a-8bfa-075489272078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:45.864832 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d7a01-fd48-4f1a-8bfa-075489272078 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:45.865124 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d7a01-fd48-4f1a-8bfa-075489272078 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:45.865446 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d7a01-fd48-4f1a-8bfa-075489272078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:45.874787 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d7a01-fd48-4f1a-8bfa-075489272078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:45.876946 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d7a01-fd48-4f1a-8bfa-075489272078 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:45.887889 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1125/2261] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:22:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:22:46.274585 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2908eb4-bcf1-4927-98c6-6011a8ffac59 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:46.276064 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-c2908eb4-bcf1-4927-98c6-6011a8ffac59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:46.291880 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2908eb4-bcf1-4927-98c6-6011a8ffac59 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:46.301212 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2b13e-7f50-4677-af84-cef37249d086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:46.302123 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2b13e-7f50-4677-af84-cef37249d086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:46.302402 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2b13e-7f50-4677-af84-cef37249d086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:46.302672 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2b13e-7f50-4677-af84-cef37249d086 admin admin] PATH_INFO: `/v3/projects/2e8f246384fe4a8da35a0a199ee15bf5` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:46.303868 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2b13e-7f50-4677-af84-cef37249d086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e8f246384fe4a8da35a0a199ee15bf5)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:46.305813 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2b13e-7f50-4677-af84-cef37249d086 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:46.416784 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-1ac2b13e-7f50-4677-af84-cef37249d086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e8f246384fe4a8da35a0a199ee15bf5', 'request_id': 'req-1ac2b13e-7f50-4677-af84-cef37249d086'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:46.423729 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-1ac2b13e-7f50-4677-af84-cef37249d086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e8f246384fe4a8da35a0a199ee15bf5', 'request_id': 'req-1ac2b13e-7f50-4677-af84-cef37249d086'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:46.430021 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-1ac2b13e-7f50-4677-af84-cef37249d086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e8f246384fe4a8da35a0a199ee15bf5', 'request_id': 'req-1ac2b13e-7f50-4677-af84-cef37249d086'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:46.512900 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-1ac2b13e-7f50-4677-af84-cef37249d086 admin admin] The token cache is being invalidate because project 2e8f246384fe4a8da35a0a199ee15bf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:22:46.513189 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-1ac2b13e-7f50-4677-af84-cef37249d086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:46.513830 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-1ac2b13e-7f50-4677-af84-cef37249d086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:46.515351 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1137/2262] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:22:46 2022] DELETE /identity/v3/projects/2e8f246384fe4a8da35a0a199ee15bf5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:50.670341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d7a01-fd48-4f1a-8bfa-075489272078 service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:50.672674 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-617d7a01-fd48-4f1a-8bfa-075489272078 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:50.718555 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d7a01-fd48-4f1a-8bfa-075489272078 service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:50.789057 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b3e7d-38cc-4f95-ae9a-b08ebdfd1adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:50.790063 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b3e7d-38cc-4f95-ae9a-b08ebdfd1adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:50.790303 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b3e7d-38cc-4f95-ae9a-b08ebdfd1adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:50.790578 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b3e7d-38cc-4f95-ae9a-b08ebdfd1adc admin admin] PATH_INFO: `/v3/users/df585f25650d4fb2aec3bcea7b71f1cf` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:50.792470 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b3e7d-38cc-4f95-ae9a-b08ebdfd1adc admin admin] RBAC: Authorizing `identity:delete_user(user_id=df585f25650d4fb2aec3bcea7b71f1cf)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:50.794626 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b3e7d-38cc-4f95-ae9a-b08ebdfd1adc admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:50.976602 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-152b3e7d-38cc-4f95-ae9a-b08ebdfd1adc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df585f25650d4fb2aec3bcea7b71f1cf'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:51.061810 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-152b3e7d-38cc-4f95-ae9a-b08ebdfd1adc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df585f25650d4fb2aec3bcea7b71f1cf'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:51.062759 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-152b3e7d-38cc-4f95-ae9a-b08ebdfd1adc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df585f25650d4fb2aec3bcea7b71f1cf'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:51.070309 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-152b3e7d-38cc-4f95-ae9a-b08ebdfd1adc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df585f25650d4fb2aec3bcea7b71f1cf'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:51.081876 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-152b3e7d-38cc-4f95-ae9a-b08ebdfd1adc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df585f25650d4fb2aec3bcea7b71f1cf'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:51.088022 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1126/2263] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:22:50 2022] DELETE /identity/v3/users/df585f25650d4fb2aec3bcea7b71f1cf => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:51.092604 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a9882-f415-4093-808b-4f8a954ed5a3 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:51.093080 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a9882-f415-4093-808b-4f8a954ed5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:51.093194 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a9882-f415-4093-808b-4f8a954ed5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:51.120753 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-009a9882-f415-4093-808b-4f8a954ed5a3 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:51.122030 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-009a9882-f415-4093-808b-4f8a954ed5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:51.180848 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1138/2264] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:22:51.191524 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b3e7d-38cc-4f95-ae9a-b08ebdfd1adc admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:51.193326 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-152b3e7d-38cc-4f95-ae9a-b08ebdfd1adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:51.250090 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b3e7d-38cc-4f95-ae9a-b08ebdfd1adc admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:51.253941 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d60fa-d98a-462c-a990-2b101f0f7bea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:51.254591 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d60fa-d98a-462c-a990-2b101f0f7bea service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:51.254883 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d60fa-d98a-462c-a990-2b101f0f7bea service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:51.255167 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d60fa-d98a-462c-a990-2b101f0f7bea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:51.263951 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d60fa-d98a-462c-a990-2b101f0f7bea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:51.265411 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d60fa-d98a-462c-a990-2b101f0f7bea service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:51.276540 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1127/2265] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:22:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:22:51.740016 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a9882-f415-4093-808b-4f8a954ed5a3 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:51.746391 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-009a9882-f415-4093-808b-4f8a954ed5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:51.754824 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a9882-f415-4093-808b-4f8a954ed5a3 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:51.768221 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b183e40-476a-42ff-a27b-2ec49ab293e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:51.769048 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b183e40-476a-42ff-a27b-2ec49ab293e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:51.769377 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b183e40-476a-42ff-a27b-2ec49ab293e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:51.775789 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b183e40-476a-42ff-a27b-2ec49ab293e2 admin admin] PATH_INFO: `/v3/projects/0d0ac7345e5e44dbb29b844d7bcc99fe` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:51.775789 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b183e40-476a-42ff-a27b-2ec49ab293e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d0ac7345e5e44dbb29b844d7bcc99fe)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:51.775789 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b183e40-476a-42ff-a27b-2ec49ab293e2 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:51.897467 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6b183e40-476a-42ff-a27b-2ec49ab293e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d0ac7345e5e44dbb29b844d7bcc99fe', 'request_id': 'req-6b183e40-476a-42ff-a27b-2ec49ab293e2'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:51.902966 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6b183e40-476a-42ff-a27b-2ec49ab293e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d0ac7345e5e44dbb29b844d7bcc99fe', 'request_id': 'req-6b183e40-476a-42ff-a27b-2ec49ab293e2'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:51.912889 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6b183e40-476a-42ff-a27b-2ec49ab293e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d0ac7345e5e44dbb29b844d7bcc99fe', 'request_id': 'req-6b183e40-476a-42ff-a27b-2ec49ab293e2'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:52.021952 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6b183e40-476a-42ff-a27b-2ec49ab293e2 admin admin] The token cache is being invalidate because project 0d0ac7345e5e44dbb29b844d7bcc99fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:22:52.022246 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6b183e40-476a-42ff-a27b-2ec49ab293e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:52.022897 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6b183e40-476a-42ff-a27b-2ec49ab293e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:52.024463 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1139/2266] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:22:51 2022] DELETE /identity/v3/projects/0d0ac7345e5e44dbb29b844d7bcc99fe => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:52.028484 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d60fa-d98a-462c-a990-2b101f0f7bea service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:52.039674 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d60fa-d98a-462c-a990-2b101f0f7bea service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:52.107742 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d695f-a177-4d1f-a27c-e471bb8b049c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:52.108651 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d695f-a177-4d1f-a27c-e471bb8b049c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:52.108943 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d695f-a177-4d1f-a27c-e471bb8b049c admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:52.109796 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d695f-a177-4d1f-a27c-e471bb8b049c admin admin] PATH_INFO: `/v3/users/69a90e5f1ebc44faa7ef6f1369696c88` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:52.111039 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d695f-a177-4d1f-a27c-e471bb8b049c admin admin] RBAC: Authorizing `identity:delete_user(user_id=69a90e5f1ebc44faa7ef6f1369696c88)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:52.116589 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d695f-a177-4d1f-a27c-e471bb8b049c admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:52.321357 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-7c0d695f-a177-4d1f-a27c-e471bb8b049c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69a90e5f1ebc44faa7ef6f1369696c88'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:52.399105 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-7c0d695f-a177-4d1f-a27c-e471bb8b049c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69a90e5f1ebc44faa7ef6f1369696c88'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:52.399541 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-7c0d695f-a177-4d1f-a27c-e471bb8b049c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69a90e5f1ebc44faa7ef6f1369696c88'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:52.407903 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-7c0d695f-a177-4d1f-a27c-e471bb8b049c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69a90e5f1ebc44faa7ef6f1369696c88'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:52.420048 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-7c0d695f-a177-4d1f-a27c-e471bb8b049c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69a90e5f1ebc44faa7ef6f1369696c88'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:52.426827 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1128/2267] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:22:52 2022] DELETE /identity/v3/users/69a90e5f1ebc44faa7ef6f1369696c88 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:52.887047 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b183e40-476a-42ff-a27b-2ec49ab293e2 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:52.888470 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-6b183e40-476a-42ff-a27b-2ec49ab293e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:52.911798 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b183e40-476a-42ff-a27b-2ec49ab293e2 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:52.995280 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71eca1-59b3-4ac0-9cfc-92dcf3bb0e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:52.996425 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71eca1-59b3-4ac0-9cfc-92dcf3bb0e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:52.996788 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71eca1-59b3-4ac0-9cfc-92dcf3bb0e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:52.997144 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71eca1-59b3-4ac0-9cfc-92dcf3bb0e1c admin admin] PATH_INFO: `/v3/projects/78b50271c86f4643986f7ea869c97a2d` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:53.006195 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71eca1-59b3-4ac0-9cfc-92dcf3bb0e1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=78b50271c86f4643986f7ea869c97a2d)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:53.009055 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71eca1-59b3-4ac0-9cfc-92dcf3bb0e1c admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:53.129520 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ef71eca1-59b3-4ac0-9cfc-92dcf3bb0e1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78b50271c86f4643986f7ea869c97a2d', 'request_id': 'req-ef71eca1-59b3-4ac0-9cfc-92dcf3bb0e1c'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:53.135237 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ef71eca1-59b3-4ac0-9cfc-92dcf3bb0e1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78b50271c86f4643986f7ea869c97a2d', 'request_id': 'req-ef71eca1-59b3-4ac0-9cfc-92dcf3bb0e1c'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:53.141978 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ef71eca1-59b3-4ac0-9cfc-92dcf3bb0e1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78b50271c86f4643986f7ea869c97a2d', 'request_id': 'req-ef71eca1-59b3-4ac0-9cfc-92dcf3bb0e1c'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:53.228933 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ef71eca1-59b3-4ac0-9cfc-92dcf3bb0e1c admin admin] The token cache is being invalidate because project 78b50271c86f4643986f7ea869c97a2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:22:53.229151 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ef71eca1-59b3-4ac0-9cfc-92dcf3bb0e1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:53.229829 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ef71eca1-59b3-4ac0-9cfc-92dcf3bb0e1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:53.231643 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1140/2268] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:22:52 2022] DELETE /identity/v3/projects/78b50271c86f4643986f7ea869c97a2d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:53.236717 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfbe66-92b9-4253-af39-d98979d58828 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:53.237221 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfbe66-92b9-4253-af39-d98979d58828 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:53.237511 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfbe66-92b9-4253-af39-d98979d58828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:53.277875 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-ccdfbe66-92b9-4253-af39-d98979d58828 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:53.279080 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-ccdfbe66-92b9-4253-af39-d98979d58828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:53.343305 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1129/2269] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:22:53.351887 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c539a-50de-49b3-8297-e89da11eac52 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:53.352180 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c539a-50de-49b3-8297-e89da11eac52 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:53.352462 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c539a-50de-49b3-8297-e89da11eac52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:53.371450 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-864c539a-50de-49b3-8297-e89da11eac52 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:53.372658 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-864c539a-50de-49b3-8297-e89da11eac52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:53.381385 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1141/2270] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:22:53.390230 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfbe66-92b9-4253-af39-d98979d58828 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:53.402131 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfbe66-92b9-4253-af39-d98979d58828 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:53.407055 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9253c-a5d6-476d-957a-84a955345b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:53.407871 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9253c-a5d6-476d-957a-84a955345b89 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:53.408219 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9253c-a5d6-476d-957a-84a955345b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:53.408496 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9253c-a5d6-476d-957a-84a955345b89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:53.409336 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9253c-a5d6-476d-957a-84a955345b89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:22:53.409656 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9253c-a5d6-476d-957a-84a955345b89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:53.412981 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9253c-a5d6-476d-957a-84a955345b89 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:53.423997 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1130/2271] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:22:53.428212 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c539a-50de-49b3-8297-e89da11eac52 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:53.439259 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c539a-50de-49b3-8297-e89da11eac52 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:53.443711 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c066a8-1d4b-4298-912e-2dd3f938a948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:53.444458 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c066a8-1d4b-4298-912e-2dd3f938a948 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:53.444811 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c066a8-1d4b-4298-912e-2dd3f938a948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:53.445161 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c066a8-1d4b-4298-912e-2dd3f938a948 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:53.445996 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c066a8-1d4b-4298-912e-2dd3f938a948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:53.448107 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c066a8-1d4b-4298-912e-2dd3f938a948 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:53.478780 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545b626-eda8-434f-b2dc-31d2a13a3d88 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:53.480411 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545b626-eda8-434f-b2dc-31d2a13a3d88 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:53.480411 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545b626-eda8-434f-b2dc-31d2a13a3d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:53.497656 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-2545b626-eda8-434f-b2dc-31d2a13a3d88 None None] MFA Rules not processed for user `f752a7bea22542009cbf86e7b36c8e83`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:53.498839 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-2545b626-eda8-434f-b2dc-31d2a13a3d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:53.534172 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1142/2272] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:22:53 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:22:53.538082 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c066a8-1d4b-4298-912e-2dd3f938a948 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:53.554970 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1131/2273] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:22:53.601868 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c066a8-1d4b-4298-912e-2dd3f938a948 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:53.607240 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3802e-1cca-4706-9712-064527a3ba84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:53.607621 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3802e-1cca-4706-9712-064527a3ba84 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:53.607817 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3802e-1cca-4706-9712-064527a3ba84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:53.608135 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3802e-1cca-4706-9712-064527a3ba84 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:53.608921 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3802e-1cca-4706-9712-064527a3ba84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:53.610965 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3802e-1cca-4706-9712-064527a3ba84 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:53.674283 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1143/2274] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:22:53 2022] POST /identity/v3/users => generated 290 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:22:53.678213 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545b626-eda8-434f-b2dc-31d2a13a3d88 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:53.689928 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545b626-eda8-434f-b2dc-31d2a13a3d88 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:53.701234 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa60ae-b324-457c-b260-5d0df815df19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:53.702084 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa60ae-b324-457c-b260-5d0df815df19 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:53.702473 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa60ae-b324-457c-b260-5d0df815df19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:53.702855 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa60ae-b324-457c-b260-5d0df815df19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:53.704349 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa60ae-b324-457c-b260-5d0df815df19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:53.706211 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa60ae-b324-457c-b260-5d0df815df19 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:53.716958 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1132/2275] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:22:53.721872 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3802e-1cca-4706-9712-064527a3ba84 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:53.732641 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3802e-1cca-4706-9712-064527a3ba84 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:53.739376 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbbc51-409d-4c14-a503-202e3b63bb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:53.740054 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbbc51-409d-4c14-a503-202e3b63bb80 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:53.740342 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbbc51-409d-4c14-a503-202e3b63bb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:53.740749 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbbc51-409d-4c14-a503-202e3b63bb80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:53.741801 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbbc51-409d-4c14-a503-202e3b63bb80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:53.743406 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbbc51-409d-4c14-a503-202e3b63bb80 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:53.755243 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1144/2276] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:22:53.759333 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa60ae-b324-457c-b260-5d0df815df19 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:53.771331 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa60ae-b324-457c-b260-5d0df815df19 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:53.781136 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376488a-fce4-4c3d-ab7d-f4f97c04f759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:53.782226 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376488a-fce4-4c3d-ab7d-f4f97c04f759 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:53.782651 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376488a-fce4-4c3d-ab7d-f4f97c04f759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:53.782940 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376488a-fce4-4c3d-ab7d-f4f97c04f759 admin admin] PATH_INFO: `/v3/projects/399460ad87864497bc47daf8be312bcb/users/d74e2cac77bf4081a342e5ccc2b7a177/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:53.799079 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376488a-fce4-4c3d-ab7d-f4f97c04f759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=399460ad87864497bc47daf8be312bcb, user_id=d74e2cac77bf4081a342e5ccc2b7a177, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:53.801785 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376488a-fce4-4c3d-ab7d-f4f97c04f759 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:53.891009 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1133/2277] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:22:53 2022] PUT /identity/v3/projects/399460ad87864497bc47daf8be312bcb/users/d74e2cac77bf4081a342e5ccc2b7a177/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:53.901790 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ca31a-b041-4567-ba61-308eb4d8eaa2 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:53.902355 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ca31a-b041-4567-ba61-308eb4d8eaa2 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:53.902449 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ca31a-b041-4567-ba61-308eb4d8eaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:53.932180 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-6f0ca31a-b041-4567-ba61-308eb4d8eaa2 None None] MFA Rules not processed for user `d74e2cac77bf4081a342e5ccc2b7a177`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:53.933531 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-6f0ca31a-b041-4567-ba61-308eb4d8eaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:53.998827 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1145/2278] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:22:54.003431 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376488a-fce4-4c3d-ab7d-f4f97c04f759 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:54.063262 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ca31a-b041-4567-ba61-308eb4d8eaa2 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:54.064828 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-6f0ca31a-b041-4567-ba61-308eb4d8eaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:54.074529 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376488a-fce4-4c3d-ab7d-f4f97c04f759 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:54.080277 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ca31a-b041-4567-ba61-308eb4d8eaa2 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:54.081006 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b80bb-52d3-43c2-875b-3b4a34e51f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:54.081761 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b80bb-52d3-43c2-875b-3b4a34e51f8c admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:54.082057 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b80bb-52d3-43c2-875b-3b4a34e51f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:54.082341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b80bb-52d3-43c2-875b-3b4a34e51f8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:54.083114 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b80bb-52d3-43c2-875b-3b4a34e51f8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:54.085063 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b80bb-52d3-43c2-875b-3b4a34e51f8c admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:54.085830 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561a495-6582-4b91-b0b5-a3222b2f00ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:54.086865 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561a495-6582-4b91-b0b5-a3222b2f00ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:54.087284 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561a495-6582-4b91-b0b5-a3222b2f00ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:54.087659 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561a495-6582-4b91-b0b5-a3222b2f00ba admin admin] PATH_INFO: `/v3/users/36eec2606934496eb8238f2b198a7762` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:54.089139 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561a495-6582-4b91-b0b5-a3222b2f00ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=36eec2606934496eb8238f2b198a7762)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:54.091360 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561a495-6582-4b91-b0b5-a3222b2f00ba admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:54.149680 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1134/2279] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:22:54 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:22:54.153658 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b80bb-52d3-43c2-875b-3b4a34e51f8c admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:54.222170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b80bb-52d3-43c2-875b-3b4a34e51f8c admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:54.227650 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c44619-6d27-4644-a8b1-4271045b80e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:54.228328 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c44619-6d27-4644-a8b1-4271045b80e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:54.228625 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c44619-6d27-4644-a8b1-4271045b80e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:54.229220 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c44619-6d27-4644-a8b1-4271045b80e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:54.229792 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c44619-6d27-4644-a8b1-4271045b80e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:54.231761 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c44619-6d27-4644-a8b1-4271045b80e2 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:54.251286 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d561a495-6582-4b91-b0b5-a3222b2f00ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36eec2606934496eb8238f2b198a7762'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:54.317779 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1135/2280] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:22:54 2022] POST /identity/v3/users => generated 294 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:22:54.318882 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c44619-6d27-4644-a8b1-4271045b80e2 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:54.324808 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d561a495-6582-4b91-b0b5-a3222b2f00ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36eec2606934496eb8238f2b198a7762'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:54.325534 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d561a495-6582-4b91-b0b5-a3222b2f00ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36eec2606934496eb8238f2b198a7762'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:54.326157 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d561a495-6582-4b91-b0b5-a3222b2f00ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36eec2606934496eb8238f2b198a7762'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:54.336367 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d561a495-6582-4b91-b0b5-a3222b2f00ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36eec2606934496eb8238f2b198a7762'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:54.338955 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c44619-6d27-4644-a8b1-4271045b80e2 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:54.344041 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d588d5-4258-4bb3-a9ca-d687abac09e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:54.344925 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d588d5-4258-4bb3-a9ca-d687abac09e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:54.345322 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d588d5-4258-4bb3-a9ca-d687abac09e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:54.346128 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d588d5-4258-4bb3-a9ca-d687abac09e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:54.346971 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d588d5-4258-4bb3-a9ca-d687abac09e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:54.349541 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d588d5-4258-4bb3-a9ca-d687abac09e2 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:54.374589 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1146/2281] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:22:54 2022] DELETE /identity/v3/users/36eec2606934496eb8238f2b198a7762 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:54.379166 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1136/2282] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:22:54.387255 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b11e87-65b9-4326-ad91-f6de14ed157b None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:54.387255 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b11e87-65b9-4326-ad91-f6de14ed157b None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:54.387255 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b11e87-65b9-4326-ad91-f6de14ed157b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:54.387478 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d588d5-4258-4bb3-a9ca-d687abac09e2 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:54.388954 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-f4d588d5-4258-4bb3-a9ca-d687abac09e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:54.419052 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d588d5-4258-4bb3-a9ca-d687abac09e2 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:54.421218 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-b7b11e87-65b9-4326-ad91-f6de14ed157b None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:54.423309 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b7b11e87-65b9-4326-ad91-f6de14ed157b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:54.496665 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1147/2283] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:22:54.507284 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b11e87-65b9-4326-ad91-f6de14ed157b None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:54.509753 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b7b11e87-65b9-4326-ad91-f6de14ed157b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:54.547446 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee24b63-5350-4984-9132-a720a9324293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:54.548468 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee24b63-5350-4984-9132-a720a9324293 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:54.548759 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee24b63-5350-4984-9132-a720a9324293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:54.549042 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee24b63-5350-4984-9132-a720a9324293 admin admin] PATH_INFO: `/v3/projects/a9450f03c47b426381034fa8f15fad44/users/e9bda21c091f4907b76ace1ce588ed19/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:54.566812 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee24b63-5350-4984-9132-a720a9324293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9450f03c47b426381034fa8f15fad44, user_id=e9bda21c091f4907b76ace1ce588ed19, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:54.569834 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee24b63-5350-4984-9132-a720a9324293 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:54.602583 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b11e87-65b9-4326-ad91-f6de14ed157b None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:54.606847 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2cbea-62e1-45af-9ec1-b0701d9cd98f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:54.607525 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2cbea-62e1-45af-9ec1-b0701d9cd98f service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:54.607811 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2cbea-62e1-45af-9ec1-b0701d9cd98f service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:54.608150 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2cbea-62e1-45af-9ec1-b0701d9cd98f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:54.618324 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2cbea-62e1-45af-9ec1-b0701d9cd98f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:54.619755 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2cbea-62e1-45af-9ec1-b0701d9cd98f service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:54.631658 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1148/2284] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:22:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:22:54.656444 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1137/2285] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:22:54 2022] PUT /identity/v3/projects/a9450f03c47b426381034fa8f15fad44/users/e9bda21c091f4907b76ace1ce588ed19/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:54.659985 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2cbea-62e1-45af-9ec1-b0701d9cd98f service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:54.670344 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2cbea-62e1-45af-9ec1-b0701d9cd98f service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:54.749128 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f06e2a-da70-41e0-9827-e1b9ecf95ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:54.750047 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f06e2a-da70-41e0-9827-e1b9ecf95ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:54.750393 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f06e2a-da70-41e0-9827-e1b9ecf95ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:54.750615 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f06e2a-da70-41e0-9827-e1b9ecf95ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:54.752674 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f06e2a-da70-41e0-9827-e1b9ecf95ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:54.754837 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f06e2a-da70-41e0-9827-e1b9ecf95ca4 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:54.767639 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1149/2286] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:22:54.771673 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee24b63-5350-4984-9132-a720a9324293 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:54.783849 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee24b63-5350-4984-9132-a720a9324293 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:54.789350 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c1829-049c-4d7a-b697-90a4cbe5268c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:54.790437 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c1829-049c-4d7a-b697-90a4cbe5268c admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:54.791057 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c1829-049c-4d7a-b697-90a4cbe5268c admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:54.791057 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c1829-049c-4d7a-b697-90a4cbe5268c admin admin] PATH_INFO: `/v3/projects/a9450f03c47b426381034fa8f15fad44/users/e9bda21c091f4907b76ace1ce588ed19/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:54.793364 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c1829-049c-4d7a-b697-90a4cbe5268c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9450f03c47b426381034fa8f15fad44, user_id=e9bda21c091f4907b76ace1ce588ed19, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:54.798858 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c1829-049c-4d7a-b697-90a4cbe5268c admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:54.811312 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1138/2287] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:22:54 2022] PUT /identity/v3/projects/a9450f03c47b426381034fa8f15fad44/users/e9bda21c091f4907b76ace1ce588ed19/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:54.822448 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a4650-7073-488e-8ed7-d143f0a42808 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:54.822742 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a4650-7073-488e-8ed7-d143f0a42808 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:54.823028 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a4650-7073-488e-8ed7-d143f0a42808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:54.870070 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-852a4650-7073-488e-8ed7-d143f0a42808 None None] MFA Rules not processed for user `e9bda21c091f4907b76ace1ce588ed19`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:54.871552 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-852a4650-7073-488e-8ed7-d143f0a42808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:55.022940 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1150/2288] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:22:55.034783 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c1829-049c-4d7a-b697-90a4cbe5268c admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:55.036477 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-501c1829-049c-4d7a-b697-90a4cbe5268c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:55.098318 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c1829-049c-4d7a-b697-90a4cbe5268c admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:55.103633 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e237ef1-ccf8-4c1c-aebc-0fe8b239c5cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:55.104582 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e237ef1-ccf8-4c1c-aebc-0fe8b239c5cb service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:55.105013 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e237ef1-ccf8-4c1c-aebc-0fe8b239c5cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:55.105538 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e237ef1-ccf8-4c1c-aebc-0fe8b239c5cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:55.120749 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e237ef1-ccf8-4c1c-aebc-0fe8b239c5cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:55.120749 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e237ef1-ccf8-4c1c-aebc-0fe8b239c5cb service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:55.132228 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1139/2289] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:22:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:22:55.181066 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a4650-7073-488e-8ed7-d143f0a42808 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:55.183441 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-852a4650-7073-488e-8ed7-d143f0a42808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:55.285100 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a4650-7073-488e-8ed7-d143f0a42808 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:55.290612 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58d89e-9560-4e55-8010-f837f1a2ff8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:55.291607 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58d89e-9560-4e55-8010-f837f1a2ff8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:55.291838 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58d89e-9560-4e55-8010-f837f1a2ff8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:55.292121 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58d89e-9560-4e55-8010-f837f1a2ff8a admin admin] PATH_INFO: `/v3/projects/4fa1deb2c93e4fa697f73509496d004a` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:55.293420 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58d89e-9560-4e55-8010-f837f1a2ff8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fa1deb2c93e4fa697f73509496d004a)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:55.295389 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58d89e-9560-4e55-8010-f837f1a2ff8a admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:55.367439 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e237ef1-ccf8-4c1c-aebc-0fe8b239c5cb service cinder] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:55.376291 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e237ef1-ccf8-4c1c-aebc-0fe8b239c5cb service cinder] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:55.381318 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023215d8-195d-48d3-bcce-6494f1ac1367 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:55.381977 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023215d8-195d-48d3-bcce-6494f1ac1367 service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:55.382267 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023215d8-195d-48d3-bcce-6494f1ac1367 service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:55.382535 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023215d8-195d-48d3-bcce-6494f1ac1367 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:55.384379 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-023215d8-195d-48d3-bcce-6494f1ac1367 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:55.433799 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-8e58d89e-9560-4e55-8010-f837f1a2ff8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fa1deb2c93e4fa697f73509496d004a', 'request_id': 'req-8e58d89e-9560-4e55-8010-f837f1a2ff8a'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:55.440254 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-8e58d89e-9560-4e55-8010-f837f1a2ff8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fa1deb2c93e4fa697f73509496d004a', 'request_id': 'req-8e58d89e-9560-4e55-8010-f837f1a2ff8a'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:55.446492 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-8e58d89e-9560-4e55-8010-f837f1a2ff8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fa1deb2c93e4fa697f73509496d004a', 'request_id': 'req-8e58d89e-9560-4e55-8010-f837f1a2ff8a'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:55.459095 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023215d8-195d-48d3-bcce-6494f1ac1367 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:55.460537 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023215d8-195d-48d3-bcce-6494f1ac1367 service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:55.469945 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1140/2290] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:22:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:22:55.599224 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-8e58d89e-9560-4e55-8010-f837f1a2ff8a admin admin] The token cache is being invalidate because project 4fa1deb2c93e4fa697f73509496d004a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:22:55.599519 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-8e58d89e-9560-4e55-8010-f837f1a2ff8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:55.600146 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-8e58d89e-9560-4e55-8010-f837f1a2ff8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:55.601981 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1151/2291] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:22:55 2022] DELETE /identity/v3/projects/4fa1deb2c93e4fa697f73509496d004a => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:55.606713 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd024f-8dad-4197-bdeb-85ff6fed4901 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:55.607010 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd024f-8dad-4197-bdeb-85ff6fed4901 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:55.607297 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd024f-8dad-4197-bdeb-85ff6fed4901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:55.627771 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-bbdd024f-8dad-4197-bdeb-85ff6fed4901 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:55.629098 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-bbdd024f-8dad-4197-bdeb-85ff6fed4901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:55.700963 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1141/2292] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:22:55.708549 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b7acb-4266-4bd4-9cbe-1b91aa7160f2 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:55.708841 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b7acb-4266-4bd4-9cbe-1b91aa7160f2 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:55.709124 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b7acb-4266-4bd4-9cbe-1b91aa7160f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:55.730628 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-ee2b7acb-4266-4bd4-9cbe-1b91aa7160f2 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:55.731852 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-ee2b7acb-4266-4bd4-9cbe-1b91aa7160f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:55.742528 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1152/2293] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:22:55.746779 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd024f-8dad-4197-bdeb-85ff6fed4901 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:55.757600 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd024f-8dad-4197-bdeb-85ff6fed4901 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:55.762766 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bca35-1857-4017-88fd-f9e20adbfe1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:55.763506 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bca35-1857-4017-88fd-f9e20adbfe1c admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:55.763870 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bca35-1857-4017-88fd-f9e20adbfe1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:55.764225 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bca35-1857-4017-88fd-f9e20adbfe1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:55.765069 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30bca35-1857-4017-88fd-f9e20adbfe1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:22:55.765593 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30bca35-1857-4017-88fd-f9e20adbfe1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:55.767385 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30bca35-1857-4017-88fd-f9e20adbfe1c admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:55.780181 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1142/2294] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:22:55.784899 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b7acb-4266-4bd4-9cbe-1b91aa7160f2 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:55.795847 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b7acb-4266-4bd4-9cbe-1b91aa7160f2 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:55.802393 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d5511-fd39-4ab1-922d-acf6a1e6d48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:55.803173 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d5511-fd39-4ab1-922d-acf6a1e6d48e admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:55.803535 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d5511-fd39-4ab1-922d-acf6a1e6d48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:55.803908 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d5511-fd39-4ab1-922d-acf6a1e6d48e admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:55.804672 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d5511-fd39-4ab1-922d-acf6a1e6d48e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:55.806716 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d5511-fd39-4ab1-922d-acf6a1e6d48e admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:55.924974 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1153/2295] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:22:55 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:22:55.929893 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bca35-1857-4017-88fd-f9e20adbfe1c admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:55.953191 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bca35-1857-4017-88fd-f9e20adbfe1c admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:56.066985 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e6938-9485-48da-9617-56b90bc64485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:56.067569 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e6938-9485-48da-9617-56b90bc64485 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:56.067854 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e6938-9485-48da-9617-56b90bc64485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:56.068133 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e6938-9485-48da-9617-56b90bc64485 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:56.068831 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e6938-9485-48da-9617-56b90bc64485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:56.071039 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e6938-9485-48da-9617-56b90bc64485 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:56.143546 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1143/2296] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:22:55 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:22:56.143911 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7dbcd-8a8d-4869-8fde-0b5072bfcd38 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:56.144418 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7dbcd-8a8d-4869-8fde-0b5072bfcd38 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:56.144543 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7dbcd-8a8d-4869-8fde-0b5072bfcd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:56.149325 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e6938-9485-48da-9617-56b90bc64485 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:56.161147 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e6938-9485-48da-9617-56b90bc64485 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:56.165025 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-a3f7dbcd-8a8d-4869-8fde-0b5072bfcd38 None None] MFA Rules not processed for user `a706b6d0163549bc80285c4158331b94`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:56.168050 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a3f7dbcd-8a8d-4869-8fde-0b5072bfcd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:56.168164 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ebef7-3830-419d-a149-47aa00187dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:56.168164 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ebef7-3830-419d-a149-47aa00187dce admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:56.168164 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ebef7-3830-419d-a149-47aa00187dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:56.168164 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ebef7-3830-419d-a149-47aa00187dce admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:56.168589 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ebef7-3830-419d-a149-47aa00187dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:56.170220 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ebef7-3830-419d-a149-47aa00187dce admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:56.180402 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1144/2297] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:22:56.184301 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ebef7-3830-419d-a149-47aa00187dce admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:56.194787 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ebef7-3830-419d-a149-47aa00187dce admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:56.199782 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a865f-8ab5-45d7-a109-7eef994ffd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:56.200429 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a865f-8ab5-45d7-a109-7eef994ffd98 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:56.200719 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a865f-8ab5-45d7-a109-7eef994ffd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:56.201007 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a865f-8ab5-45d7-a109-7eef994ffd98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:56.203364 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a865f-8ab5-45d7-a109-7eef994ffd98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:56.206311 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a865f-8ab5-45d7-a109-7eef994ffd98 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:56.219776 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1145/2298] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:22:56.224180 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a865f-8ab5-45d7-a109-7eef994ffd98 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:56.234076 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1154/2299] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Mar 29 20:22:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:22:56.243491 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a865f-8ab5-45d7-a109-7eef994ffd98 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:56.249108 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400d76b-7cac-4d77-bdb2-bb0d0394fffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:56.250101 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400d76b-7cac-4d77-bdb2-bb0d0394fffa admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:56.250392 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400d76b-7cac-4d77-bdb2-bb0d0394fffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:56.253631 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400d76b-7cac-4d77-bdb2-bb0d0394fffa admin admin] PATH_INFO: `/v3/projects/594de1decf6c490ab56923a18a8b8262/users/7637014da2fd482d9f4a330879270470/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:56.267621 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400d76b-7cac-4d77-bdb2-bb0d0394fffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=594de1decf6c490ab56923a18a8b8262, user_id=7637014da2fd482d9f4a330879270470, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:56.270404 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400d76b-7cac-4d77-bdb2-bb0d0394fffa admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:56.287788 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7dbcd-8a8d-4869-8fde-0b5072bfcd38 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:56.289230 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a3f7dbcd-8a8d-4869-8fde-0b5072bfcd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:56.342757 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1146/2300] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:22:56 2022] PUT /identity/v3/projects/594de1decf6c490ab56923a18a8b8262/users/7637014da2fd482d9f4a330879270470/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:22:56.351929 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0810be-3df4-46c6-ad96-d38eadbcefbe None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:56.352220 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0810be-3df4-46c6-ad96-d38eadbcefbe None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:56.352526 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0810be-3df4-46c6-ad96-d38eadbcefbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:56.370408 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7dbcd-8a8d-4869-8fde-0b5072bfcd38 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:56.381644 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-cf0810be-3df4-46c6-ad96-d38eadbcefbe None None] MFA Rules not processed for user `7637014da2fd482d9f4a330879270470`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:56.382898 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-cf0810be-3df4-46c6-ad96-d38eadbcefbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:56.449223 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f417c-30e5-4735-865b-0a744d8e3be5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d6d8e7788494f2c92ad5c183c8fa283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:56.450024 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f417c-30e5-4735-865b-0a744d8e3be5 service swift] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:56.450314 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f417c-30e5-4735-865b-0a744d8e3be5 service swift] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:56.450595 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f417c-30e5-4735-865b-0a744d8e3be5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:56.460308 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1147/2301] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:22:56.472783 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0810be-3df4-46c6-ad96-d38eadbcefbe None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:56.474279 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-cf0810be-3df4-46c6-ad96-d38eadbcefbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:56.527146 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f417c-30e5-4735-865b-0a744d8e3be5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:56.529138 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f417c-30e5-4735-865b-0a744d8e3be5 service swift] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:56.538584 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1155/2302] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Mar 29 20:22:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 29 20:22:56.596689 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0810be-3df4-46c6-ad96-d38eadbcefbe None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:56.600871 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118438b4-b488-4cac-ade1-896f221ed3a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:56.607139 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118438b4-b488-4cac-ade1-896f221ed3a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:56.607139 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118438b4-b488-4cac-ade1-896f221ed3a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:56.607139 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118438b4-b488-4cac-ade1-896f221ed3a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:56.613144 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118438b4-b488-4cac-ade1-896f221ed3a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:56.614841 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118438b4-b488-4cac-ade1-896f221ed3a6 service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:56.633345 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1148/2303] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:22:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:22:56.667465 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f417c-30e5-4735-865b-0a744d8e3be5 service swift] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:56.783268 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f417c-30e5-4735-865b-0a744d8e3be5 service swift] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:56.788715 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9164b1-276c-40ee-b1dd-d5f3ba09de6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:56.790282 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9164b1-276c-40ee-b1dd-d5f3ba09de6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:56.790843 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9164b1-276c-40ee-b1dd-d5f3ba09de6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:56.791237 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9164b1-276c-40ee-b1dd-d5f3ba09de6f admin admin] PATH_INFO: `/v3/users/7637014da2fd482d9f4a330879270470` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:56.793946 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9164b1-276c-40ee-b1dd-d5f3ba09de6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7637014da2fd482d9f4a330879270470)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:56.796305 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9164b1-276c-40ee-b1dd-d5f3ba09de6f admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:56.972299 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ac9164b1-276c-40ee-b1dd-d5f3ba09de6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7637014da2fd482d9f4a330879270470'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:57.050801 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ac9164b1-276c-40ee-b1dd-d5f3ba09de6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7637014da2fd482d9f4a330879270470'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:57.051547 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ac9164b1-276c-40ee-b1dd-d5f3ba09de6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7637014da2fd482d9f4a330879270470'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:57.052197 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ac9164b1-276c-40ee-b1dd-d5f3ba09de6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7637014da2fd482d9f4a330879270470'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:57.069864 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ac9164b1-276c-40ee-b1dd-d5f3ba09de6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7637014da2fd482d9f4a330879270470'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:22:57.126123 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1156/2304] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:22:56 2022] DELETE /identity/v3/users/7637014da2fd482d9f4a330879270470 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:22:57.128218 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d8141-c6e7-432e-9493-760f7edaf60f None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:57.128593 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d8141-c6e7-432e-9493-760f7edaf60f None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:57.129006 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d8141-c6e7-432e-9493-760f7edaf60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:57.172098 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-9a0d8141-c6e7-432e-9493-760f7edaf60f None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:22:57.173567 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9a0d8141-c6e7-432e-9493-760f7edaf60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:57.366844 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1149/2305] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:22:57.431135 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9164b1-276c-40ee-b1dd-d5f3ba09de6f admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:57.434940 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-ac9164b1-276c-40ee-b1dd-d5f3ba09de6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:57.567458 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9164b1-276c-40ee-b1dd-d5f3ba09de6f admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:57.576763 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1766d-d225-43e8-9526-f4353dcc4386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:57.577478 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1766d-d225-43e8-9526-f4353dcc4386 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:57.578298 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1766d-d225-43e8-9526-f4353dcc4386 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:57.578852 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1766d-d225-43e8-9526-f4353dcc4386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:57.615421 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1766d-d225-43e8-9526-f4353dcc4386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:57.616811 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1766d-d225-43e8-9526-f4353dcc4386 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:57.628917 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1157/2306] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:22:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:22:59.707159 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d8141-c6e7-432e-9493-760f7edaf60f None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:22:59.709465 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9a0d8141-c6e7-432e-9493-760f7edaf60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:22:59.738580 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d8141-c6e7-432e-9493-760f7edaf60f None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:22:59.774366 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37df705-911e-4ffe-b970-b501b850516b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:22:59.775625 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37df705-911e-4ffe-b970-b501b850516b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:22:59.776249 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37df705-911e-4ffe-b970-b501b850516b admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:22:59.776854 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37df705-911e-4ffe-b970-b501b850516b admin admin] PATH_INFO: `/v3/projects/594de1decf6c490ab56923a18a8b8262` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:22:59.778649 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37df705-911e-4ffe-b970-b501b850516b admin admin] RBAC: Authorizing `identity:delete_project(project_id=594de1decf6c490ab56923a18a8b8262)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:22:59.782890 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37df705-911e-4ffe-b970-b501b850516b admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:22:59.947527 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f37df705-911e-4ffe-b970-b501b850516b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '594de1decf6c490ab56923a18a8b8262', 'request_id': 'req-f37df705-911e-4ffe-b970-b501b850516b'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:00.241030 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f37df705-911e-4ffe-b970-b501b850516b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '594de1decf6c490ab56923a18a8b8262', 'request_id': 'req-f37df705-911e-4ffe-b970-b501b850516b'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:00.251372 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f37df705-911e-4ffe-b970-b501b850516b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '594de1decf6c490ab56923a18a8b8262', 'request_id': 'req-f37df705-911e-4ffe-b970-b501b850516b'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:00.397467 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f37df705-911e-4ffe-b970-b501b850516b admin admin] The token cache is being invalidate because project 594de1decf6c490ab56923a18a8b8262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:23:00.397467 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f37df705-911e-4ffe-b970-b501b850516b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:00.397467 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f37df705-911e-4ffe-b970-b501b850516b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:00.397467 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1150/2307] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:22:59 2022] DELETE /identity/v3/projects/594de1decf6c490ab56923a18a8b8262 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:23:00.407897 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54b7d4-1158-428b-971b-615d6d6757f2 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:00.408527 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54b7d4-1158-428b-971b-615d6d6757f2 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:00.408527 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54b7d4-1158-428b-971b-615d6d6757f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:00.439767 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-af54b7d4-1158-428b-971b-615d6d6757f2 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:23:00.475400 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-af54b7d4-1158-428b-971b-615d6d6757f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:00.576316 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1158/2308] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:23:00.604943 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fe031-1133-476b-9ba5-4c60710af075 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:00.604943 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fe031-1133-476b-9ba5-4c60710af075 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:00.604943 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fe031-1133-476b-9ba5-4c60710af075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:00.608906 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-3b4fe031-1133-476b-9ba5-4c60710af075 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:23:00.610944 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-3b4fe031-1133-476b-9ba5-4c60710af075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:00.625182 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1151/2309] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:23:00.629892 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54b7d4-1158-428b-971b-615d6d6757f2 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:00.640201 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54b7d4-1158-428b-971b-615d6d6757f2 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:00.645028 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73468b10-0b3a-47f9-aa8d-dc34aba2a23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:00.645809 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73468b10-0b3a-47f9-aa8d-dc34aba2a23e admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:00.646115 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73468b10-0b3a-47f9-aa8d-dc34aba2a23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:00.646376 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73468b10-0b3a-47f9-aa8d-dc34aba2a23e admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:00.647105 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73468b10-0b3a-47f9-aa8d-dc34aba2a23e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:23:00.649963 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73468b10-0b3a-47f9-aa8d-dc34aba2a23e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:00.652657 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73468b10-0b3a-47f9-aa8d-dc34aba2a23e admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:00.671946 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fe031-1133-476b-9ba5-4c60710af075 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:00.677257 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1159/2310] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:23:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:23:00.683111 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fe031-1133-476b-9ba5-4c60710af075 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:00.691679 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f667e-16ae-43c5-aba3-263a5a612ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:00.692458 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f667e-16ae-43c5-aba3-263a5a612ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:00.692841 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f667e-16ae-43c5-aba3-263a5a612ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:00.693198 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f667e-16ae-43c5-aba3-263a5a612ed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:00.694291 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f667e-16ae-43c5-aba3-263a5a612ed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:00.696299 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f667e-16ae-43c5-aba3-263a5a612ed3 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:00.973469 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1152/2311] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:23:00 2022] POST /identity/v3/projects => generated 383 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:23:00.978354 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73468b10-0b3a-47f9-aa8d-dc34aba2a23e admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:00.998616 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73468b10-0b3a-47f9-aa8d-dc34aba2a23e admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:01.063215 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdcfdd-cd3b-4c96-beab-1e12e7815359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:01.064065 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdcfdd-cd3b-4c96-beab-1e12e7815359 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:01.064357 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdcfdd-cd3b-4c96-beab-1e12e7815359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:01.064637 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdcfdd-cd3b-4c96-beab-1e12e7815359 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:01.065369 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebdcfdd-cd3b-4c96-beab-1e12e7815359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:01.067322 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebdcfdd-cd3b-4c96-beab-1e12e7815359 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:01.308017 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1160/2312] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:23:00 2022] POST /identity/v3/users => generated 292 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:23:01.312255 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f667e-16ae-43c5-aba3-263a5a612ed3 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:01.323226 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f667e-16ae-43c5-aba3-263a5a612ed3 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:01.327792 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452acaf-9c0a-4636-9103-e60ded7f0a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:01.328457 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452acaf-9c0a-4636-9103-e60ded7f0a5f admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:01.328832 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452acaf-9c0a-4636-9103-e60ded7f0a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:01.329075 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452acaf-9c0a-4636-9103-e60ded7f0a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:01.329835 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452acaf-9c0a-4636-9103-e60ded7f0a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:01.331410 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452acaf-9c0a-4636-9103-e60ded7f0a5f admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:01.341565 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1153/2313] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:23:01.346795 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdcfdd-cd3b-4c96-beab-1e12e7815359 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:01.356713 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdcfdd-cd3b-4c96-beab-1e12e7815359 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:01.362595 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81c2f0-0c0b-42db-a2df-4a86273aee33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:01.363355 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81c2f0-0c0b-42db-a2df-4a86273aee33 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:01.363647 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81c2f0-0c0b-42db-a2df-4a86273aee33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:01.364409 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81c2f0-0c0b-42db-a2df-4a86273aee33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:01.364663 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81c2f0-0c0b-42db-a2df-4a86273aee33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:01.366331 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81c2f0-0c0b-42db-a2df-4a86273aee33 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:01.377467 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1161/2314] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:23:01.381655 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452acaf-9c0a-4636-9103-e60ded7f0a5f admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:01.393275 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452acaf-9c0a-4636-9103-e60ded7f0a5f admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:01.398043 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e41b5-2962-4734-9dd8-b61c6e6edfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:01.398965 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e41b5-2962-4734-9dd8-b61c6e6edfb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:01.399251 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e41b5-2962-4734-9dd8-b61c6e6edfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:01.399532 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e41b5-2962-4734-9dd8-b61c6e6edfb8 admin admin] PATH_INFO: `/v3/projects/2f6b0dd8bfcc425ab8ede8ef9179704f/users/6aaa0c43a8d64df294186dbde0edd025/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:01.425461 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e41b5-2962-4734-9dd8-b61c6e6edfb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f6b0dd8bfcc425ab8ede8ef9179704f, user_id=6aaa0c43a8d64df294186dbde0edd025, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:01.428291 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e41b5-2962-4734-9dd8-b61c6e6edfb8 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:01.540651 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9671a5-2003-436e-9b78-571574d15e9e None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:01.541240 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9671a5-2003-436e-9b78-571574d15e9e None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:01.541459 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9671a5-2003-436e-9b78-571574d15e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:01.545602 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1154/2315] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:23:01 2022] PUT /identity/v3/projects/2f6b0dd8bfcc425ab8ede8ef9179704f/users/6aaa0c43a8d64df294186dbde0edd025/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:23:01.565750 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-7d9671a5-2003-436e-9b78-571574d15e9e None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:23:01.566540 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-7d9671a5-2003-436e-9b78-571574d15e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:01.647430 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1162/2316] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:23:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:23:01.660221 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e41b5-2962-4734-9dd8-b61c6e6edfb8 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:01.662258 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-895e41b5-2962-4734-9dd8-b61c6e6edfb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:01.731356 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e41b5-2962-4734-9dd8-b61c6e6edfb8 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:01.735188 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263221f-1bf3-4c2a-8404-39d4d1d50ca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:01.736094 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263221f-1bf3-4c2a-8404-39d4d1d50ca3 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:01.736383 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263221f-1bf3-4c2a-8404-39d4d1d50ca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:01.736669 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263221f-1bf3-4c2a-8404-39d4d1d50ca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:01.746513 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263221f-1bf3-4c2a-8404-39d4d1d50ca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:01.748087 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263221f-1bf3-4c2a-8404-39d4d1d50ca3 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:01.765506 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1155/2317] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:23:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:23:08.852650 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9671a5-2003-436e-9b78-571574d15e9e None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:08.858439 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-7d9671a5-2003-436e-9b78-571574d15e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:08.879591 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9671a5-2003-436e-9b78-571574d15e9e None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:08.888926 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764c2a8-779b-4ed9-b7df-90e5fc9b4581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:08.889852 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764c2a8-779b-4ed9-b7df-90e5fc9b4581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:08.890137 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764c2a8-779b-4ed9-b7df-90e5fc9b4581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:08.890413 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764c2a8-779b-4ed9-b7df-90e5fc9b4581 admin admin] PATH_INFO: `/v3/users/d74e2cac77bf4081a342e5ccc2b7a177` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:08.908906 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764c2a8-779b-4ed9-b7df-90e5fc9b4581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d74e2cac77bf4081a342e5ccc2b7a177)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:08.910931 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764c2a8-779b-4ed9-b7df-90e5fc9b4581 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:09.129939 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7764c2a8-779b-4ed9-b7df-90e5fc9b4581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd74e2cac77bf4081a342e5ccc2b7a177'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:09.222792 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7764c2a8-779b-4ed9-b7df-90e5fc9b4581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd74e2cac77bf4081a342e5ccc2b7a177'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:09.224390 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7764c2a8-779b-4ed9-b7df-90e5fc9b4581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd74e2cac77bf4081a342e5ccc2b7a177'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:09.225477 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7764c2a8-779b-4ed9-b7df-90e5fc9b4581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd74e2cac77bf4081a342e5ccc2b7a177'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:09.237650 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7764c2a8-779b-4ed9-b7df-90e5fc9b4581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd74e2cac77bf4081a342e5ccc2b7a177'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:09.281012 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1163/2318] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:23:08 2022] DELETE /identity/v3/users/d74e2cac77bf4081a342e5ccc2b7a177 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:23:09.287027 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47556146-3182-4c35-aacc-7ac49dc13152 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:09.288059 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47556146-3182-4c35-aacc-7ac49dc13152 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:09.289033 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47556146-3182-4c35-aacc-7ac49dc13152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:09.323156 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-47556146-3182-4c35-aacc-7ac49dc13152 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:23:09.326087 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-47556146-3182-4c35-aacc-7ac49dc13152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:09.478947 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1156/2319] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:23:09.491676 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764c2a8-779b-4ed9-b7df-90e5fc9b4581 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:09.493189 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-7764c2a8-779b-4ed9-b7df-90e5fc9b4581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:09.650565 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764c2a8-779b-4ed9-b7df-90e5fc9b4581 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:09.655583 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffd6ce-13a4-4d08-9260-cea1bedd2824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:09.656274 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffd6ce-13a4-4d08-9260-cea1bedd2824 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:09.656562 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffd6ce-13a4-4d08-9260-cea1bedd2824 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:09.657666 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffd6ce-13a4-4d08-9260-cea1bedd2824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:09.680463 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffd6ce-13a4-4d08-9260-cea1bedd2824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:09.682281 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffd6ce-13a4-4d08-9260-cea1bedd2824 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:09.695348 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1164/2320] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:23:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:23:10.368062 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47556146-3182-4c35-aacc-7ac49dc13152 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:10.369760 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-47556146-3182-4c35-aacc-7ac49dc13152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:10.412877 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47556146-3182-4c35-aacc-7ac49dc13152 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:10.420976 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd20fa-5d60-4733-b57e-931493e0fbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:10.423146 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd20fa-5d60-4733-b57e-931493e0fbcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:10.425463 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd20fa-5d60-4733-b57e-931493e0fbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:10.425463 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd20fa-5d60-4733-b57e-931493e0fbcb admin admin] PATH_INFO: `/v3/projects/399460ad87864497bc47daf8be312bcb` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:10.425838 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd20fa-5d60-4733-b57e-931493e0fbcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=399460ad87864497bc47daf8be312bcb)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:10.428257 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd20fa-5d60-4733-b57e-931493e0fbcb admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:10.596758 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-d1cd20fa-5d60-4733-b57e-931493e0fbcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '399460ad87864497bc47daf8be312bcb', 'request_id': 'req-d1cd20fa-5d60-4733-b57e-931493e0fbcb'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:10.671621 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-d1cd20fa-5d60-4733-b57e-931493e0fbcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '399460ad87864497bc47daf8be312bcb', 'request_id': 'req-d1cd20fa-5d60-4733-b57e-931493e0fbcb'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:10.680183 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-d1cd20fa-5d60-4733-b57e-931493e0fbcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '399460ad87864497bc47daf8be312bcb', 'request_id': 'req-d1cd20fa-5d60-4733-b57e-931493e0fbcb'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:10.711677 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-d1cd20fa-5d60-4733-b57e-931493e0fbcb admin admin] The token cache is being invalidate because project 399460ad87864497bc47daf8be312bcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:23:10.712029 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-d1cd20fa-5d60-4733-b57e-931493e0fbcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:10.712672 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-d1cd20fa-5d60-4733-b57e-931493e0fbcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:10.714648 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1157/2321] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:23:10 2022] DELETE /identity/v3/projects/399460ad87864497bc47daf8be312bcb => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:23:10.731326 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffd6ce-13a4-4d08-9260-cea1bedd2824 service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:10.743661 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffd6ce-13a4-4d08-9260-cea1bedd2824 service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:10.870296 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22880835-aaf3-4ce6-86d8-427669b87d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:10.871322 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22880835-aaf3-4ce6-86d8-427669b87d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:10.871620 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22880835-aaf3-4ce6-86d8-427669b87d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:10.871908 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22880835-aaf3-4ce6-86d8-427669b87d07 admin admin] PATH_INFO: `/v3/users/e9bda21c091f4907b76ace1ce588ed19` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:10.873553 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22880835-aaf3-4ce6-86d8-427669b87d07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9bda21c091f4907b76ace1ce588ed19)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:10.876550 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22880835-aaf3-4ce6-86d8-427669b87d07 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:11.559336 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-22880835-aaf3-4ce6-86d8-427669b87d07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9bda21c091f4907b76ace1ce588ed19'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:11.634211 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-22880835-aaf3-4ce6-86d8-427669b87d07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9bda21c091f4907b76ace1ce588ed19'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:11.634979 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-22880835-aaf3-4ce6-86d8-427669b87d07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9bda21c091f4907b76ace1ce588ed19'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:11.635705 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-22880835-aaf3-4ce6-86d8-427669b87d07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9bda21c091f4907b76ace1ce588ed19'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:11.647938 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-22880835-aaf3-4ce6-86d8-427669b87d07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9bda21c091f4907b76ace1ce588ed19'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:11.691160 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1165/2322] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:23:10 2022] DELETE /identity/v3/users/e9bda21c091f4907b76ace1ce588ed19 => generated 0 bytes in 960 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:23:12.331231 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468af44-ce62-4221-8cce-6d639884fa42 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:12.332257 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468af44-ce62-4221-8cce-6d639884fa42 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:12.332758 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468af44-ce62-4221-8cce-6d639884fa42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:12.394253 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-0468af44-ce62-4221-8cce-6d639884fa42 None None] MFA Rules not processed for user `6aaa0c43a8d64df294186dbde0edd025`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:23:12.396618 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-0468af44-ce62-4221-8cce-6d639884fa42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:12.550777 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22880835-aaf3-4ce6-86d8-427669b87d07 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:12.551863 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1158/2323] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:23:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:23:12.553229 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-22880835-aaf3-4ce6-86d8-427669b87d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:12.696100 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22880835-aaf3-4ce6-86d8-427669b87d07 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:12.708330 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468af44-ce62-4221-8cce-6d639884fa42 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:12.715183 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-0468af44-ce62-4221-8cce-6d639884fa42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:12.722155 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f96819-fba6-4a4d-9a0d-2a42dc0d1769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:12.723042 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f96819-fba6-4a4d-9a0d-2a42dc0d1769 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:12.723389 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f96819-fba6-4a4d-9a0d-2a42dc0d1769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:12.723749 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f96819-fba6-4a4d-9a0d-2a42dc0d1769 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:12.724530 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f96819-fba6-4a4d-9a0d-2a42dc0d1769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:12.726753 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f96819-fba6-4a4d-9a0d-2a42dc0d1769 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:12.736305 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468af44-ce62-4221-8cce-6d639884fa42 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:12.754215 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f64215-1f7f-49e5-9f32-938242808ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:12.756841 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f64215-1f7f-49e5-9f32-938242808ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:12.759406 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f64215-1f7f-49e5-9f32-938242808ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:12.759921 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f64215-1f7f-49e5-9f32-938242808ecf admin admin] PATH_INFO: `/v3/projects/a9450f03c47b426381034fa8f15fad44` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:12.763897 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f64215-1f7f-49e5-9f32-938242808ecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9450f03c47b426381034fa8f15fad44)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:12.771324 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f64215-1f7f-49e5-9f32-938242808ecf admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:12.858184 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1166/2324] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:23:12 2022] POST /identity/v3/projects => generated 383 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:23:12.862112 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f96819-fba6-4a4d-9a0d-2a42dc0d1769 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:12.963777 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f96819-fba6-4a4d-9a0d-2a42dc0d1769 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:12.965443 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-c8f64215-1f7f-49e5-9f32-938242808ecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9450f03c47b426381034fa8f15fad44', 'request_id': 'req-c8f64215-1f7f-49e5-9f32-938242808ecf'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:13.029309 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14174d25-969d-40e0-83c4-10a462c25f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:13.030331 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14174d25-969d-40e0-83c4-10a462c25f70 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:13.030685 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14174d25-969d-40e0-83c4-10a462c25f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:13.031040 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14174d25-969d-40e0-83c4-10a462c25f70 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:13.032566 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14174d25-969d-40e0-83c4-10a462c25f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:13.034648 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14174d25-969d-40e0-83c4-10a462c25f70 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:13.039036 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-c8f64215-1f7f-49e5-9f32-938242808ecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9450f03c47b426381034fa8f15fad44', 'request_id': 'req-c8f64215-1f7f-49e5-9f32-938242808ecf'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:13.045651 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-c8f64215-1f7f-49e5-9f32-938242808ecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9450f03c47b426381034fa8f15fad44', 'request_id': 'req-c8f64215-1f7f-49e5-9f32-938242808ecf'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:13.069942 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-c8f64215-1f7f-49e5-9f32-938242808ecf admin admin] The token cache is being invalidate because project a9450f03c47b426381034fa8f15fad44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:23:13.070277 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-c8f64215-1f7f-49e5-9f32-938242808ecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:13.070899 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-c8f64215-1f7f-49e5-9f32-938242808ecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:13.076809 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1159/2325] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:23:12 2022] DELETE /identity/v3/projects/a9450f03c47b426381034fa8f15fad44 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:23:13.078361 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a06af-b482-4c28-8d7c-f592908e6286 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:13.079248 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a06af-b482-4c28-8d7c-f592908e6286 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:13.080232 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a06af-b482-4c28-8d7c-f592908e6286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:13.128423 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-021a06af-b482-4c28-8d7c-f592908e6286 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:23:13.130087 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-021a06af-b482-4c28-8d7c-f592908e6286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:13.136125 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1167/2326] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:23:12 2022] POST /identity/v3/users => generated 298 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:23:13.142133 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14174d25-969d-40e0-83c4-10a462c25f70 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:13.146409 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-14174d25-969d-40e0-83c4-10a462c25f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:13.199021 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14174d25-969d-40e0-83c4-10a462c25f70 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:13.199219 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1160/2327] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:23:13.199219 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063339c-5ed2-459d-9f32-11939ff8eec8 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:13.199219 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063339c-5ed2-459d-9f32-11939ff8eec8 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:13.199219 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063339c-5ed2-459d-9f32-11939ff8eec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:13.199672 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0950da-8b5d-4f4f-87ab-cad1adce9fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:13.200322 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0950da-8b5d-4f4f-87ab-cad1adce9fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:13.200880 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0950da-8b5d-4f4f-87ab-cad1adce9fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:13.201420 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0950da-8b5d-4f4f-87ab-cad1adce9fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:13.202407 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0950da-8b5d-4f4f-87ab-cad1adce9fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:13.211427 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-c063339c-5ed2-459d-9f32-11939ff8eec8 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:23:13.211904 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0950da-8b5d-4f4f-87ab-cad1adce9fd8 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:13.212662 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-c063339c-5ed2-459d-9f32-11939ff8eec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:13.221818 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1161/2328] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:23:13.226975 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063339c-5ed2-459d-9f32-11939ff8eec8 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:13.232294 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1168/2329] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:23:13.233601 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0950da-8b5d-4f4f-87ab-cad1adce9fd8 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:13.238900 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063339c-5ed2-459d-9f32-11939ff8eec8 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:13.246369 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74657f7-625b-49f4-8402-dee2ab010ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:13.247263 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74657f7-625b-49f4-8402-dee2ab010ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:13.247559 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74657f7-625b-49f4-8402-dee2ab010ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:13.247900 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74657f7-625b-49f4-8402-dee2ab010ff0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:13.248649 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74657f7-625b-49f4-8402-dee2ab010ff0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:23:13.249015 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74657f7-625b-49f4-8402-dee2ab010ff0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:13.250723 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74657f7-625b-49f4-8402-dee2ab010ff0 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:13.258769 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0950da-8b5d-4f4f-87ab-cad1adce9fd8 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:13.273820 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1162/2330] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:23:13.274851 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74657f7-625b-49f4-8402-dee2ab010ff0 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:13.277054 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd21c8-4883-4435-9ff5-3811c480d90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:13.278017 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd21c8-4883-4435-9ff5-3811c480d90b admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:13.278344 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd21c8-4883-4435-9ff5-3811c480d90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:13.278574 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd21c8-4883-4435-9ff5-3811c480d90b admin admin] PATH_INFO: `/v3/projects/a7eb3a2cad5c4b7ca6a3c8ed9a9297f5/users/fd598446c55c48e385ef1c92f438388b/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:13.292877 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74657f7-625b-49f4-8402-dee2ab010ff0 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:13.302462 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fea1e-8326-4b6c-b779-bbc1003baf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:13.303144 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fea1e-8326-4b6c-b779-bbc1003baf43 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:13.303514 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fea1e-8326-4b6c-b779-bbc1003baf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:13.303703 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fea1e-8326-4b6c-b779-bbc1003baf43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:13.304409 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fea1e-8326-4b6c-b779-bbc1003baf43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:13.306868 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fea1e-8326-4b6c-b779-bbc1003baf43 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:13.309155 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd21c8-4883-4435-9ff5-3811c480d90b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7eb3a2cad5c4b7ca6a3c8ed9a9297f5, user_id=fd598446c55c48e385ef1c92f438388b, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:13.312090 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd21c8-4883-4435-9ff5-3811c480d90b admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:13.389598 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1169/2331] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:23:13 2022] PUT /identity/v3/projects/a7eb3a2cad5c4b7ca6a3c8ed9a9297f5/users/fd598446c55c48e385ef1c92f438388b/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:23:13.394055 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd21c8-4883-4435-9ff5-3811c480d90b admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:13.437720 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1163/2332] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:23:13 2022] POST /identity/v3/projects => generated 407 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:23:13.442252 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fea1e-8326-4b6c-b779-bbc1003baf43 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:13.475343 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd21c8-4883-4435-9ff5-3811c480d90b admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:13.529100 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fea1e-8326-4b6c-b779-bbc1003baf43 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:13.549598 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e508e1-8078-4d7c-8b67-19f843bbaa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:13.551862 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e508e1-8078-4d7c-8b67-19f843bbaa8f admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:13.552272 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e508e1-8078-4d7c-8b67-19f843bbaa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:13.552671 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e508e1-8078-4d7c-8b67-19f843bbaa8f admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:13.555251 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e508e1-8078-4d7c-8b67-19f843bbaa8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:13.561481 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e508e1-8078-4d7c-8b67-19f843bbaa8f admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:13.613976 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6db06-9b5a-4382-9695-538df3d4af9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:13.614690 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6db06-9b5a-4382-9695-538df3d4af9b admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:13.614979 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6db06-9b5a-4382-9695-538df3d4af9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:13.615449 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6db06-9b5a-4382-9695-538df3d4af9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:13.616358 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6db06-9b5a-4382-9695-538df3d4af9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:13.618265 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6db06-9b5a-4382-9695-538df3d4af9b admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:13.640679 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1170/2333] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:23:13.645634 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6db06-9b5a-4382-9695-538df3d4af9b admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:13.661527 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6db06-9b5a-4382-9695-538df3d4af9b admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:13.682674 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1164/2334] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:23:13 2022] POST /identity/v3/users => generated 304 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:23:13.687429 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e508e1-8078-4d7c-8b67-19f843bbaa8f admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:13.688868 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef41e8f-167e-4810-81cf-1c33256e5ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:13.689873 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef41e8f-167e-4810-81cf-1c33256e5ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:13.690162 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef41e8f-167e-4810-81cf-1c33256e5ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:13.690460 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef41e8f-167e-4810-81cf-1c33256e5ab6 admin admin] PATH_INFO: `/v3/projects/a7eb3a2cad5c4b7ca6a3c8ed9a9297f5/users/fd598446c55c48e385ef1c92f438388b/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:13.695910 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef41e8f-167e-4810-81cf-1c33256e5ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7eb3a2cad5c4b7ca6a3c8ed9a9297f5, user_id=fd598446c55c48e385ef1c92f438388b, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:13.698670 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef41e8f-167e-4810-81cf-1c33256e5ab6 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:13.701511 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e508e1-8078-4d7c-8b67-19f843bbaa8f admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:13.709987 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9359f5f-7707-441f-8cf5-42db9825b430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:13.711314 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9359f5f-7707-441f-8cf5-42db9825b430 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:13.711314 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9359f5f-7707-441f-8cf5-42db9825b430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:13.711897 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9359f5f-7707-441f-8cf5-42db9825b430 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:13.712878 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9359f5f-7707-441f-8cf5-42db9825b430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:13.715477 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9359f5f-7707-441f-8cf5-42db9825b430 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:13.728852 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1165/2335] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:23:13.734412 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9359f5f-7707-441f-8cf5-42db9825b430 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:13.737168 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1171/2336] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:23:13 2022] PUT /identity/v3/projects/a7eb3a2cad5c4b7ca6a3c8ed9a9297f5/users/fd598446c55c48e385ef1c92f438388b/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:23:13.756135 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9359f5f-7707-441f-8cf5-42db9825b430 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:13.888009 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5f14a-cef5-402a-be13-1ae309b40a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:13.888712 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5f14a-cef5-402a-be13-1ae309b40a73 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:13.888991 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5f14a-cef5-402a-be13-1ae309b40a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:13.889274 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5f14a-cef5-402a-be13-1ae309b40a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:13.890040 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5f14a-cef5-402a-be13-1ae309b40a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:13.895580 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5f14a-cef5-402a-be13-1ae309b40a73 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:13.930133 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1166/2337] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:23:13.934486 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef41e8f-167e-4810-81cf-1c33256e5ab6 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:13.949944 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef41e8f-167e-4810-81cf-1c33256e5ab6 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:13.960524 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b9dc2-0f1d-4224-b0ac-8f2287b22792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:13.961624 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b9dc2-0f1d-4224-b0ac-8f2287b22792 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:13.962010 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b9dc2-0f1d-4224-b0ac-8f2287b22792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:13.962401 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b9dc2-0f1d-4224-b0ac-8f2287b22792 admin admin] PATH_INFO: `/v3/projects/6e434bb6afb443b1a61f90c3ee5651bd/users/6134350315a048579b1a712a76451ebb/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:14.001274 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b9dc2-0f1d-4224-b0ac-8f2287b22792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e434bb6afb443b1a61f90c3ee5651bd, user_id=6134350315a048579b1a712a76451ebb, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:14.004271 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b9dc2-0f1d-4224-b0ac-8f2287b22792 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:14.103226 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1172/2338] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:23:13 2022] PUT /identity/v3/projects/6e434bb6afb443b1a61f90c3ee5651bd/users/6134350315a048579b1a712a76451ebb/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:23:14.114351 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11891f9-e5bb-4661-bc29-825119c13fee None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:14.114977 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11891f9-e5bb-4661-bc29-825119c13fee None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:14.115429 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11891f9-e5bb-4661-bc29-825119c13fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:14.175519 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-d11891f9-e5bb-4661-bc29-825119c13fee None None] MFA Rules not processed for user `6134350315a048579b1a712a76451ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:23:14.176923 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-d11891f9-e5bb-4661-bc29-825119c13fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:14.347486 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1167/2339] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:23:14 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:23:14.352040 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b9dc2-0f1d-4224-b0ac-8f2287b22792 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:14.449708 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b9dc2-0f1d-4224-b0ac-8f2287b22792 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:14.462346 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809c229-985a-44d9-8a9c-00c9c393ff21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:14.463347 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809c229-985a-44d9-8a9c-00c9c393ff21 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:14.463747 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809c229-985a-44d9-8a9c-00c9c393ff21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:14.464250 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809c229-985a-44d9-8a9c-00c9c393ff21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:14.465077 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d809c229-985a-44d9-8a9c-00c9c393ff21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:14.467783 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d809c229-985a-44d9-8a9c-00c9c393ff21 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:14.591630 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1173/2340] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:23:14 2022] POST /identity/v3/projects => generated 409 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:23:14.593209 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11891f9-e5bb-4661-bc29-825119c13fee None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:14.610532 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11891f9-e5bb-4661-bc29-825119c13fee None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:14.745173 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad47c1f-a59f-46b3-b4af-247b9c3eb748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:14.746084 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad47c1f-a59f-46b3-b4af-247b9c3eb748 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:14.746512 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad47c1f-a59f-46b3-b4af-247b9c3eb748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:14.748156 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad47c1f-a59f-46b3-b4af-247b9c3eb748 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:14.749105 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad47c1f-a59f-46b3-b4af-247b9c3eb748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:14.756392 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad47c1f-a59f-46b3-b4af-247b9c3eb748 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:14.877059 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1168/2341] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:23:14 2022] POST /identity/v3/users => generated 311 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:23:14.881368 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809c229-985a-44d9-8a9c-00c9c393ff21 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:14.899245 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809c229-985a-44d9-8a9c-00c9c393ff21 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:14.957779 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2b915-d312-4e7e-b854-ff868ce29cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:14.970825 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2b915-d312-4e7e-b854-ff868ce29cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:14.970825 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2b915-d312-4e7e-b854-ff868ce29cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:14.970825 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2b915-d312-4e7e-b854-ff868ce29cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:14.970825 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2b915-d312-4e7e-b854-ff868ce29cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:14.973674 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2b915-d312-4e7e-b854-ff868ce29cd4 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:15.012222 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1174/2342] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:23:15.017382 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad47c1f-a59f-46b3-b4af-247b9c3eb748 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:15.032975 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad47c1f-a59f-46b3-b4af-247b9c3eb748 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:15.059304 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca598c-921c-412d-909f-c455c796d9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:15.060226 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca598c-921c-412d-909f-c455c796d9b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:15.060516 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca598c-921c-412d-909f-c455c796d9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:15.060792 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca598c-921c-412d-909f-c455c796d9b5 admin admin] PATH_INFO: `/v3/projects/545b441fe1d64087b50c493315dfea75/users/4845e277bcba41dbb41d586cda350d87/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:15.103554 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca598c-921c-412d-909f-c455c796d9b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=545b441fe1d64087b50c493315dfea75, user_id=4845e277bcba41dbb41d586cda350d87, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:15.106449 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca598c-921c-412d-909f-c455c796d9b5 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:15.189234 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1169/2343] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:23:15 2022] PUT /identity/v3/projects/545b441fe1d64087b50c493315dfea75/users/4845e277bcba41dbb41d586cda350d87/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:23:15.193801 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2b915-d312-4e7e-b854-ff868ce29cd4 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:15.208282 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2b915-d312-4e7e-b854-ff868ce29cd4 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:15.329738 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0574d88-8832-4bfc-9305-6b5386179f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:15.330770 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0574d88-8832-4bfc-9305-6b5386179f90 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:15.331275 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0574d88-8832-4bfc-9305-6b5386179f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:15.331774 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0574d88-8832-4bfc-9305-6b5386179f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:15.332726 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0574d88-8832-4bfc-9305-6b5386179f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:15.334885 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0574d88-8832-4bfc-9305-6b5386179f90 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:15.347279 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1175/2344] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:23:15.351462 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca598c-921c-412d-909f-c455c796d9b5 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:15.367235 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca598c-921c-412d-909f-c455c796d9b5 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:15.373180 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0974b4-3327-4b4f-a8b4-32693f2bdecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:15.376582 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0974b4-3327-4b4f-a8b4-32693f2bdecf admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:15.377204 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0974b4-3327-4b4f-a8b4-32693f2bdecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:15.377760 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0974b4-3327-4b4f-a8b4-32693f2bdecf admin admin] PATH_INFO: `/v3/projects/545b441fe1d64087b50c493315dfea75/users/4845e277bcba41dbb41d586cda350d87/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:15.380609 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0974b4-3327-4b4f-a8b4-32693f2bdecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=545b441fe1d64087b50c493315dfea75, user_id=4845e277bcba41dbb41d586cda350d87, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:15.384188 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0974b4-3327-4b4f-a8b4-32693f2bdecf admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:15.410495 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1170/2345] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:23:15 2022] PUT /identity/v3/projects/545b441fe1d64087b50c493315dfea75/users/4845e277bcba41dbb41d586cda350d87/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:23:15.424194 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbddfe-6cf0-4669-98c1-dfcefddb7f9d None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:15.426361 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbddfe-6cf0-4669-98c1-dfcefddb7f9d None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:15.426543 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbddfe-6cf0-4669-98c1-dfcefddb7f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:15.465752 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-2ddbddfe-6cf0-4669-98c1-dfcefddb7f9d None None] MFA Rules not processed for user `4845e277bcba41dbb41d586cda350d87`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:23:15.467862 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-2ddbddfe-6cf0-4669-98c1-dfcefddb7f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:15.579015 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1176/2346] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:23:15 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:23:15.599184 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0974b4-3327-4b4f-a8b4-32693f2bdecf admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:15.601734 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-5f0974b4-3327-4b4f-a8b4-32693f2bdecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:15.722435 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0974b4-3327-4b4f-a8b4-32693f2bdecf admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:15.726437 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38defe-feb6-4eea-b7ab-6774fa5a675b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:15.727154 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38defe-feb6-4eea-b7ab-6774fa5a675b service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:15.727443 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38defe-feb6-4eea-b7ab-6774fa5a675b service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:15.727721 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38defe-feb6-4eea-b7ab-6774fa5a675b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:15.738480 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38defe-feb6-4eea-b7ab-6774fa5a675b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:15.740084 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38defe-feb6-4eea-b7ab-6774fa5a675b service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:15.753628 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1171/2347] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:23:15 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:23:16.112426 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbddfe-6cf0-4669-98c1-dfcefddb7f9d None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:16.123245 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbddfe-6cf0-4669-98c1-dfcefddb7f9d None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:16.136924 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029ed11-aec2-4898-ac31-d01f462aaa0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:16.138424 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029ed11-aec2-4898-ac31-d01f462aaa0d service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:16.138424 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029ed11-aec2-4898-ac31-d01f462aaa0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:16.138424 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029ed11-aec2-4898-ac31-d01f462aaa0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:16.211867 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029ed11-aec2-4898-ac31-d01f462aaa0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:16.213409 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029ed11-aec2-4898-ac31-d01f462aaa0d service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:16.224180 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1177/2348] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:23:16 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:23:20.027284 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09f6f8-4ff9-48b8-9f84-18fa67048216 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:20.028202 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09f6f8-4ff9-48b8-9f84-18fa67048216 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:20.028656 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09f6f8-4ff9-48b8-9f84-18fa67048216 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:20.031256 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1172/2349] 10.222.0.43 () {54 vars in 921 bytes} [Tue Mar 29 20:23:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:23:20.041623 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7a6d4-7a56-43e2-b8c2-a3798dd0c224 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:20.042157 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7a6d4-7a56-43e2-b8c2-a3798dd0c224 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:20.042270 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7a6d4-7a56-43e2-b8c2-a3798dd0c224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:20.145172 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-38e7a6d4-7a56-43e2-b8c2-a3798dd0c224 None None] MFA Rules not processed for user `b797e15939694c9abf1f2b8e9aee4d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:23:20.146798 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-38e7a6d4-7a56-43e2-b8c2-a3798dd0c224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:20.264905 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1178/2350] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Mar 29 20:23:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:23:20.278287 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09f6f8-4ff9-48b8-9f84-18fa67048216 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:20.280097 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-0c09f6f8-4ff9-48b8-9f84-18fa67048216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:20.352828 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09f6f8-4ff9-48b8-9f84-18fa67048216 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:20.357274 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a1869-1b65-4440-8c61-a13fb85f3f47 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b169395c92c4fbfbbe4fd14a235f81f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:20.360628 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a1869-1b65-4440-8c61-a13fb85f3f47 service glance] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:20.360628 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a1869-1b65-4440-8c61-a13fb85f3f47 service glance] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:20.360628 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a1869-1b65-4440-8c61-a13fb85f3f47 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:20.371215 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a1869-1b65-4440-8c61-a13fb85f3f47 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:20.372694 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a1869-1b65-4440-8c61-a13fb85f3f47 service glance] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:20.386816 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1173/2351] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:23:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:23:20.601210 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbda86-5eb7-45a7-a3de-4a45a5b2bb52 None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:20.601536 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbda86-5eb7-45a7-a3de-4a45a5b2bb52 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:20.601896 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbda86-5eb7-45a7-a3de-4a45a5b2bb52 None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:20.604819 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1179/2352] 10.222.0.43 () {54 vars in 921 bytes} [Tue Mar 29 20:23:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:23:20.609230 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb5379-6c81-4e47-a27c-5730bb3f0ac8 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:20.609638 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb5379-6c81-4e47-a27c-5730bb3f0ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:20.610505 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb5379-6c81-4e47-a27c-5730bb3f0ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:20.631980 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-f6bb5379-6c81-4e47-a27c-5730bb3f0ac8 None None] MFA Rules not processed for user `22bdaa02b1b14be3837b337fbf6e0eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:23:20.633175 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-f6bb5379-6c81-4e47-a27c-5730bb3f0ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:20.684831 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1174/2353] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Mar 29 20:23:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:23:20.697777 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbda86-5eb7-45a7-a3de-4a45a5b2bb52 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:20.699470 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e8dbda86-5eb7-45a7-a3de-4a45a5b2bb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:20.712835 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbda86-5eb7-45a7-a3de-4a45a5b2bb52 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:20.716371 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6af2d-2e9d-472c-afe0-8a86f95b060d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:20.717006 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6af2d-2e9d-472c-afe0-8a86f95b060d service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:20.717323 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6af2d-2e9d-472c-afe0-8a86f95b060d service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:20.717603 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6af2d-2e9d-472c-afe0-8a86f95b060d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:20.725685 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6af2d-2e9d-472c-afe0-8a86f95b060d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:20.727101 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6af2d-2e9d-472c-afe0-8a86f95b060d service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:20.735400 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1180/2354] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:23:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:23:20.831510 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6b183-7b79-439b-9f89-159fbe4b9a4e None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:20.831803 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6b183-7b79-439b-9f89-159fbe4b9a4e None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:20.832090 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6b183-7b79-439b-9f89-159fbe4b9a4e None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:20.833926 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1175/2355] 10.222.0.43 () {54 vars in 921 bytes} [Tue Mar 29 20:23:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:23:20.849375 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1663b-ac47-4d44-a2af-36141846fbfc None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:20.849742 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1663b-ac47-4d44-a2af-36141846fbfc None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:20.850104 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1663b-ac47-4d44-a2af-36141846fbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:20.870572 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-58d1663b-ac47-4d44-a2af-36141846fbfc None None] MFA Rules not processed for user `b797e15939694c9abf1f2b8e9aee4d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:23:20.872605 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-58d1663b-ac47-4d44-a2af-36141846fbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:20.882807 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1181/2356] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Mar 29 20:23:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:23:20.900569 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6b183-7b79-439b-9f89-159fbe4b9a4e None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:20.913345 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6b183-7b79-439b-9f89-159fbe4b9a4e None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:20.917629 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bf79a-91f7-4913-9d6f-d4b023327b9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:20.918327 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bf79a-91f7-4913-9d6f-d4b023327b9c service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:20.918680 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bf79a-91f7-4913-9d6f-d4b023327b9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:20.919023 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bf79a-91f7-4913-9d6f-d4b023327b9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:20.932282 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bf79a-91f7-4913-9d6f-d4b023327b9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:20.933890 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bf79a-91f7-4913-9d6f-d4b023327b9c service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:20.961165 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1176/2357] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:23:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:23:21.212268 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cdb5f-d42e-4e7c-8738-3b465d415b4c None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:21.212777 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cdb5f-d42e-4e7c-8738-3b465d415b4c None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:21.213021 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cdb5f-d42e-4e7c-8738-3b465d415b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:21.243555 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-504cdb5f-d42e-4e7c-8738-3b465d415b4c None None] MFA Rules not processed for user `fd598446c55c48e385ef1c92f438388b`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:23:21.244911 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-504cdb5f-d42e-4e7c-8738-3b465d415b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:21.337181 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bf79a-91f7-4913-9d6f-d4b023327b9c service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:21.338967 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1182/2358] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:23:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:23:21.347366 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bf79a-91f7-4913-9d6f-d4b023327b9c service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:21.352465 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fecca4-abfc-4a63-9fd3-7f5c2f8f2e02 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b169395c92c4fbfbbe4fd14a235f81f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:21.353388 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fecca4-abfc-4a63-9fd3-7f5c2f8f2e02 service glance] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:21.353827 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fecca4-abfc-4a63-9fd3-7f5c2f8f2e02 service glance] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:21.354857 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fecca4-abfc-4a63-9fd3-7f5c2f8f2e02 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:21.357900 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-43fecca4-abfc-4a63-9fd3-7f5c2f8f2e02 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:21.492466 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fecca4-abfc-4a63-9fd3-7f5c2f8f2e02 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:21.494023 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fecca4-abfc-4a63-9fd3-7f5c2f8f2e02 service glance] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:21.505540 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1177/2359] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:23:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:23:21.764932 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982d366-56a6-4842-b468-20994ed35915 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:21.765494 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982d366-56a6-4842-b468-20994ed35915 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:21.766036 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982d366-56a6-4842-b468-20994ed35915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:21.788358 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-5982d366-56a6-4842-b468-20994ed35915 None None] MFA Rules not processed for user `a706b6d0163549bc80285c4158331b94`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:23:21.790324 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-5982d366-56a6-4842-b468-20994ed35915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:21.867426 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1183/2360] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Mar 29 20:23:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:23:21.882857 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fecca4-abfc-4a63-9fd3-7f5c2f8f2e02 service glance] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:21.884423 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-43fecca4-abfc-4a63-9fd3-7f5c2f8f2e02 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:21.962743 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fecca4-abfc-4a63-9fd3-7f5c2f8f2e02 service glance] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:21.968463 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78411922-f511-47b2-92df-ab1f0f01ce82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d6d8e7788494f2c92ad5c183c8fa283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:21.969529 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78411922-f511-47b2-92df-ab1f0f01ce82 service swift] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:21.969812 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78411922-f511-47b2-92df-ab1f0f01ce82 service swift] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:21.970186 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78411922-f511-47b2-92df-ab1f0f01ce82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:21.979433 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78411922-f511-47b2-92df-ab1f0f01ce82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:21.981187 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78411922-f511-47b2-92df-ab1f0f01ce82 service swift] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:21.993039 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1178/2361] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Mar 29 20:23:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 29 20:23:25.966709 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031e93c-cb64-468b-9c0a-2a55c18fe6cc None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:25.968131 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031e93c-cb64-468b-9c0a-2a55c18fe6cc None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:25.968414 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031e93c-cb64-468b-9c0a-2a55c18fe6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:25.993768 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-a031e93c-cb64-468b-9c0a-2a55c18fe6cc None None] MFA Rules not processed for user `a706b6d0163549bc80285c4158331b94`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:23:25.995272 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a031e93c-cb64-468b-9c0a-2a55c18fe6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:26.007873 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1184/2362] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Mar 29 20:23:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:23:26.022680 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78411922-f511-47b2-92df-ab1f0f01ce82 service swift] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:26.033972 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78411922-f511-47b2-92df-ab1f0f01ce82 service swift] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:26.039742 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9c7df-2140-4c9c-ba61-6f98074e25b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d6d8e7788494f2c92ad5c183c8fa283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:26.040705 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9c7df-2140-4c9c-ba61-6f98074e25b5 service swift] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:26.041014 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9c7df-2140-4c9c-ba61-6f98074e25b5 service swift] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:26.041359 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9c7df-2140-4c9c-ba61-6f98074e25b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:26.058631 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9c7df-2140-4c9c-ba61-6f98074e25b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:26.060787 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9c7df-2140-4c9c-ba61-6f98074e25b5 service swift] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:26.077698 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1179/2363] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Mar 29 20:23:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 20:23:26.600575 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031e93c-cb64-468b-9c0a-2a55c18fe6cc None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:26.748396 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031e93c-cb64-468b-9c0a-2a55c18fe6cc None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:26.755936 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd4797-5eb9-4332-a61f-56f2b8e3717c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:26.757454 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd4797-5eb9-4332-a61f-56f2b8e3717c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:26.758257 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd4797-5eb9-4332-a61f-56f2b8e3717c admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:26.758894 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd4797-5eb9-4332-a61f-56f2b8e3717c admin admin] PATH_INFO: `/v3/users/6134350315a048579b1a712a76451ebb` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:26.760680 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd4797-5eb9-4332-a61f-56f2b8e3717c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6134350315a048579b1a712a76451ebb)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:26.765737 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd4797-5eb9-4332-a61f-56f2b8e3717c admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:27.015204 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fbfd4797-5eb9-4332-a61f-56f2b8e3717c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6134350315a048579b1a712a76451ebb'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:27.084931 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fbfd4797-5eb9-4332-a61f-56f2b8e3717c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6134350315a048579b1a712a76451ebb'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:27.085908 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fbfd4797-5eb9-4332-a61f-56f2b8e3717c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6134350315a048579b1a712a76451ebb'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:27.086533 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fbfd4797-5eb9-4332-a61f-56f2b8e3717c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6134350315a048579b1a712a76451ebb'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:27.097123 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fbfd4797-5eb9-4332-a61f-56f2b8e3717c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6134350315a048579b1a712a76451ebb'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:27.141819 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1185/2364] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:23:26 2022] DELETE /identity/v3/users/6134350315a048579b1a712a76451ebb => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:23:27.150183 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f417a8-3fa8-4ce6-a830-6a44d37e4474 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:27.151911 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f417a8-3fa8-4ce6-a830-6a44d37e4474 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:27.151911 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f417a8-3fa8-4ce6-a830-6a44d37e4474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:27.188768 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-01f417a8-3fa8-4ce6-a830-6a44d37e4474 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:23:27.194807 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-01f417a8-3fa8-4ce6-a830-6a44d37e4474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:27.361657 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1180/2365] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:23:27.372967 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd4797-5eb9-4332-a61f-56f2b8e3717c admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:27.374507 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-fbfd4797-5eb9-4332-a61f-56f2b8e3717c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:27.491028 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd4797-5eb9-4332-a61f-56f2b8e3717c admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:27.498966 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8b823-fdd9-4bd0-af9d-caca7dfca07e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:27.501902 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8b823-fdd9-4bd0-af9d-caca7dfca07e service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:27.504487 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8b823-fdd9-4bd0-af9d-caca7dfca07e service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:27.505020 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8b823-fdd9-4bd0-af9d-caca7dfca07e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:27.528340 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8b823-fdd9-4bd0-af9d-caca7dfca07e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:27.530353 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8b823-fdd9-4bd0-af9d-caca7dfca07e service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:27.557818 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1186/2366] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:23:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:23:27.799680 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f417a8-3fa8-4ce6-a830-6a44d37e4474 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:27.801126 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-01f417a8-3fa8-4ce6-a830-6a44d37e4474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:27.817910 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f417a8-3fa8-4ce6-a830-6a44d37e4474 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:27.827456 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd53865-3598-4b37-9f55-b042f7b7ecf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:27.828158 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd53865-3598-4b37-9f55-b042f7b7ecf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:27.829015 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd53865-3598-4b37-9f55-b042f7b7ecf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:27.829015 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd53865-3598-4b37-9f55-b042f7b7ecf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:27.834136 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-6bd53865-3598-4b37-9f55-b042f7b7ecf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:27.924607 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd53865-3598-4b37-9f55-b042f7b7ecf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:27.926559 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd53865-3598-4b37-9f55-b042f7b7ecf8 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:27.964364 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1181/2367] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:23:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:23:28.866584 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8b823-fdd9-4bd0-af9d-caca7dfca07e service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:28.868199 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-ddd8b823-fdd9-4bd0-af9d-caca7dfca07e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:28.905892 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8b823-fdd9-4bd0-af9d-caca7dfca07e service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:28.921130 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc98670-9d98-4c7b-a06b-78b5f9a238fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:28.922047 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc98670-9d98-4c7b-a06b-78b5f9a238fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:28.922895 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc98670-9d98-4c7b-a06b-78b5f9a238fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:28.923174 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc98670-9d98-4c7b-a06b-78b5f9a238fc admin admin] PATH_INFO: `/v3/projects/6e434bb6afb443b1a61f90c3ee5651bd` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:28.929903 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc98670-9d98-4c7b-a06b-78b5f9a238fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e434bb6afb443b1a61f90c3ee5651bd)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:28.933461 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc98670-9d98-4c7b-a06b-78b5f9a238fc admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:29.124491 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-1dc98670-9d98-4c7b-a06b-78b5f9a238fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e434bb6afb443b1a61f90c3ee5651bd', 'request_id': 'req-1dc98670-9d98-4c7b-a06b-78b5f9a238fc'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:29.134982 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-1dc98670-9d98-4c7b-a06b-78b5f9a238fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e434bb6afb443b1a61f90c3ee5651bd', 'request_id': 'req-1dc98670-9d98-4c7b-a06b-78b5f9a238fc'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:29.146806 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-1dc98670-9d98-4c7b-a06b-78b5f9a238fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e434bb6afb443b1a61f90c3ee5651bd', 'request_id': 'req-1dc98670-9d98-4c7b-a06b-78b5f9a238fc'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:29.233213 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-1dc98670-9d98-4c7b-a06b-78b5f9a238fc admin admin] The token cache is being invalidate because project 6e434bb6afb443b1a61f90c3ee5651bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:23:29.233666 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-1dc98670-9d98-4c7b-a06b-78b5f9a238fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:29.234326 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-1dc98670-9d98-4c7b-a06b-78b5f9a238fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:29.237044 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1187/2368] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:23:28 2022] DELETE /identity/v3/projects/6e434bb6afb443b1a61f90c3ee5651bd => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:23:29.241412 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd53865-3598-4b37-9f55-b042f7b7ecf8 service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:29.263303 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd53865-3598-4b37-9f55-b042f7b7ecf8 service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:29.410760 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7488d-8d88-4269-9d37-414ddaa88e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:29.416206 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7488d-8d88-4269-9d37-414ddaa88e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:29.416206 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7488d-8d88-4269-9d37-414ddaa88e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:29.416206 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7488d-8d88-4269-9d37-414ddaa88e33 admin admin] PATH_INFO: `/v3/users/4845e277bcba41dbb41d586cda350d87` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:29.428811 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7488d-8d88-4269-9d37-414ddaa88e33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4845e277bcba41dbb41d586cda350d87)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:29.434982 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7488d-8d88-4269-9d37-414ddaa88e33 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:29.698539 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-9be7488d-8d88-4269-9d37-414ddaa88e33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4845e277bcba41dbb41d586cda350d87'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:29.799040 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-9be7488d-8d88-4269-9d37-414ddaa88e33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4845e277bcba41dbb41d586cda350d87'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:29.799727 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-9be7488d-8d88-4269-9d37-414ddaa88e33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4845e277bcba41dbb41d586cda350d87'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:29.815798 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-9be7488d-8d88-4269-9d37-414ddaa88e33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4845e277bcba41dbb41d586cda350d87'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:29.847370 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-9be7488d-8d88-4269-9d37-414ddaa88e33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4845e277bcba41dbb41d586cda350d87'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:29.865967 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1182/2369] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:23:29 2022] DELETE /identity/v3/users/4845e277bcba41dbb41d586cda350d87 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:23:30.778594 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc98670-9d98-4c7b-a06b-78b5f9a238fc admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:30.781104 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-1dc98670-9d98-4c7b-a06b-78b5f9a238fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:30.806773 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc98670-9d98-4c7b-a06b-78b5f9a238fc admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:30.860274 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7488d-8d88-4269-9d37-414ddaa88e33 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:30.861808 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9be7488d-8d88-4269-9d37-414ddaa88e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:30.865204 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe497e-6063-41f0-9b25-ccdf4901f576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:30.866115 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe497e-6063-41f0-9b25-ccdf4901f576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:30.866404 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe497e-6063-41f0-9b25-ccdf4901f576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:30.866686 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe497e-6063-41f0-9b25-ccdf4901f576 admin admin] PATH_INFO: `/v3/projects/545b441fe1d64087b50c493315dfea75` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:30.867939 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe497e-6063-41f0-9b25-ccdf4901f576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=545b441fe1d64087b50c493315dfea75)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:30.870004 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe497e-6063-41f0-9b25-ccdf4901f576 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:30.960568 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7488d-8d88-4269-9d37-414ddaa88e33 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:30.966016 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919388b8-5174-42c6-be30-eaa4009d704b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef0001e91524a13a9ca601a601de66b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:30.966668 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919388b8-5174-42c6-be30-eaa4009d704b service placement] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:30.966953 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919388b8-5174-42c6-be30-eaa4009d704b service placement] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:30.967231 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919388b8-5174-42c6-be30-eaa4009d704b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:30.969029 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-919388b8-5174-42c6-be30-eaa4009d704b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:30.980293 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919388b8-5174-42c6-be30-eaa4009d704b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:30.981901 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919388b8-5174-42c6-be30-eaa4009d704b service placement] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:30.991904 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1183/2370] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:23:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:23:31.252282 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d3fe497e-6063-41f0-9b25-ccdf4901f576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '545b441fe1d64087b50c493315dfea75', 'request_id': 'req-d3fe497e-6063-41f0-9b25-ccdf4901f576'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:31.264547 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d3fe497e-6063-41f0-9b25-ccdf4901f576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '545b441fe1d64087b50c493315dfea75', 'request_id': 'req-d3fe497e-6063-41f0-9b25-ccdf4901f576'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:31.285278 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d3fe497e-6063-41f0-9b25-ccdf4901f576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '545b441fe1d64087b50c493315dfea75', 'request_id': 'req-d3fe497e-6063-41f0-9b25-ccdf4901f576'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:31.349547 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d3fe497e-6063-41f0-9b25-ccdf4901f576 admin admin] The token cache is being invalidate because project 545b441fe1d64087b50c493315dfea75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:23:31.349897 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d3fe497e-6063-41f0-9b25-ccdf4901f576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:31.352238 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d3fe497e-6063-41f0-9b25-ccdf4901f576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:31.358490 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1188/2371] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:23:30 2022] DELETE /identity/v3/projects/545b441fe1d64087b50c493315dfea75 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:23:31.363908 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47758be8-e82d-4cbb-9266-a2f668d67b55 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:31.364236 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47758be8-e82d-4cbb-9266-a2f668d67b55 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:31.364547 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47758be8-e82d-4cbb-9266-a2f668d67b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:31.424721 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-47758be8-e82d-4cbb-9266-a2f668d67b55 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:23:31.426149 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-47758be8-e82d-4cbb-9266-a2f668d67b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:31.602889 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1184/2372] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:23:31.611665 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de53bc8-a1ab-4655-bb61-fd2c74b4e999 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:31.611785 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de53bc8-a1ab-4655-bb61-fd2c74b4e999 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:31.612064 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de53bc8-a1ab-4655-bb61-fd2c74b4e999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:31.650537 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-9de53bc8-a1ab-4655-bb61-fd2c74b4e999 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:23:31.651806 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-9de53bc8-a1ab-4655-bb61-fd2c74b4e999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:31.667416 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1189/2373] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:23:31.668182 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47758be8-e82d-4cbb-9266-a2f668d67b55 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:31.686842 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47758be8-e82d-4cbb-9266-a2f668d67b55 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:31.700457 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925e1ab-3a3c-4d44-9356-d99e4e14d4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:31.701135 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925e1ab-3a3c-4d44-9356-d99e4e14d4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:31.701448 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925e1ab-3a3c-4d44-9356-d99e4e14d4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:31.701728 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925e1ab-3a3c-4d44-9356-d99e4e14d4e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:31.702467 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925e1ab-3a3c-4d44-9356-d99e4e14d4e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:23:31.702775 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925e1ab-3a3c-4d44-9356-d99e4e14d4e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:31.705719 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925e1ab-3a3c-4d44-9356-d99e4e14d4e3 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:31.728318 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1185/2374] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:23:31.733606 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de53bc8-a1ab-4655-bb61-fd2c74b4e999 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:31.751309 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de53bc8-a1ab-4655-bb61-fd2c74b4e999 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:31.766674 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0dd1e-0f44-411e-9076-01f1bcc35e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:31.767651 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0dd1e-0f44-411e-9076-01f1bcc35e5f admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:31.769560 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0dd1e-0f44-411e-9076-01f1bcc35e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:31.772008 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0dd1e-0f44-411e-9076-01f1bcc35e5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:31.773083 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0dd1e-0f44-411e-9076-01f1bcc35e5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:31.776358 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0dd1e-0f44-411e-9076-01f1bcc35e5f admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:31.853780 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1190/2375] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:23:31 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:23:31.857859 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925e1ab-3a3c-4d44-9356-d99e4e14d4e3 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:31.871506 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925e1ab-3a3c-4d44-9356-d99e4e14d4e3 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:32.010461 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee204a-0b22-4c0c-804a-9c4c51dbee15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:32.011239 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee204a-0b22-4c0c-804a-9c4c51dbee15 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:32.011587 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee204a-0b22-4c0c-804a-9c4c51dbee15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:32.011942 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee204a-0b22-4c0c-804a-9c4c51dbee15 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:32.012740 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee204a-0b22-4c0c-804a-9c4c51dbee15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:32.017242 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee204a-0b22-4c0c-804a-9c4c51dbee15 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:32.126385 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1186/2376] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:23:31 2022] POST /identity/v3/users => generated 291 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:23:32.131191 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0dd1e-0f44-411e-9076-01f1bcc35e5f admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:32.145757 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0dd1e-0f44-411e-9076-01f1bcc35e5f admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:32.162515 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a813e16-515a-422d-b305-25f8ca1c4633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:32.164413 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a813e16-515a-422d-b305-25f8ca1c4633 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:32.164704 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a813e16-515a-422d-b305-25f8ca1c4633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:32.167498 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a813e16-515a-422d-b305-25f8ca1c4633 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:32.168311 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a813e16-515a-422d-b305-25f8ca1c4633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:32.174339 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a813e16-515a-422d-b305-25f8ca1c4633 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:32.199040 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1191/2377] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:23:32.203029 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee204a-0b22-4c0c-804a-9c4c51dbee15 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:32.238326 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee204a-0b22-4c0c-804a-9c4c51dbee15 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:32.253700 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c18e8-16c2-46ab-8a52-32e528294939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:32.254736 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c18e8-16c2-46ab-8a52-32e528294939 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:32.255959 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c18e8-16c2-46ab-8a52-32e528294939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:32.256379 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c18e8-16c2-46ab-8a52-32e528294939 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:32.257768 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c18e8-16c2-46ab-8a52-32e528294939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:32.263667 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c18e8-16c2-46ab-8a52-32e528294939 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:32.295840 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1187/2378] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:23:32.298238 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a813e16-515a-422d-b305-25f8ca1c4633 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:32.313812 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a813e16-515a-422d-b305-25f8ca1c4633 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:32.320850 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6d25a-f0fa-4a3d-b329-8cf7be9ab999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:32.322290 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6d25a-f0fa-4a3d-b329-8cf7be9ab999 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:32.322715 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6d25a-f0fa-4a3d-b329-8cf7be9ab999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:32.323127 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6d25a-f0fa-4a3d-b329-8cf7be9ab999 admin admin] PATH_INFO: `/v3/projects/e1d6e5b972124a6f9f897ee0a3a74d68/users/892d1cb49d4744b69f54aee56820a733/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:32.351419 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6d25a-f0fa-4a3d-b329-8cf7be9ab999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1d6e5b972124a6f9f897ee0a3a74d68, user_id=892d1cb49d4744b69f54aee56820a733, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:32.355167 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6d25a-f0fa-4a3d-b329-8cf7be9ab999 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:32.441197 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1192/2379] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:23:32 2022] PUT /identity/v3/projects/e1d6e5b972124a6f9f897ee0a3a74d68/users/892d1cb49d4744b69f54aee56820a733/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:23:32.443640 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac536ed-edcb-4177-bc07-08b24c842495 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:32.444131 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac536ed-edcb-4177-bc07-08b24c842495 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:32.444421 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac536ed-edcb-4177-bc07-08b24c842495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:32.512891 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-2ac536ed-edcb-4177-bc07-08b24c842495 None None] MFA Rules not processed for user `892d1cb49d4744b69f54aee56820a733`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:23:32.514001 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-2ac536ed-edcb-4177-bc07-08b24c842495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:32.736958 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1188/2380] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:23:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:23:32.738728 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6d25a-f0fa-4a3d-b329-8cf7be9ab999 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:32.861402 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6d25a-f0fa-4a3d-b329-8cf7be9ab999 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:32.868280 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a46697-4250-41fe-a5ac-450e6599e3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:32.869249 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a46697-4250-41fe-a5ac-450e6599e3e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:32.869673 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a46697-4250-41fe-a5ac-450e6599e3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:32.870207 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a46697-4250-41fe-a5ac-450e6599e3e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:32.871284 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a46697-4250-41fe-a5ac-450e6599e3e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:32.875001 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a46697-4250-41fe-a5ac-450e6599e3e4 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:32.995566 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1193/2381] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:23:32 2022] POST /identity/v3/projects => generated 379 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:23:32.995780 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac536ed-edcb-4177-bc07-08b24c842495 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:33.017782 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac536ed-edcb-4177-bc07-08b24c842495 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:33.117758 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24298908-63d3-4a19-b0de-b7bd985522fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:33.118937 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24298908-63d3-4a19-b0de-b7bd985522fb admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:33.119331 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24298908-63d3-4a19-b0de-b7bd985522fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:33.119758 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24298908-63d3-4a19-b0de-b7bd985522fb admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:33.120591 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24298908-63d3-4a19-b0de-b7bd985522fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:33.123239 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24298908-63d3-4a19-b0de-b7bd985522fb admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:33.218486 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1189/2382] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:23:32 2022] POST /identity/v3/users => generated 296 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:23:33.221855 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a46697-4250-41fe-a5ac-450e6599e3e4 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:33.290152 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a46697-4250-41fe-a5ac-450e6599e3e4 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:33.327479 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5433aee-9309-4e15-8278-eb86010f8a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:33.333641 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5433aee-9309-4e15-8278-eb86010f8a84 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:33.335261 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5433aee-9309-4e15-8278-eb86010f8a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:33.335815 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5433aee-9309-4e15-8278-eb86010f8a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:33.338554 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5433aee-9309-4e15-8278-eb86010f8a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:33.352440 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5433aee-9309-4e15-8278-eb86010f8a84 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:33.404421 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1194/2383] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:23:33.410871 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24298908-63d3-4a19-b0de-b7bd985522fb admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:33.439381 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24298908-63d3-4a19-b0de-b7bd985522fb admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:33.460531 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf8f13-3910-4543-811b-dfa10ed368c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:33.467584 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf8f13-3910-4543-811b-dfa10ed368c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:33.467584 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf8f13-3910-4543-811b-dfa10ed368c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:33.467584 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf8f13-3910-4543-811b-dfa10ed368c8 admin admin] PATH_INFO: `/v3/projects/394c951405fc4730afe094a6a7723620/users/e3e2f067a68e42e88ab825f9cdcefc64/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:33.525533 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf8f13-3910-4543-811b-dfa10ed368c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=394c951405fc4730afe094a6a7723620, user_id=e3e2f067a68e42e88ab825f9cdcefc64, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:33.529516 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf8f13-3910-4543-811b-dfa10ed368c8 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:33.726670 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1190/2384] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:23:33 2022] PUT /identity/v3/projects/394c951405fc4730afe094a6a7723620/users/e3e2f067a68e42e88ab825f9cdcefc64/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:23:33.731466 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5433aee-9309-4e15-8278-eb86010f8a84 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:33.767299 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5433aee-9309-4e15-8278-eb86010f8a84 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:33.937326 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea308c-257b-46dd-9dc3-335fce4898fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:33.948442 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea308c-257b-46dd-9dc3-335fce4898fa admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:33.948745 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea308c-257b-46dd-9dc3-335fce4898fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:33.949080 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea308c-257b-46dd-9dc3-335fce4898fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:33.949929 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea308c-257b-46dd-9dc3-335fce4898fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:33.951715 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea308c-257b-46dd-9dc3-335fce4898fa admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:33.974431 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1195/2385] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:23:33.976029 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf8f13-3910-4543-811b-dfa10ed368c8 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:33.995771 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf8f13-3910-4543-811b-dfa10ed368c8 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:34.011209 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb9eef-8242-46ca-9e70-6e04687e4934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:34.012321 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb9eef-8242-46ca-9e70-6e04687e4934 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:34.012621 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb9eef-8242-46ca-9e70-6e04687e4934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:34.012907 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb9eef-8242-46ca-9e70-6e04687e4934 admin admin] PATH_INFO: `/v3/projects/394c951405fc4730afe094a6a7723620/users/e3e2f067a68e42e88ab825f9cdcefc64/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:34.023209 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb9eef-8242-46ca-9e70-6e04687e4934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=394c951405fc4730afe094a6a7723620, user_id=e3e2f067a68e42e88ab825f9cdcefc64, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:34.025938 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb9eef-8242-46ca-9e70-6e04687e4934 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:34.053739 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1191/2386] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:23:33 2022] PUT /identity/v3/projects/394c951405fc4730afe094a6a7723620/users/e3e2f067a68e42e88ab825f9cdcefc64/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:23:34.070165 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06d7d5-2931-4e7f-8fe6-66f6ae16ed3d None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:34.070537 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06d7d5-2931-4e7f-8fe6-66f6ae16ed3d None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:34.071560 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06d7d5-2931-4e7f-8fe6-66f6ae16ed3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:34.130372 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-3a06d7d5-2931-4e7f-8fe6-66f6ae16ed3d None None] MFA Rules not processed for user `e3e2f067a68e42e88ab825f9cdcefc64`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:23:34.135189 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-3a06d7d5-2931-4e7f-8fe6-66f6ae16ed3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:34.310490 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1196/2387] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:23:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:23:34.324978 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb9eef-8242-46ca-9e70-6e04687e4934 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:34.327078 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-0efb9eef-8242-46ca-9e70-6e04687e4934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:34.533904 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb9eef-8242-46ca-9e70-6e04687e4934 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:34.542004 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df77764-915a-4745-9602-dd5a69945ea7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:34.548920 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df77764-915a-4745-9602-dd5a69945ea7 service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:34.548920 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df77764-915a-4745-9602-dd5a69945ea7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:34.548920 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df77764-915a-4745-9602-dd5a69945ea7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:34.571306 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df77764-915a-4745-9602-dd5a69945ea7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:34.582505 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df77764-915a-4745-9602-dd5a69945ea7 service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:34.616728 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1192/2388] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:23:34 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:23:35.350251 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06d7d5-2931-4e7f-8fe6-66f6ae16ed3d None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:35.578406 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06d7d5-2931-4e7f-8fe6-66f6ae16ed3d None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:35.590245 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a5842-1fbc-495b-9553-bcd622e7e74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:35.591173 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a5842-1fbc-495b-9553-bcd622e7e74a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:35.591465 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a5842-1fbc-495b-9553-bcd622e7e74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:35.591930 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a5842-1fbc-495b-9553-bcd622e7e74a admin admin] PATH_INFO: `/v3/users/892d1cb49d4744b69f54aee56820a733` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:35.593174 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a5842-1fbc-495b-9553-bcd622e7e74a admin admin] RBAC: Authorizing `identity:delete_user(user_id=892d1cb49d4744b69f54aee56820a733)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:35.596487 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a5842-1fbc-495b-9553-bcd622e7e74a admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:36.152523 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3b4a5842-1fbc-495b-9553-bcd622e7e74a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '892d1cb49d4744b69f54aee56820a733'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:36.210975 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3b4a5842-1fbc-495b-9553-bcd622e7e74a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '892d1cb49d4744b69f54aee56820a733'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:36.212022 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3b4a5842-1fbc-495b-9553-bcd622e7e74a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '892d1cb49d4744b69f54aee56820a733'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:36.212946 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3b4a5842-1fbc-495b-9553-bcd622e7e74a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '892d1cb49d4744b69f54aee56820a733'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:36.222475 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3b4a5842-1fbc-495b-9553-bcd622e7e74a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '892d1cb49d4744b69f54aee56820a733'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:36.250755 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1197/2389] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:23:35 2022] DELETE /identity/v3/users/892d1cb49d4744b69f54aee56820a733 => generated 0 bytes in 901 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:23:36.255316 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8327a-9baa-4add-8703-315e5f4e130a None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:36.255866 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8327a-9baa-4add-8703-315e5f4e130a None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:36.255866 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8327a-9baa-4add-8703-315e5f4e130a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:36.278418 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-1af8327a-9baa-4add-8703-315e5f4e130a None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:23:36.280319 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-1af8327a-9baa-4add-8703-315e5f4e130a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:36.352157 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1193/2390] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:23:36.363274 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a5842-1fbc-495b-9553-bcd622e7e74a admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:36.365601 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-3b4a5842-1fbc-495b-9553-bcd622e7e74a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:36.437455 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a5842-1fbc-495b-9553-bcd622e7e74a admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:36.444619 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c17ac-1ec6-42a1-aae3-4b2decfc99b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:36.445936 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c17ac-1ec6-42a1-aae3-4b2decfc99b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:36.446530 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c17ac-1ec6-42a1-aae3-4b2decfc99b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:36.447076 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c17ac-1ec6-42a1-aae3-4b2decfc99b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:36.459981 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c17ac-1ec6-42a1-aae3-4b2decfc99b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:36.463160 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c17ac-1ec6-42a1-aae3-4b2decfc99b6 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:36.475861 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1198/2391] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:23:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:23:37.103799 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8327a-9baa-4add-8703-315e5f4e130a None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:37.105404 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-1af8327a-9baa-4add-8703-315e5f4e130a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:37.128839 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8327a-9baa-4add-8703-315e5f4e130a None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:37.145866 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26b740-0311-4a50-8308-49e69e49974d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:37.148087 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26b740-0311-4a50-8308-49e69e49974d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:37.148480 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26b740-0311-4a50-8308-49e69e49974d admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:37.148920 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26b740-0311-4a50-8308-49e69e49974d admin admin] PATH_INFO: `/v3/projects/e1d6e5b972124a6f9f897ee0a3a74d68` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:37.150443 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26b740-0311-4a50-8308-49e69e49974d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1d6e5b972124a6f9f897ee0a3a74d68)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:37.173578 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26b740-0311-4a50-8308-49e69e49974d admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:37.332352 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-3b26b740-0311-4a50-8308-49e69e49974d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1d6e5b972124a6f9f897ee0a3a74d68', 'request_id': 'req-3b26b740-0311-4a50-8308-49e69e49974d'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:37.423793 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-3b26b740-0311-4a50-8308-49e69e49974d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1d6e5b972124a6f9f897ee0a3a74d68', 'request_id': 'req-3b26b740-0311-4a50-8308-49e69e49974d'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:37.437119 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-3b26b740-0311-4a50-8308-49e69e49974d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1d6e5b972124a6f9f897ee0a3a74d68', 'request_id': 'req-3b26b740-0311-4a50-8308-49e69e49974d'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:37.453249 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-3b26b740-0311-4a50-8308-49e69e49974d admin admin] The token cache is being invalidate because project e1d6e5b972124a6f9f897ee0a3a74d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:23:37.454783 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-3b26b740-0311-4a50-8308-49e69e49974d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:37.454783 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-3b26b740-0311-4a50-8308-49e69e49974d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:37.459463 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1194/2392] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:23:37 2022] DELETE /identity/v3/projects/e1d6e5b972124a6f9f897ee0a3a74d68 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:23:37.460825 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c17ac-1ec6-42a1-aae3-4b2decfc99b6 service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:37.472319 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c17ac-1ec6-42a1-aae3-4b2decfc99b6 service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:37.549634 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff13c0-8450-493c-ac9d-d187e9b7de36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:37.550666 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff13c0-8450-493c-ac9d-d187e9b7de36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:37.551041 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff13c0-8450-493c-ac9d-d187e9b7de36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:37.551399 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff13c0-8450-493c-ac9d-d187e9b7de36 admin admin] PATH_INFO: `/v3/users/e3e2f067a68e42e88ab825f9cdcefc64` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:37.552700 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff13c0-8450-493c-ac9d-d187e9b7de36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3e2f067a68e42e88ab825f9cdcefc64)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:37.555059 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff13c0-8450-493c-ac9d-d187e9b7de36 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:37.770960 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c6ff13c0-8450-493c-ac9d-d187e9b7de36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3e2f067a68e42e88ab825f9cdcefc64'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:37.845370 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c6ff13c0-8450-493c-ac9d-d187e9b7de36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3e2f067a68e42e88ab825f9cdcefc64'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:37.846373 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c6ff13c0-8450-493c-ac9d-d187e9b7de36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3e2f067a68e42e88ab825f9cdcefc64'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:37.847117 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c6ff13c0-8450-493c-ac9d-d187e9b7de36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3e2f067a68e42e88ab825f9cdcefc64'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:37.855610 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c6ff13c0-8450-493c-ac9d-d187e9b7de36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3e2f067a68e42e88ab825f9cdcefc64'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:37.888030 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1199/2393] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:23:37 2022] DELETE /identity/v3/users/e3e2f067a68e42e88ab825f9cdcefc64 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:23:38.351174 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26b740-0311-4a50-8308-49e69e49974d admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:38.352180 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb73b50-03ee-4f38-8b44-d8e09e917c64 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:38.352461 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb73b50-03ee-4f38-8b44-d8e09e917c64 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:38.352743 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb73b50-03ee-4f38-8b44-d8e09e917c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:38.353976 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-3b26b740-0311-4a50-8308-49e69e49974d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:38.372594 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-8bb73b50-03ee-4f38-8b44-d8e09e917c64 None None] MFA Rules not processed for user `6aaa0c43a8d64df294186dbde0edd025`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:23:38.377145 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-8bb73b50-03ee-4f38-8b44-d8e09e917c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:38.383708 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26b740-0311-4a50-8308-49e69e49974d admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:38.448663 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1200/2394] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:23:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:23:38.455161 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8c4a3-1477-4cc0-b6de-577aa1b11b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:38.456052 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8c4a3-1477-4cc0-b6de-577aa1b11b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:38.456408 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8c4a3-1477-4cc0-b6de-577aa1b11b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:38.456756 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8c4a3-1477-4cc0-b6de-577aa1b11b25 admin admin] PATH_INFO: `/v3/projects/394c951405fc4730afe094a6a7723620` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:38.458043 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8c4a3-1477-4cc0-b6de-577aa1b11b25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=394c951405fc4730afe094a6a7723620)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:38.460078 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8c4a3-1477-4cc0-b6de-577aa1b11b25 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:38.546595 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-dec8c4a3-1477-4cc0-b6de-577aa1b11b25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '394c951405fc4730afe094a6a7723620', 'request_id': 'req-dec8c4a3-1477-4cc0-b6de-577aa1b11b25'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:38.611026 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-dec8c4a3-1477-4cc0-b6de-577aa1b11b25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '394c951405fc4730afe094a6a7723620', 'request_id': 'req-dec8c4a3-1477-4cc0-b6de-577aa1b11b25'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:38.617340 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-dec8c4a3-1477-4cc0-b6de-577aa1b11b25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '394c951405fc4730afe094a6a7723620', 'request_id': 'req-dec8c4a3-1477-4cc0-b6de-577aa1b11b25'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:38.629133 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-dec8c4a3-1477-4cc0-b6de-577aa1b11b25 admin admin] The token cache is being invalidate because project 394c951405fc4730afe094a6a7723620 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:23:38.629464 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-dec8c4a3-1477-4cc0-b6de-577aa1b11b25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:38.630122 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-dec8c4a3-1477-4cc0-b6de-577aa1b11b25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:23:38.631666 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1195/2395] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:23:38 2022] DELETE /identity/v3/projects/394c951405fc4730afe094a6a7723620 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:23:38.637176 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af579e-49da-4a18-b32e-dcc50e6cee90 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:38.637683 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af579e-49da-4a18-b32e-dcc50e6cee90 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:38.637833 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af579e-49da-4a18-b32e-dcc50e6cee90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:38.656688 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-c9af579e-49da-4a18-b32e-dcc50e6cee90 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:23:38.658209 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-c9af579e-49da-4a18-b32e-dcc50e6cee90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:38.719608 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1201/2396] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:23:38.727279 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc3fd4-5c60-4e44-8169-4b203c48834c None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:38.727581 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc3fd4-5c60-4e44-8169-4b203c48834c None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:38.727867 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc3fd4-5c60-4e44-8169-4b203c48834c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:38.746507 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-2bbc3fd4-5c60-4e44-8169-4b203c48834c None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:23:38.754065 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-2bbc3fd4-5c60-4e44-8169-4b203c48834c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:38.757885 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1196/2397] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:23:38.762107 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af579e-49da-4a18-b32e-dcc50e6cee90 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:38.772371 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af579e-49da-4a18-b32e-dcc50e6cee90 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:38.777580 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae657b-7f25-4c8b-bd69-4aa3b4214ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:38.778233 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae657b-7f25-4c8b-bd69-4aa3b4214ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:38.779737 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae657b-7f25-4c8b-bd69-4aa3b4214ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:38.779737 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae657b-7f25-4c8b-bd69-4aa3b4214ba8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:38.779921 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae657b-7f25-4c8b-bd69-4aa3b4214ba8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:23:38.780167 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae657b-7f25-4c8b-bd69-4aa3b4214ba8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:38.782436 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae657b-7f25-4c8b-bd69-4aa3b4214ba8 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:38.794237 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1202/2398] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:23:38.798764 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc3fd4-5c60-4e44-8169-4b203c48834c None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:38.809400 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc3fd4-5c60-4e44-8169-4b203c48834c None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:38.815092 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b50f87-0ad6-4d1f-a327-e4a7452705b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:38.815779 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b50f87-0ad6-4d1f-a327-e4a7452705b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:38.816066 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b50f87-0ad6-4d1f-a327-e4a7452705b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:38.816343 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b50f87-0ad6-4d1f-a327-e4a7452705b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:38.817043 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b50f87-0ad6-4d1f-a327-e4a7452705b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:38.818969 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b50f87-0ad6-4d1f-a327-e4a7452705b4 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:38.925458 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1197/2399] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:23:38 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:23:38.925709 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae657b-7f25-4c8b-bd69-4aa3b4214ba8 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:38.937845 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae657b-7f25-4c8b-bd69-4aa3b4214ba8 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:38.995292 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3694ba-33cc-4d13-b4f0-2b9cf888cf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:38.995972 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3694ba-33cc-4d13-b4f0-2b9cf888cf9f admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:38.996261 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3694ba-33cc-4d13-b4f0-2b9cf888cf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:38.996545 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3694ba-33cc-4d13-b4f0-2b9cf888cf9f admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:38.997238 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3694ba-33cc-4d13-b4f0-2b9cf888cf9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:38.999188 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3694ba-33cc-4d13-b4f0-2b9cf888cf9f admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:39.126072 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1203/2400] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:23:38 2022] POST /identity/v3/users => generated 285 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:23:39.129871 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b50f87-0ad6-4d1f-a327-e4a7452705b4 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:39.139878 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b50f87-0ad6-4d1f-a327-e4a7452705b4 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:39.145272 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e4acd-f81b-4343-a809-0b294a57baa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:39.145976 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e4acd-f81b-4343-a809-0b294a57baa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:39.146264 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e4acd-f81b-4343-a809-0b294a57baa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:39.146543 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e4acd-f81b-4343-a809-0b294a57baa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:39.147283 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e4acd-f81b-4343-a809-0b294a57baa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:39.148939 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e4acd-f81b-4343-a809-0b294a57baa6 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:39.160743 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1198/2401] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:23:39.164635 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3694ba-33cc-4d13-b4f0-2b9cf888cf9f admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:39.174982 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3694ba-33cc-4d13-b4f0-2b9cf888cf9f admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:39.180093 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8a134-60d9-404c-97d8-2edcbe963552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:39.180976 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8a134-60d9-404c-97d8-2edcbe963552 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:39.181274 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8a134-60d9-404c-97d8-2edcbe963552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:39.181662 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8a134-60d9-404c-97d8-2edcbe963552 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:39.182460 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8a134-60d9-404c-97d8-2edcbe963552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:39.184149 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8a134-60d9-404c-97d8-2edcbe963552 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:39.195110 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1204/2402] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:23:39.198996 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e4acd-f81b-4343-a809-0b294a57baa6 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:39.209819 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e4acd-f81b-4343-a809-0b294a57baa6 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:39.214965 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c8670-d999-408f-a5bd-0ab176c36fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:39.215842 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c8670-d999-408f-a5bd-0ab176c36fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:39.216126 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c8670-d999-408f-a5bd-0ab176c36fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:39.216407 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c8670-d999-408f-a5bd-0ab176c36fe4 admin admin] PATH_INFO: `/v3/projects/3bb3abd84c80467198bc9a1bbd44d766/users/e990bd7b10f547039955b560d920eb65/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:39.231214 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c8670-d999-408f-a5bd-0ab176c36fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb3abd84c80467198bc9a1bbd44d766, user_id=e990bd7b10f547039955b560d920eb65, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:39.233888 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c8670-d999-408f-a5bd-0ab176c36fe4 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:39.336833 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1199/2403] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:23:39 2022] PUT /identity/v3/projects/3bb3abd84c80467198bc9a1bbd44d766/users/e990bd7b10f547039955b560d920eb65/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:23:39.347707 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6b892-f0a2-400e-85af-9403b022517e None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:39.347999 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6b892-f0a2-400e-85af-9403b022517e None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:39.348287 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6b892-f0a2-400e-85af-9403b022517e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:39.375882 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-dbb6b892-f0a2-400e-85af-9403b022517e None None] MFA Rules not processed for user `e990bd7b10f547039955b560d920eb65`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:23:39.377377 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-dbb6b892-f0a2-400e-85af-9403b022517e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:39.442686 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1205/2404] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:23:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:23:39.454878 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c8670-d999-408f-a5bd-0ab176c36fe4 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:39.456678 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-5f8c8670-d999-408f-a5bd-0ab176c36fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:39.538376 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c8670-d999-408f-a5bd-0ab176c36fe4 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:39.542225 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7319cd-5538-4f14-8e50-e39599d3b922 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b169395c92c4fbfbbe4fd14a235f81f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:39.542886 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7319cd-5538-4f14-8e50-e39599d3b922 service glance] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:39.543179 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7319cd-5538-4f14-8e50-e39599d3b922 service glance] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:39.543467 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7319cd-5538-4f14-8e50-e39599d3b922 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:39.554049 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7319cd-5538-4f14-8e50-e39599d3b922 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:39.557466 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7319cd-5538-4f14-8e50-e39599d3b922 service glance] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:39.566905 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1200/2405] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:23:39 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:23:41.850574 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80587a62-1099-4043-b84a-654b5c95565c None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:41.851117 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80587a62-1099-4043-b84a-654b5c95565c None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:41.851117 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80587a62-1099-4043-b84a-654b5c95565c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:41.899934 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-80587a62-1099-4043-b84a-654b5c95565c None None] MFA Rules not processed for user `a706b6d0163549bc80285c4158331b94`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:23:41.901185 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-80587a62-1099-4043-b84a-654b5c95565c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:41.978465 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1206/2406] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Mar 29 20:23:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:23:41.992530 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7319cd-5538-4f14-8e50-e39599d3b922 service glance] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:23:41.994453 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-ad7319cd-5538-4f14-8e50-e39599d3b922 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:23:42.090055 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7319cd-5538-4f14-8e50-e39599d3b922 service glance] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:23:42.095617 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0001a-1f91-4d2e-92e3-27c497f277f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d6d8e7788494f2c92ad5c183c8fa283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:23:42.096258 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0001a-1f91-4d2e-92e3-27c497f277f2 service swift] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:23:42.096542 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0001a-1f91-4d2e-92e3-27c497f277f2 service swift] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:23:42.096818 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0001a-1f91-4d2e-92e3-27c497f277f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:23:42.105411 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e0001a-1f91-4d2e-92e3-27c497f277f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:23:42.106993 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e0001a-1f91-4d2e-92e3-27c497f277f2 service swift] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:23:42.115298 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1201/2407] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Mar 29 20:23:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 20:24:02.923586 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bda0a-9d37-4168-b4ed-34d8a9e877fa None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:24:02.924128 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bda0a-9d37-4168-b4ed-34d8a9e877fa None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:24:02.924128 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bda0a-9d37-4168-b4ed-34d8a9e877fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:24:02.945751 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-af2bda0a-9d37-4168-b4ed-34d8a9e877fa None None] MFA Rules not processed for user `a706b6d0163549bc80285c4158331b94`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:24:02.946971 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-af2bda0a-9d37-4168-b4ed-34d8a9e877fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:24:02.954145 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1207/2408] 10.222.0.43 () {58 vars in 967 bytes} [Tue Mar 29 20:24:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:24:02.981535 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0001a-1f91-4d2e-92e3-27c497f277f2 service swift] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:24:02.994131 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0001a-1f91-4d2e-92e3-27c497f277f2 service swift] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:24:02.999223 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43597eef-b8e2-447a-8320-0494816c0beb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d6d8e7788494f2c92ad5c183c8fa283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:24:02.999913 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43597eef-b8e2-447a-8320-0494816c0beb service swift] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:24:03.000149 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43597eef-b8e2-447a-8320-0494816c0beb service swift] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:24:03.000432 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43597eef-b8e2-447a-8320-0494816c0beb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:24:03.009085 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43597eef-b8e2-447a-8320-0494816c0beb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:24:03.012631 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43597eef-b8e2-447a-8320-0494816c0beb service swift] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:24:03.018676 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1202/2409] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Mar 29 20:24:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 20:24:16.490172 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2bda0a-9d37-4168-b4ed-34d8a9e877fa None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:24:16.550386 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2bda0a-9d37-4168-b4ed-34d8a9e877fa None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:24:16.555546 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563aa58-f91b-4f04-a72b-7a7249a2457d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:24:16.556403 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563aa58-f91b-4f04-a72b-7a7249a2457d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:24:16.556685 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563aa58-f91b-4f04-a72b-7a7249a2457d admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:24:16.556968 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563aa58-f91b-4f04-a72b-7a7249a2457d admin admin] PATH_INFO: `/v3/users/e990bd7b10f547039955b560d920eb65` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:24:16.558151 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563aa58-f91b-4f04-a72b-7a7249a2457d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e990bd7b10f547039955b560d920eb65)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:24:16.560041 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563aa58-f91b-4f04-a72b-7a7249a2457d admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:24:16.715617 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7563aa58-f91b-4f04-a72b-7a7249a2457d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e990bd7b10f547039955b560d920eb65'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:24:16.764947 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7563aa58-f91b-4f04-a72b-7a7249a2457d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e990bd7b10f547039955b560d920eb65'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:24:16.765601 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7563aa58-f91b-4f04-a72b-7a7249a2457d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e990bd7b10f547039955b560d920eb65'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:24:16.766204 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7563aa58-f91b-4f04-a72b-7a7249a2457d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e990bd7b10f547039955b560d920eb65'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:24:16.773482 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7563aa58-f91b-4f04-a72b-7a7249a2457d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e990bd7b10f547039955b560d920eb65'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:24:16.790667 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1208/2410] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:24:16 2022] DELETE /identity/v3/users/e990bd7b10f547039955b560d920eb65 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:24:16.795212 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ca140-87ad-4548-a1b7-0e5027530110 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:24:16.795679 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ca140-87ad-4548-a1b7-0e5027530110 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:24:16.795865 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ca140-87ad-4548-a1b7-0e5027530110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:24:16.815206 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-1d3ca140-87ad-4548-a1b7-0e5027530110 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:24:16.816434 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-1d3ca140-87ad-4548-a1b7-0e5027530110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:24:16.872194 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1203/2411] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:24:16.882029 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563aa58-f91b-4f04-a72b-7a7249a2457d admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:24:16.883391 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-7563aa58-f91b-4f04-a72b-7a7249a2457d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:24:16.938929 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563aa58-f91b-4f04-a72b-7a7249a2457d admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:24:16.942829 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddd132-7dcb-4fd6-aec2-1f58a53f9837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:24:16.943478 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddd132-7dcb-4fd6-aec2-1f58a53f9837 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:24:16.943837 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddd132-7dcb-4fd6-aec2-1f58a53f9837 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:24:16.944200 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddd132-7dcb-4fd6-aec2-1f58a53f9837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:24:16.953213 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ddd132-7dcb-4fd6-aec2-1f58a53f9837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:24:16.954665 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ddd132-7dcb-4fd6-aec2-1f58a53f9837 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:24:16.963902 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1209/2412] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:24:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:24:18.092935 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ca140-87ad-4548-a1b7-0e5027530110 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:24:18.097594 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-1d3ca140-87ad-4548-a1b7-0e5027530110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:24:18.107141 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ca140-87ad-4548-a1b7-0e5027530110 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:24:18.112235 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a94fa7-81c7-45da-b8a2-43dede377261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:24:18.113109 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a94fa7-81c7-45da-b8a2-43dede377261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:24:18.113432 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a94fa7-81c7-45da-b8a2-43dede377261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:24:18.113717 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a94fa7-81c7-45da-b8a2-43dede377261 admin admin] PATH_INFO: `/v3/projects/3bb3abd84c80467198bc9a1bbd44d766` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:24:18.114941 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a94fa7-81c7-45da-b8a2-43dede377261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bb3abd84c80467198bc9a1bbd44d766)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:24:18.116953 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a94fa7-81c7-45da-b8a2-43dede377261 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:24:18.216842 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-c7a94fa7-81c7-45da-b8a2-43dede377261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bb3abd84c80467198bc9a1bbd44d766', 'request_id': 'req-c7a94fa7-81c7-45da-b8a2-43dede377261'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:24:18.284432 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-c7a94fa7-81c7-45da-b8a2-43dede377261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bb3abd84c80467198bc9a1bbd44d766', 'request_id': 'req-c7a94fa7-81c7-45da-b8a2-43dede377261'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:24:18.291083 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-c7a94fa7-81c7-45da-b8a2-43dede377261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bb3abd84c80467198bc9a1bbd44d766', 'request_id': 'req-c7a94fa7-81c7-45da-b8a2-43dede377261'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:24:18.302000 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-c7a94fa7-81c7-45da-b8a2-43dede377261 admin admin] The token cache is being invalidate because project 3bb3abd84c80467198bc9a1bbd44d766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:24:18.302290 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-c7a94fa7-81c7-45da-b8a2-43dede377261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:24:18.303057 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-c7a94fa7-81c7-45da-b8a2-43dede377261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:24:18.305256 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1204/2413] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:24:18 2022] DELETE /identity/v3/projects/3bb3abd84c80467198bc9a1bbd44d766 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:24:18.310300 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd707c-b361-4be4-ab6d-1d404c246058 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:24:18.310775 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd707c-b361-4be4-ab6d-1d404c246058 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:24:18.310868 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd707c-b361-4be4-ab6d-1d404c246058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:24:18.330290 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-52cd707c-b361-4be4-ab6d-1d404c246058 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:24:18.331477 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-52cd707c-b361-4be4-ab6d-1d404c246058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:24:18.393134 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1210/2414] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:24:18.399785 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd110ac6-5396-466a-a8f5-ad0fa93e0ec9 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:24:18.400162 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd110ac6-5396-466a-a8f5-ad0fa93e0ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:24:18.400520 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd110ac6-5396-466a-a8f5-ad0fa93e0ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:24:18.419797 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-bd110ac6-5396-466a-a8f5-ad0fa93e0ec9 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:24:18.420921 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-bd110ac6-5396-466a-a8f5-ad0fa93e0ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:24:18.431403 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1205/2415] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:24:18.435477 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd707c-b361-4be4-ab6d-1d404c246058 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:24:18.446699 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd707c-b361-4be4-ab6d-1d404c246058 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:24:18.452291 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f85fd-4a8f-4655-bb7a-f51bf947f839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:24:18.453157 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f85fd-4a8f-4655-bb7a-f51bf947f839 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:24:18.453484 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f85fd-4a8f-4655-bb7a-f51bf947f839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:24:18.464380 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f85fd-4a8f-4655-bb7a-f51bf947f839 admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:24:18.464380 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f85fd-4a8f-4655-bb7a-f51bf947f839 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:24:18.464380 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f85fd-4a8f-4655-bb7a-f51bf947f839 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:24:18.464380 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f85fd-4a8f-4655-bb7a-f51bf947f839 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:24:18.469945 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1211/2416] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:24:18.474298 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd110ac6-5396-466a-a8f5-ad0fa93e0ec9 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:24:18.484642 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd110ac6-5396-466a-a8f5-ad0fa93e0ec9 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:24:18.489607 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9480cc-90ed-47c8-8ca7-c263ff1d6708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:24:18.490255 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9480cc-90ed-47c8-8ca7-c263ff1d6708 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:24:18.490538 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9480cc-90ed-47c8-8ca7-c263ff1d6708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:24:18.490861 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9480cc-90ed-47c8-8ca7-c263ff1d6708 admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:24:18.492724 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9480cc-90ed-47c8-8ca7-c263ff1d6708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:24:18.494669 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9480cc-90ed-47c8-8ca7-c263ff1d6708 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:24:18.607278 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1206/2417] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:24:18 2022] POST /identity/v3/projects => generated 363 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:24:18.611196 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f85fd-4a8f-4655-bb7a-f51bf947f839 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:24:18.622111 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f85fd-4a8f-4655-bb7a-f51bf947f839 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:24:18.677040 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4928d-7e72-410f-bd44-027758b31561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:24:18.677683 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4928d-7e72-410f-bd44-027758b31561 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:24:18.677997 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4928d-7e72-410f-bd44-027758b31561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:24:18.678316 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4928d-7e72-410f-bd44-027758b31561 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:24:18.679689 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4928d-7e72-410f-bd44-027758b31561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:24:18.681652 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4928d-7e72-410f-bd44-027758b31561 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:24:18.789133 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1212/2418] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:24:18 2022] POST /identity/v3/users => generated 282 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:24:18.792946 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9480cc-90ed-47c8-8ca7-c263ff1d6708 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:24:18.803571 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9480cc-90ed-47c8-8ca7-c263ff1d6708 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:24:18.808480 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6e5df-5f14-414d-a22a-cc38d6ad3ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:24:18.809186 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6e5df-5f14-414d-a22a-cc38d6ad3ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:24:18.809509 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6e5df-5f14-414d-a22a-cc38d6ad3ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:24:18.809914 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6e5df-5f14-414d-a22a-cc38d6ad3ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:24:18.810647 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6e5df-5f14-414d-a22a-cc38d6ad3ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:24:18.812242 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6e5df-5f14-414d-a22a-cc38d6ad3ae4 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:24:18.826633 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1207/2419] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:24:18.829416 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4928d-7e72-410f-bd44-027758b31561 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:24:18.839903 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4928d-7e72-410f-bd44-027758b31561 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:24:18.844428 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80725110-6824-4202-b3a9-70c738502ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:24:18.845080 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80725110-6824-4202-b3a9-70c738502ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:24:18.845398 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80725110-6824-4202-b3a9-70c738502ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:24:18.845682 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80725110-6824-4202-b3a9-70c738502ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:24:18.846404 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80725110-6824-4202-b3a9-70c738502ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:24:18.847998 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80725110-6824-4202-b3a9-70c738502ef8 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:24:18.858236 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1213/2420] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:24:18.862211 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6e5df-5f14-414d-a22a-cc38d6ad3ae4 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:24:18.872433 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6e5df-5f14-414d-a22a-cc38d6ad3ae4 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:24:18.876912 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b4245-93e4-405c-86e8-8c7e3300e80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:24:18.877809 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b4245-93e4-405c-86e8-8c7e3300e80c admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:24:18.878093 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b4245-93e4-405c-86e8-8c7e3300e80c admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:24:18.878367 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b4245-93e4-405c-86e8-8c7e3300e80c admin admin] PATH_INFO: `/v3/projects/1e79df43810a4b578b3a325a46ae61bb/users/fc4b50fd18394b41b9a4b8396dcc1c69/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:24:18.892541 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b4245-93e4-405c-86e8-8c7e3300e80c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e79df43810a4b578b3a325a46ae61bb, user_id=fc4b50fd18394b41b9a4b8396dcc1c69, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:24:18.895180 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b4245-93e4-405c-86e8-8c7e3300e80c admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:24:18.966841 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1208/2421] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:24:18 2022] PUT /identity/v3/projects/1e79df43810a4b578b3a325a46ae61bb/users/fc4b50fd18394b41b9a4b8396dcc1c69/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:24:18.977396 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189efd5-3b19-4dae-8cec-c5341022e5d1 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:24:18.977718 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189efd5-3b19-4dae-8cec-c5341022e5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:24:18.978001 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189efd5-3b19-4dae-8cec-c5341022e5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:24:19.005928 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-0189efd5-3b19-4dae-8cec-c5341022e5d1 None None] MFA Rules not processed for user `fc4b50fd18394b41b9a4b8396dcc1c69`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:24:19.007488 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-0189efd5-3b19-4dae-8cec-c5341022e5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:24:19.076509 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1214/2422] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:24:18 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:24:19.088619 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b4245-93e4-405c-86e8-8c7e3300e80c admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:24:19.090427 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-b11b4245-93e4-405c-86e8-8c7e3300e80c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:24:19.150120 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b4245-93e4-405c-86e8-8c7e3300e80c admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:24:19.154175 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a6c6b-3f17-4197-a9bf-8e73811691c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:24:19.154822 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a6c6b-3f17-4197-a9bf-8e73811691c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:24:19.155105 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a6c6b-3f17-4197-a9bf-8e73811691c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:24:19.155383 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a6c6b-3f17-4197-a9bf-8e73811691c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:24:19.164942 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a6c6b-3f17-4197-a9bf-8e73811691c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:24:19.166397 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a6c6b-3f17-4197-a9bf-8e73811691c9 service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:24:19.175522 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1209/2423] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:24:19 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:24:20.165692 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189efd5-3b19-4dae-8cec-c5341022e5d1 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:24:20.167225 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-0189efd5-3b19-4dae-8cec-c5341022e5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:24:20.222558 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189efd5-3b19-4dae-8cec-c5341022e5d1 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:24:20.226183 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287d41b-6db5-42fe-be52-5bbc9d056933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:24:20.231173 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287d41b-6db5-42fe-be52-5bbc9d056933 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:24:20.231173 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287d41b-6db5-42fe-be52-5bbc9d056933 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:24:20.231173 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287d41b-6db5-42fe-be52-5bbc9d056933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:24:20.231173 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b287d41b-6db5-42fe-be52-5bbc9d056933 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:24:20.289131 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287d41b-6db5-42fe-be52-5bbc9d056933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:24:20.290543 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287d41b-6db5-42fe-be52-5bbc9d056933 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:24:20.300426 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1215/2424] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:24:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:24:43.462693 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2d610-bfe9-4541-afe0-d29760f8cec5 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:24:43.464341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2d610-bfe9-4541-afe0-d29760f8cec5 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:24:43.464341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2d610-bfe9-4541-afe0-d29760f8cec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:24:43.483837 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-14b2d610-bfe9-4541-afe0-d29760f8cec5 None None] MFA Rules not processed for user `f752a7bea22542009cbf86e7b36c8e83`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:24:43.485055 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-14b2d610-bfe9-4541-afe0-d29760f8cec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:24:43.539473 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1210/2425] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:24:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:24:59.508879 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287d41b-6db5-42fe-be52-5bbc9d056933 service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:24:59.571048 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287d41b-6db5-42fe-be52-5bbc9d056933 service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:24:59.576135 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22c334-71c9-423f-90b8-c2e80c3844f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:24:59.577014 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22c334-71c9-423f-90b8-c2e80c3844f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:24:59.577324 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22c334-71c9-423f-90b8-c2e80c3844f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:24:59.577603 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22c334-71c9-423f-90b8-c2e80c3844f7 admin admin] PATH_INFO: `/v3/users/fc4b50fd18394b41b9a4b8396dcc1c69` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:24:59.578794 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22c334-71c9-423f-90b8-c2e80c3844f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc4b50fd18394b41b9a4b8396dcc1c69)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:24:59.580741 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22c334-71c9-423f-90b8-c2e80c3844f7 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:24:59.802320 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-4e22c334-71c9-423f-90b8-c2e80c3844f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc4b50fd18394b41b9a4b8396dcc1c69'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:24:59.859030 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-4e22c334-71c9-423f-90b8-c2e80c3844f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc4b50fd18394b41b9a4b8396dcc1c69'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:24:59.864798 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-4e22c334-71c9-423f-90b8-c2e80c3844f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc4b50fd18394b41b9a4b8396dcc1c69'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:24:59.864798 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-4e22c334-71c9-423f-90b8-c2e80c3844f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc4b50fd18394b41b9a4b8396dcc1c69'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:24:59.875739 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-4e22c334-71c9-423f-90b8-c2e80c3844f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc4b50fd18394b41b9a4b8396dcc1c69'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:24:59.898856 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1216/2426] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:24:59 2022] DELETE /identity/v3/users/fc4b50fd18394b41b9a4b8396dcc1c69 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:24:59.903469 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60f83e-8a8e-430c-b3a8-42ad92337390 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:24:59.904006 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60f83e-8a8e-430c-b3a8-42ad92337390 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:24:59.904097 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60f83e-8a8e-430c-b3a8-42ad92337390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:24:59.923320 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-6f60f83e-8a8e-430c-b3a8-42ad92337390 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:24:59.925142 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-6f60f83e-8a8e-430c-b3a8-42ad92337390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:25:00.003357 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1211/2427] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:25:00.013707 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22c334-71c9-423f-90b8-c2e80c3844f7 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:00.015444 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-4e22c334-71c9-423f-90b8-c2e80c3844f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:25:00.084205 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22c334-71c9-423f-90b8-c2e80c3844f7 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:00.088513 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66caa19d-72d4-4413-8c68-6cf831617ca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:00.089164 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66caa19d-72d4-4413-8c68-6cf831617ca7 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:00.089536 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66caa19d-72d4-4413-8c68-6cf831617ca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:00.089755 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66caa19d-72d4-4413-8c68-6cf831617ca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:00.099839 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66caa19d-72d4-4413-8c68-6cf831617ca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:00.101330 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66caa19d-72d4-4413-8c68-6cf831617ca7 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:00.111610 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1217/2428] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:25:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:25:00.549976 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60f83e-8a8e-430c-b3a8-42ad92337390 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:00.551500 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-6f60f83e-8a8e-430c-b3a8-42ad92337390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:25:00.566734 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60f83e-8a8e-430c-b3a8-42ad92337390 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:00.571635 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce914a-b49c-47d9-80f2-c4385c7ea47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:00.572904 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce914a-b49c-47d9-80f2-c4385c7ea47b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:00.573363 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce914a-b49c-47d9-80f2-c4385c7ea47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:00.574481 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce914a-b49c-47d9-80f2-c4385c7ea47b admin admin] PATH_INFO: `/v3/projects/1e79df43810a4b578b3a325a46ae61bb` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:00.576151 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce914a-b49c-47d9-80f2-c4385c7ea47b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e79df43810a4b578b3a325a46ae61bb)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:00.578167 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce914a-b49c-47d9-80f2-c4385c7ea47b admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:00.663180 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a1ce914a-b49c-47d9-80f2-c4385c7ea47b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e79df43810a4b578b3a325a46ae61bb', 'request_id': 'req-a1ce914a-b49c-47d9-80f2-c4385c7ea47b'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:25:00.707613 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a1ce914a-b49c-47d9-80f2-c4385c7ea47b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e79df43810a4b578b3a325a46ae61bb', 'request_id': 'req-a1ce914a-b49c-47d9-80f2-c4385c7ea47b'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:25:00.714045 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a1ce914a-b49c-47d9-80f2-c4385c7ea47b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e79df43810a4b578b3a325a46ae61bb', 'request_id': 'req-a1ce914a-b49c-47d9-80f2-c4385c7ea47b'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:25:00.725161 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a1ce914a-b49c-47d9-80f2-c4385c7ea47b admin admin] The token cache is being invalidate because project 1e79df43810a4b578b3a325a46ae61bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:25:00.725569 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a1ce914a-b49c-47d9-80f2-c4385c7ea47b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:25:00.726217 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a1ce914a-b49c-47d9-80f2-c4385c7ea47b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:25:00.727787 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1212/2429] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:25:00 2022] DELETE /identity/v3/projects/1e79df43810a4b578b3a325a46ae61bb => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:25:00.733645 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e070e-f329-47ef-8bb5-1f5c704f660b None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:00.734131 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e070e-f329-47ef-8bb5-1f5c704f660b None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:00.734228 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e070e-f329-47ef-8bb5-1f5c704f660b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:00.751514 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-8d1e070e-f329-47ef-8bb5-1f5c704f660b None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:25:00.752700 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-8d1e070e-f329-47ef-8bb5-1f5c704f660b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:25:00.812915 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1218/2430] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:25:00.820977 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac474315-9cc9-4ad3-8ef1-e25f80f491c2 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:00.821273 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac474315-9cc9-4ad3-8ef1-e25f80f491c2 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:00.821583 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac474315-9cc9-4ad3-8ef1-e25f80f491c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:00.843075 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-ac474315-9cc9-4ad3-8ef1-e25f80f491c2 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:25:00.844267 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-ac474315-9cc9-4ad3-8ef1-e25f80f491c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:25:00.852145 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1213/2431] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:25:00.857048 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e070e-f329-47ef-8bb5-1f5c704f660b None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:00.866608 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e070e-f329-47ef-8bb5-1f5c704f660b None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:00.871885 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92881d2-c7a7-4620-b2d1-fc2cb5a82868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:00.872632 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92881d2-c7a7-4620-b2d1-fc2cb5a82868 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:00.872811 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92881d2-c7a7-4620-b2d1-fc2cb5a82868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:00.873429 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92881d2-c7a7-4620-b2d1-fc2cb5a82868 admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:00.874231 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92881d2-c7a7-4620-b2d1-fc2cb5a82868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:25:00.874713 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92881d2-c7a7-4620-b2d1-fc2cb5a82868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:00.876308 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92881d2-c7a7-4620-b2d1-fc2cb5a82868 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:00.888359 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1219/2432] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:25:00.897974 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac474315-9cc9-4ad3-8ef1-e25f80f491c2 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:00.908182 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac474315-9cc9-4ad3-8ef1-e25f80f491c2 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:00.912847 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417c8b4-bf61-4aed-ac30-62c5c4da4bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:00.913587 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417c8b4-bf61-4aed-ac30-62c5c4da4bca admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:00.913818 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417c8b4-bf61-4aed-ac30-62c5c4da4bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:00.914219 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417c8b4-bf61-4aed-ac30-62c5c4da4bca admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:00.914914 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417c8b4-bf61-4aed-ac30-62c5c4da4bca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:00.918147 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417c8b4-bf61-4aed-ac30-62c5c4da4bca admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:01.038056 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1214/2433] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:25:00 2022] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:25:01.042926 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92881d2-c7a7-4620-b2d1-fc2cb5a82868 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:01.057554 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92881d2-c7a7-4620-b2d1-fc2cb5a82868 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:01.119919 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6f43d-e96a-433b-92a0-a6780ee32a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:01.120605 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6f43d-e96a-433b-92a0-a6780ee32a7b admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:01.121018 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6f43d-e96a-433b-92a0-a6780ee32a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:01.121326 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6f43d-e96a-433b-92a0-a6780ee32a7b admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:01.122034 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6f43d-e96a-433b-92a0-a6780ee32a7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:01.124043 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6f43d-e96a-433b-92a0-a6780ee32a7b admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:01.205673 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1220/2434] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:25:01 2022] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:25:01.209600 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417c8b4-bf61-4aed-ac30-62c5c4da4bca admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:01.221588 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417c8b4-bf61-4aed-ac30-62c5c4da4bca admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:01.233104 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc399d-e5bc-47cb-a519-d7cb466ebdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:01.234905 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc399d-e5bc-47cb-a519-d7cb466ebdeb admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:01.235340 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc399d-e5bc-47cb-a519-d7cb466ebdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:01.239153 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc399d-e5bc-47cb-a519-d7cb466ebdeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:01.239153 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc399d-e5bc-47cb-a519-d7cb466ebdeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:01.239389 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc399d-e5bc-47cb-a519-d7cb466ebdeb admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:01.260128 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1215/2435] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:25:01.264037 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6f43d-e96a-433b-92a0-a6780ee32a7b admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:01.275309 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6f43d-e96a-433b-92a0-a6780ee32a7b admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:01.281254 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298084a-915d-4269-b5aa-d2badbc47942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:01.281958 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298084a-915d-4269-b5aa-d2badbc47942 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:01.282245 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298084a-915d-4269-b5aa-d2badbc47942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:01.282523 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298084a-915d-4269-b5aa-d2badbc47942 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:01.283351 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298084a-915d-4269-b5aa-d2badbc47942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:01.285003 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298084a-915d-4269-b5aa-d2badbc47942 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:01.297407 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1221/2436] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:25:01.301436 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc399d-e5bc-47cb-a519-d7cb466ebdeb admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:01.313812 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc399d-e5bc-47cb-a519-d7cb466ebdeb admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:01.318987 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638cc4b-0df8-486f-aff2-97c96346c759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:01.319888 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638cc4b-0df8-486f-aff2-97c96346c759 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:01.320170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638cc4b-0df8-486f-aff2-97c96346c759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:01.320444 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638cc4b-0df8-486f-aff2-97c96346c759 admin admin] PATH_INFO: `/v3/projects/f9800a1b31b34882beb7e5e6dcb78fd6/users/a0ce08fda1014dff843c40970cf3af11/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:01.336954 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638cc4b-0df8-486f-aff2-97c96346c759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9800a1b31b34882beb7e5e6dcb78fd6, user_id=a0ce08fda1014dff843c40970cf3af11, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:01.340285 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638cc4b-0df8-486f-aff2-97c96346c759 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:01.418192 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1216/2437] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:25:01 2022] PUT /identity/v3/projects/f9800a1b31b34882beb7e5e6dcb78fd6/users/a0ce08fda1014dff843c40970cf3af11/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:25:01.423542 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f260f9a-4694-4005-9715-102675d3c5ad None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:01.423835 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f260f9a-4694-4005-9715-102675d3c5ad None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:01.424123 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f260f9a-4694-4005-9715-102675d3c5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:01.443390 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-6f260f9a-4694-4005-9715-102675d3c5ad None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:25:01.444598 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-6f260f9a-4694-4005-9715-102675d3c5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:25:01.513004 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1222/2438] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:25:01.529875 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638cc4b-0df8-486f-aff2-97c96346c759 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:01.531962 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-e638cc4b-0df8-486f-aff2-97c96346c759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:25:01.607519 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638cc4b-0df8-486f-aff2-97c96346c759 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:01.617484 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cda6a8-c627-4b26-a453-71c037bac8eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:01.624109 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cda6a8-c627-4b26-a453-71c037bac8eb service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:01.624109 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cda6a8-c627-4b26-a453-71c037bac8eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:01.624109 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cda6a8-c627-4b26-a453-71c037bac8eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:01.631851 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cda6a8-c627-4b26-a453-71c037bac8eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:01.633319 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cda6a8-c627-4b26-a453-71c037bac8eb service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:01.644117 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1217/2439] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:25:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:25:04.447369 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a68828-e8ce-4765-8908-0acd579d8963 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:04.447927 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a68828-e8ce-4765-8908-0acd579d8963 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:04.447927 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a68828-e8ce-4765-8908-0acd579d8963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:04.466658 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-a4a68828-e8ce-4765-8908-0acd579d8963 None None] MFA Rules not processed for user `1c4e8920f33a4ae1a68811d68dd5d58f`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:25:04.467865 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a4a68828-e8ce-4765-8908-0acd579d8963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:25:04.527032 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1223/2440] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:25:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:25:07.221359 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671de98-98f7-4ef9-a452-f558d167dc0c None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:07.221892 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671de98-98f7-4ef9-a452-f558d167dc0c None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:07.221892 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671de98-98f7-4ef9-a452-f558d167dc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:07.262741 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-7671de98-98f7-4ef9-a452-f558d167dc0c None None] MFA Rules not processed for user `a0ce08fda1014dff843c40970cf3af11`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:25:07.264219 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-7671de98-98f7-4ef9-a452-f558d167dc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:25:07.365763 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1218/2441] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:25:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:25:07.370598 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a68828-e8ce-4765-8908-0acd579d8963 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:07.388258 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a68828-e8ce-4765-8908-0acd579d8963 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:07.394901 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fe5b2-2346-4181-b0d9-d4cc012719b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:07.396022 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fe5b2-2346-4181-b0d9-d4cc012719b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:07.396371 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fe5b2-2346-4181-b0d9-d4cc012719b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:07.396717 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fe5b2-2346-4181-b0d9-d4cc012719b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:07.397630 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fe5b2-2346-4181-b0d9-d4cc012719b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:07.399997 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fe5b2-2346-4181-b0d9-d4cc012719b7 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:07.508694 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1224/2442] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:25:07 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:25:07.511519 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671de98-98f7-4ef9-a452-f558d167dc0c None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:07.523050 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671de98-98f7-4ef9-a452-f558d167dc0c None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:07.598482 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6799d-d698-4ca6-bb8f-0caef95609ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:07.599677 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6799d-d698-4ca6-bb8f-0caef95609ff admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:07.600116 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6799d-d698-4ca6-bb8f-0caef95609ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:07.600611 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6799d-d698-4ca6-bb8f-0caef95609ff admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:07.601578 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6799d-d698-4ca6-bb8f-0caef95609ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:07.604821 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6799d-d698-4ca6-bb8f-0caef95609ff admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:07.725991 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1219/2443] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:25:07 2022] POST /identity/v3/users => generated 296 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:25:07.730796 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fe5b2-2346-4181-b0d9-d4cc012719b7 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:07.742540 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fe5b2-2346-4181-b0d9-d4cc012719b7 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:07.748487 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a1450-908e-4387-83a8-a986affad49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:07.749843 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a1450-908e-4387-83a8-a986affad49c admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:07.750321 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a1450-908e-4387-83a8-a986affad49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:07.751834 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a1450-908e-4387-83a8-a986affad49c admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:07.752723 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a1450-908e-4387-83a8-a986affad49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:07.754596 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a1450-908e-4387-83a8-a986affad49c admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:07.767965 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1225/2444] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:25:07.772616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6799d-d698-4ca6-bb8f-0caef95609ff admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:07.786667 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6799d-d698-4ca6-bb8f-0caef95609ff admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:07.796197 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d23da-0e4e-4d8a-b3b0-d297f46259d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:07.797439 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d23da-0e4e-4d8a-b3b0-d297f46259d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:07.797918 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d23da-0e4e-4d8a-b3b0-d297f46259d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:07.799745 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d23da-0e4e-4d8a-b3b0-d297f46259d8 admin admin] PATH_INFO: `/v3/projects/4d4ba541303f4c3cbbbb479c169d8bd4/users/7e9f53378a3247858997c804b376426e/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:07.827851 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d23da-0e4e-4d8a-b3b0-d297f46259d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d4ba541303f4c3cbbbb479c169d8bd4, user_id=7e9f53378a3247858997c804b376426e, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:07.835714 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d23da-0e4e-4d8a-b3b0-d297f46259d8 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:07.901674 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1220/2445] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:25:07 2022] PUT /identity/v3/projects/4d4ba541303f4c3cbbbb479c169d8bd4/users/7e9f53378a3247858997c804b376426e/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:25:07.906310 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a1450-908e-4387-83a8-a986affad49c admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:07.917609 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a1450-908e-4387-83a8-a986affad49c admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:08.018570 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73d0c9-7294-486f-902d-92cae403f55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:08.019689 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73d0c9-7294-486f-902d-92cae403f55d admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:08.020083 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73d0c9-7294-486f-902d-92cae403f55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:08.020445 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73d0c9-7294-486f-902d-92cae403f55d admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:08.026531 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73d0c9-7294-486f-902d-92cae403f55d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:08.028415 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73d0c9-7294-486f-902d-92cae403f55d admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:08.047198 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1226/2446] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:25:08.051587 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d23da-0e4e-4d8a-b3b0-d297f46259d8 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:08.063620 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d23da-0e4e-4d8a-b3b0-d297f46259d8 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:08.068891 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabf710-0269-4909-9ac5-a465ee83c39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:08.069856 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabf710-0269-4909-9ac5-a465ee83c39d admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:08.070167 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabf710-0269-4909-9ac5-a465ee83c39d admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:08.070444 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabf710-0269-4909-9ac5-a465ee83c39d admin admin] PATH_INFO: `/v3/projects/4d4ba541303f4c3cbbbb479c169d8bd4/users/7e9f53378a3247858997c804b376426e/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:08.073769 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabf710-0269-4909-9ac5-a465ee83c39d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d4ba541303f4c3cbbbb479c169d8bd4, user_id=7e9f53378a3247858997c804b376426e, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:08.077207 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabf710-0269-4909-9ac5-a465ee83c39d admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:08.093653 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1221/2447] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:25:08 2022] PUT /identity/v3/projects/4d4ba541303f4c3cbbbb479c169d8bd4/users/7e9f53378a3247858997c804b376426e/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:25:15.129975 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a26a3-0411-4083-b695-2405bbf0f1b6 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:15.131043 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a26a3-0411-4083-b695-2405bbf0f1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:15.131398 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a26a3-0411-4083-b695-2405bbf0f1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:15.159943 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-045a26a3-0411-4083-b695-2405bbf0f1b6 None None] MFA Rules not processed for user `7e9f53378a3247858997c804b376426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:25:15.161927 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-045a26a3-0411-4083-b695-2405bbf0f1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:25:15.243338 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1227/2448] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:25:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:25:15.267234 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabf710-0269-4909-9ac5-a465ee83c39d admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:15.269056 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-0aabf710-0269-4909-9ac5-a465ee83c39d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:25:15.488082 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabf710-0269-4909-9ac5-a465ee83c39d admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:15.493834 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1165212-4e03-4f9b-91cd-b8f7195f0ecd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:15.495111 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1165212-4e03-4f9b-91cd-b8f7195f0ecd service nova] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:15.495397 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1165212-4e03-4f9b-91cd-b8f7195f0ecd service nova] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:15.495675 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1165212-4e03-4f9b-91cd-b8f7195f0ecd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:15.555231 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1165212-4e03-4f9b-91cd-b8f7195f0ecd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:15.557019 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1165212-4e03-4f9b-91cd-b8f7195f0ecd service nova] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:15.566856 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1222/2449] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:25:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:25:27.173534 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a26a3-0411-4083-b695-2405bbf0f1b6 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:27.175105 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-045a26a3-0411-4083-b695-2405bbf0f1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:25:27.242756 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a26a3-0411-4083-b695-2405bbf0f1b6 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:27.246533 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84451faf-4156-4df4-be1e-38354f6bbfa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:27.247210 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84451faf-4156-4df4-be1e-38354f6bbfa9 service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:27.247496 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84451faf-4156-4df4-be1e-38354f6bbfa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:27.247779 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84451faf-4156-4df4-be1e-38354f6bbfa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:27.249852 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-84451faf-4156-4df4-be1e-38354f6bbfa9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:25:27.265777 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84451faf-4156-4df4-be1e-38354f6bbfa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:27.267416 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84451faf-4156-4df4-be1e-38354f6bbfa9 service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:27.279869 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1228/2450] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:25:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:25:28.196276 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ff341-0bc9-4adb-9de4-7955e9874341 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:28.196865 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ff341-0bc9-4adb-9de4-7955e9874341 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:28.196865 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ff341-0bc9-4adb-9de4-7955e9874341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:28.217557 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-638ff341-0bc9-4adb-9de4-7955e9874341 None None] MFA Rules not processed for user `b608c6b9c7ef48c2abe8ec8ebb61d75c`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:25:28.218757 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-638ff341-0bc9-4adb-9de4-7955e9874341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:25:28.283222 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1223/2451] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:25:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:25:29.070374 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84451faf-4156-4df4-be1e-38354f6bbfa9 service cinder] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:29.132572 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84451faf-4156-4df4-be1e-38354f6bbfa9 service cinder] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:29.136565 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5582798-b1d7-4a69-85f3-bc2690fe8332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:29.140350 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5582798-b1d7-4a69-85f3-bc2690fe8332 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:29.140785 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5582798-b1d7-4a69-85f3-bc2690fe8332 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:29.141070 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5582798-b1d7-4a69-85f3-bc2690fe8332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:29.143330 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e5582798-b1d7-4a69-85f3-bc2690fe8332 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:25:29.159409 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5582798-b1d7-4a69-85f3-bc2690fe8332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:29.160883 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5582798-b1d7-4a69-85f3-bc2690fe8332 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:29.173432 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1229/2452] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:25:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:25:34.626974 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c830ac-f245-474c-b32b-f70d6305808a None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:34.627542 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c830ac-f245-474c-b32b-f70d6305808a None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:34.627542 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c830ac-f245-474c-b32b-f70d6305808a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:34.645616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-52c830ac-f245-474c-b32b-f70d6305808a None None] MFA Rules not processed for user `a0ce08fda1014dff843c40970cf3af11`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:25:34.646832 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-52c830ac-f245-474c-b32b-f70d6305808a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:25:34.654299 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1224/2453] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:25:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:25:36.349337 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5582798-b1d7-4a69-85f3-bc2690fe8332 service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:36.351298 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e5582798-b1d7-4a69-85f3-bc2690fe8332 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:25:36.435750 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5582798-b1d7-4a69-85f3-bc2690fe8332 service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:36.441523 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea5f61-236a-4317-a969-4e83d07c4b12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef0001e91524a13a9ca601a601de66b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:36.442192 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea5f61-236a-4317-a969-4e83d07c4b12 service placement] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:36.442478 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea5f61-236a-4317-a969-4e83d07c4b12 service placement] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:36.442764 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea5f61-236a-4317-a969-4e83d07c4b12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:36.444569 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e2ea5f61-236a-4317-a969-4e83d07c4b12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:25:36.459919 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea5f61-236a-4317-a969-4e83d07c4b12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:36.461942 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea5f61-236a-4317-a969-4e83d07c4b12 service placement] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:36.475322 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1230/2454] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:25:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:25:36.671837 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c830ac-f245-474c-b32b-f70d6305808a None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:36.675471 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-52c830ac-f245-474c-b32b-f70d6305808a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:25:36.718822 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c830ac-f245-474c-b32b-f70d6305808a None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:36.725268 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4ca7c-6e79-428a-9e18-7fac1ca77453 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:36.726243 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4ca7c-6e79-428a-9e18-7fac1ca77453 service nova] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:36.726532 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4ca7c-6e79-428a-9e18-7fac1ca77453 service nova] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:36.726993 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4ca7c-6e79-428a-9e18-7fac1ca77453 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:36.728964 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-30f4ca7c-6e79-428a-9e18-7fac1ca77453 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:25:36.810461 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4ca7c-6e79-428a-9e18-7fac1ca77453 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:36.812251 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4ca7c-6e79-428a-9e18-7fac1ca77453 service nova] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:36.821959 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1225/2455] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:25:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:25:51.858467 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea5f61-236a-4317-a969-4e83d07c4b12 service placement] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:51.872301 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea5f61-236a-4317-a969-4e83d07c4b12 service placement] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:51.878336 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0f96d-2425-4ade-91d2-9df6c3184164 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:51.879172 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0f96d-2425-4ade-91d2-9df6c3184164 service nova] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:51.879485 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0f96d-2425-4ade-91d2-9df6c3184164 service nova] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:51.879839 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0f96d-2425-4ade-91d2-9df6c3184164 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:51.881987 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-c8e0f96d-2425-4ade-91d2-9df6c3184164 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:25:51.897078 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0f96d-2425-4ade-91d2-9df6c3184164 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:51.899273 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0f96d-2425-4ade-91d2-9df6c3184164 service nova] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:51.911593 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1231/2456] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:25:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:25:53.023692 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4ca7c-6e79-428a-9e18-7fac1ca77453 service nova] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:53.033826 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4ca7c-6e79-428a-9e18-7fac1ca77453 service nova] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:53.037530 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7b931-8288-4553-b97c-0f24079decdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:53.038170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7b931-8288-4553-b97c-0f24079decdf service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:53.038458 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7b931-8288-4553-b97c-0f24079decdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:53.038738 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7b931-8288-4553-b97c-0f24079decdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:53.040542 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-b2a7b931-8288-4553-b97c-0f24079decdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:25:53.051169 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7b931-8288-4553-b97c-0f24079decdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:53.052688 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7b931-8288-4553-b97c-0f24079decdf service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:53.066138 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1226/2457] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:25:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:25:53.589826 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0f96d-2425-4ade-91d2-9df6c3184164 service nova] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:53.600781 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0f96d-2425-4ade-91d2-9df6c3184164 service nova] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:53.604358 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0b17a-8d29-46ef-b74f-9c93b2720924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:53.605007 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0b17a-8d29-46ef-b74f-9c93b2720924 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:53.605318 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0b17a-8d29-46ef-b74f-9c93b2720924 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:53.605607 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0b17a-8d29-46ef-b74f-9c93b2720924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:53.607758 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e0f0b17a-8d29-46ef-b74f-9c93b2720924 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:25:53.678875 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0b17a-8d29-46ef-b74f-9c93b2720924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:53.680299 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0b17a-8d29-46ef-b74f-9c93b2720924 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:53.690660 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1232/2458] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:25:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:25:56.240600 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7b931-8288-4553-b97c-0f24079decdf service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:56.249905 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7b931-8288-4553-b97c-0f24079decdf service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:56.253722 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60306f8d-7fd3-4178-948d-e3b4885ab6cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:56.254434 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60306f8d-7fd3-4178-948d-e3b4885ab6cd service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:56.254725 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60306f8d-7fd3-4178-948d-e3b4885ab6cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:56.255008 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60306f8d-7fd3-4178-948d-e3b4885ab6cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:56.265481 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60306f8d-7fd3-4178-948d-e3b4885ab6cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:56.266941 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60306f8d-7fd3-4178-948d-e3b4885ab6cd service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:56.278938 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1227/2459] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:25:56 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:25:58.515834 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0b17a-8d29-46ef-b74f-9c93b2720924 service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:58.517359 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e0f0b17a-8d29-46ef-b74f-9c93b2720924 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:25:58.531180 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0b17a-8d29-46ef-b74f-9c93b2720924 service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:58.536315 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da86c6-cebb-4f5e-b99f-a072a9c7b088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:58.537204 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da86c6-cebb-4f5e-b99f-a072a9c7b088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:58.537526 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da86c6-cebb-4f5e-b99f-a072a9c7b088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:58.537811 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da86c6-cebb-4f5e-b99f-a072a9c7b088 admin admin] PATH_INFO: `/v3/users/f752a7bea22542009cbf86e7b36c8e83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:58.539039 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da86c6-cebb-4f5e-b99f-a072a9c7b088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f752a7bea22542009cbf86e7b36c8e83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:58.540975 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da86c6-cebb-4f5e-b99f-a072a9c7b088 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:58.727713 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-57da86c6-cebb-4f5e-b99f-a072a9c7b088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f752a7bea22542009cbf86e7b36c8e83'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:25:58.788659 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-57da86c6-cebb-4f5e-b99f-a072a9c7b088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f752a7bea22542009cbf86e7b36c8e83'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:25:58.789351 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-57da86c6-cebb-4f5e-b99f-a072a9c7b088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f752a7bea22542009cbf86e7b36c8e83'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:25:58.789992 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-57da86c6-cebb-4f5e-b99f-a072a9c7b088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f752a7bea22542009cbf86e7b36c8e83'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:25:58.799525 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-57da86c6-cebb-4f5e-b99f-a072a9c7b088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f752a7bea22542009cbf86e7b36c8e83'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:25:58.821606 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1233/2460] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:25:58 2022] DELETE /identity/v3/users/f752a7bea22542009cbf86e7b36c8e83 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:25:59.070051 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60306f8d-7fd3-4178-948d-e3b4885ab6cd service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:59.087886 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60306f8d-7fd3-4178-948d-e3b4885ab6cd service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:59.220801 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba680fdc-e7c7-4302-8bd7-9e4176130506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:59.223576 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba680fdc-e7c7-4302-8bd7-9e4176130506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:59.224311 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba680fdc-e7c7-4302-8bd7-9e4176130506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:59.224862 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba680fdc-e7c7-4302-8bd7-9e4176130506 admin admin] PATH_INFO: `/v3/projects/378d35471c8d47cc9624b98530d05223` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:59.227622 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba680fdc-e7c7-4302-8bd7-9e4176130506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=378d35471c8d47cc9624b98530d05223)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:59.231150 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba680fdc-e7c7-4302-8bd7-9e4176130506 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:59.424073 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-ba680fdc-e7c7-4302-8bd7-9e4176130506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '378d35471c8d47cc9624b98530d05223', 'request_id': 'req-ba680fdc-e7c7-4302-8bd7-9e4176130506'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:25:59.503178 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-ba680fdc-e7c7-4302-8bd7-9e4176130506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '378d35471c8d47cc9624b98530d05223', 'request_id': 'req-ba680fdc-e7c7-4302-8bd7-9e4176130506'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:25:59.512807 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-ba680fdc-e7c7-4302-8bd7-9e4176130506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '378d35471c8d47cc9624b98530d05223', 'request_id': 'req-ba680fdc-e7c7-4302-8bd7-9e4176130506'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:25:59.530470 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-ba680fdc-e7c7-4302-8bd7-9e4176130506 admin admin] The token cache is being invalidate because project 378d35471c8d47cc9624b98530d05223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:25:59.531169 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-ba680fdc-e7c7-4302-8bd7-9e4176130506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:25:59.532024 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-ba680fdc-e7c7-4302-8bd7-9e4176130506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:25:59.539005 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1228/2461] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:25:59 2022] DELETE /identity/v3/projects/378d35471c8d47cc9624b98530d05223 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:25:59.541176 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300433b7-172e-4fc2-8eb9-4b67afab465e None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:59.541818 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300433b7-172e-4fc2-8eb9-4b67afab465e None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:59.542447 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300433b7-172e-4fc2-8eb9-4b67afab465e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:59.582451 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-300433b7-172e-4fc2-8eb9-4b67afab465e None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:25:59.584136 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-300433b7-172e-4fc2-8eb9-4b67afab465e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:25:59.668078 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31c9e0-61e9-47f4-b936-1cbcfe7cb3d5 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:59.668375 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31c9e0-61e9-47f4-b936-1cbcfe7cb3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:59.668660 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31c9e0-61e9-47f4-b936-1cbcfe7cb3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:59.674164 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1234/2462] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:25:59.692227 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-9c31c9e0-61e9-47f4-b936-1cbcfe7cb3d5 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:25:59.693751 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9c31c9e0-61e9-47f4-b936-1cbcfe7cb3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:25:59.713430 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300433b7-172e-4fc2-8eb9-4b67afab465e None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:59.718925 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1229/2463] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:25:59.724555 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300433b7-172e-4fc2-8eb9-4b67afab465e None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:59.733736 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc1bdf-d0ac-4754-b7c8-5c99a90fe53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:59.735857 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc1bdf-d0ac-4754-b7c8-5c99a90fe53d admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:59.735857 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc1bdf-d0ac-4754-b7c8-5c99a90fe53d admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:59.735857 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc1bdf-d0ac-4754-b7c8-5c99a90fe53d admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:59.738017 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc1bdf-d0ac-4754-b7c8-5c99a90fe53d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:25:59.738547 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc1bdf-d0ac-4754-b7c8-5c99a90fe53d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:59.741868 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc1bdf-d0ac-4754-b7c8-5c99a90fe53d admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:59.772363 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1235/2464] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:25:59.776607 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31c9e0-61e9-47f4-b936-1cbcfe7cb3d5 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:59.787272 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31c9e0-61e9-47f4-b936-1cbcfe7cb3d5 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:25:59.798656 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82348c2-5150-4c41-bc1f-e0f63efdd76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:25:59.799354 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82348c2-5150-4c41-bc1f-e0f63efdd76a admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:25:59.799644 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82348c2-5150-4c41-bc1f-e0f63efdd76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:25:59.799930 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82348c2-5150-4c41-bc1f-e0f63efdd76a admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:25:59.800657 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82348c2-5150-4c41-bc1f-e0f63efdd76a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:25:59.802827 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82348c2-5150-4c41-bc1f-e0f63efdd76a admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:25:59.939490 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1230/2465] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:25:59 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:25:59.945617 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc1bdf-d0ac-4754-b7c8-5c99a90fe53d admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:25:59.957231 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc1bdf-d0ac-4754-b7c8-5c99a90fe53d admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:26:00.070145 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492aca9d-c8ce-4063-8088-238a1aa02f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:26:00.070969 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492aca9d-c8ce-4063-8088-238a1aa02f80 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:00.071311 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492aca9d-c8ce-4063-8088-238a1aa02f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:00.071908 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492aca9d-c8ce-4063-8088-238a1aa02f80 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:00.072750 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492aca9d-c8ce-4063-8088-238a1aa02f80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:26:00.076104 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492aca9d-c8ce-4063-8088-238a1aa02f80 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:26:00.218685 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1236/2466] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:25:59 2022] POST /identity/v3/users => generated 292 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:26:00.223200 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82348c2-5150-4c41-bc1f-e0f63efdd76a admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:26:00.234686 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82348c2-5150-4c41-bc1f-e0f63efdd76a admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:26:00.239703 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80ef0e-ffad-4590-8c2b-0312d4a90741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:26:00.241635 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80ef0e-ffad-4590-8c2b-0312d4a90741 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:00.242506 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80ef0e-ffad-4590-8c2b-0312d4a90741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:00.242798 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80ef0e-ffad-4590-8c2b-0312d4a90741 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:00.243701 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80ef0e-ffad-4590-8c2b-0312d4a90741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:26:00.245422 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80ef0e-ffad-4590-8c2b-0312d4a90741 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:26:00.258820 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1231/2467] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:26:00.269468 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492aca9d-c8ce-4063-8088-238a1aa02f80 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:26:00.280804 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492aca9d-c8ce-4063-8088-238a1aa02f80 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:26:00.286650 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55def4-1d78-4ea5-9d75-8799cfbc74f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:26:00.287335 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55def4-1d78-4ea5-9d75-8799cfbc74f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:00.287631 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55def4-1d78-4ea5-9d75-8799cfbc74f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:00.287917 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55def4-1d78-4ea5-9d75-8799cfbc74f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:00.288662 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55def4-1d78-4ea5-9d75-8799cfbc74f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:26:00.290405 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55def4-1d78-4ea5-9d75-8799cfbc74f3 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:26:00.305183 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1237/2468] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:26:00.306196 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80ef0e-ffad-4590-8c2b-0312d4a90741 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:26:00.317100 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80ef0e-ffad-4590-8c2b-0312d4a90741 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:26:00.322524 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1732b9f-5229-439a-90b8-46a1a3442487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:26:00.323422 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1732b9f-5229-439a-90b8-46a1a3442487 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:00.323717 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1732b9f-5229-439a-90b8-46a1a3442487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:00.324008 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1732b9f-5229-439a-90b8-46a1a3442487 admin admin] PATH_INFO: `/v3/projects/10e0da9e3b824cd2bfb89fac347f7dc6/users/756b474793a84ca9af8702de02434af9/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:00.338936 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1732b9f-5229-439a-90b8-46a1a3442487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10e0da9e3b824cd2bfb89fac347f7dc6, user_id=756b474793a84ca9af8702de02434af9, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:26:00.342563 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1732b9f-5229-439a-90b8-46a1a3442487 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:26:00.417544 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1232/2469] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:26:00 2022] PUT /identity/v3/projects/10e0da9e3b824cd2bfb89fac347f7dc6/users/756b474793a84ca9af8702de02434af9/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:26:00.423689 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6272232-408c-48f7-b152-876706a8284e None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:00.424034 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6272232-408c-48f7-b152-876706a8284e None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:00.424323 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6272232-408c-48f7-b152-876706a8284e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:00.445007 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-b6272232-408c-48f7-b152-876706a8284e None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:26:00.446264 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b6272232-408c-48f7-b152-876706a8284e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:26:00.507934 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1238/2470] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:26:00.518989 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1732b9f-5229-439a-90b8-46a1a3442487 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:26:00.520714 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-f1732b9f-5229-439a-90b8-46a1a3442487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:26:00.576732 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1732b9f-5229-439a-90b8-46a1a3442487 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:26:00.580297 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c04ac6-ec42-4123-9dbd-dd460d57d84d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:26:00.580940 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c04ac6-ec42-4123-9dbd-dd460d57d84d service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:00.581228 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c04ac6-ec42-4123-9dbd-dd460d57d84d service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:00.581546 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c04ac6-ec42-4123-9dbd-dd460d57d84d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:00.590312 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c04ac6-ec42-4123-9dbd-dd460d57d84d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:26:00.592443 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c04ac6-ec42-4123-9dbd-dd460d57d84d service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:26:00.601669 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1233/2471] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:26:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:26:03.323923 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6272232-408c-48f7-b152-876706a8284e None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:26:03.325964 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b6272232-408c-48f7-b152-876706a8284e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:26:03.338299 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6272232-408c-48f7-b152-876706a8284e None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:26:03.343227 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e30cd5-c7eb-4ae0-b996-af41ec31338b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:26:03.343935 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e30cd5-c7eb-4ae0-b996-af41ec31338b service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:03.344219 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e30cd5-c7eb-4ae0-b996-af41ec31338b service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:03.344495 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e30cd5-c7eb-4ae0-b996-af41ec31338b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:03.346315 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-f4e30cd5-c7eb-4ae0-b996-af41ec31338b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:26:03.357379 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e30cd5-c7eb-4ae0-b996-af41ec31338b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:26:03.358932 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e30cd5-c7eb-4ae0-b996-af41ec31338b service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:26:03.367375 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1239/2472] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:26:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:26:03.650331 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8114690-3988-4604-9ac4-82ab01621ef3 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:03.652940 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8114690-3988-4604-9ac4-82ab01621ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:03.652940 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8114690-3988-4604-9ac4-82ab01621ef3 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:03.654276 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1234/2473] 10.222.0.43 () {54 vars in 921 bytes} [Tue Mar 29 20:26:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:26:03.660956 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd007e8e-ef4c-4c99-ac1b-9a1113be0085 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:03.661520 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd007e8e-ef4c-4c99-ac1b-9a1113be0085 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:03.661966 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd007e8e-ef4c-4c99-ac1b-9a1113be0085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:03.693118 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-bd007e8e-ef4c-4c99-ac1b-9a1113be0085 None None] MFA Rules not processed for user `22bdaa02b1b14be3837b337fbf6e0eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:26:03.693118 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-bd007e8e-ef4c-4c99-ac1b-9a1113be0085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:26:03.705544 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1240/2474] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Mar 29 20:26:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:26:03.726869 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8114690-3988-4604-9ac4-82ab01621ef3 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:26:03.742606 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8114690-3988-4604-9ac4-82ab01621ef3 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:26:03.747928 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fd20b-8f03-48e1-a743-3f4e932c7f4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:26:03.748879 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fd20b-8f03-48e1-a743-3f4e932c7f4d service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:03.749187 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fd20b-8f03-48e1-a743-3f4e932c7f4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:03.749515 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fd20b-8f03-48e1-a743-3f4e932c7f4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:03.758723 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fd20b-8f03-48e1-a743-3f4e932c7f4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:26:03.760411 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fd20b-8f03-48e1-a743-3f4e932c7f4d service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:26:03.773819 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1235/2475] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:26:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:26:03.883434 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5390be5-f637-4d52-8d0d-677d01ceb51b None None] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:03.883778 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5390be5-f637-4d52-8d0d-677d01ceb51b None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:03.884099 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5390be5-f637-4d52-8d0d-677d01ceb51b None None] PATH_INFO: `/` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:03.886136 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1241/2476] 10.222.0.43 () {54 vars in 921 bytes} [Tue Mar 29 20:26:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:26:03.892886 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ab3ae-5bd0-4f78-82b7-1381e9e63910 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:03.893675 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ab3ae-5bd0-4f78-82b7-1381e9e63910 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:03.894189 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ab3ae-5bd0-4f78-82b7-1381e9e63910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:03.919615 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-a30ab3ae-5bd0-4f78-82b7-1381e9e63910 None None] MFA Rules not processed for user `b797e15939694c9abf1f2b8e9aee4d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:26:03.921096 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-a30ab3ae-5bd0-4f78-82b7-1381e9e63910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:26:04.009002 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1236/2477] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Mar 29 20:26:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:26:04.021030 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5390be5-f637-4d52-8d0d-677d01ceb51b None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:26:04.040606 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5390be5-f637-4d52-8d0d-677d01ceb51b None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:26:04.044480 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6317c-6bae-48e2-b0ea-7c0f3feb0e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:26:04.045056 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6317c-6bae-48e2-b0ea-7c0f3feb0e08 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:04.045389 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6317c-6bae-48e2-b0ea-7c0f3feb0e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:04.045671 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6317c-6bae-48e2-b0ea-7c0f3feb0e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:04.062107 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6317c-6bae-48e2-b0ea-7c0f3feb0e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:26:04.063769 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6317c-6bae-48e2-b0ea-7c0f3feb0e08 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:26:04.079056 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1242/2478] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:26:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:26:05.575606 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ab3ae-5bd0-4f78-82b7-1381e9e63910 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:26:05.577874 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-a30ab3ae-5bd0-4f78-82b7-1381e9e63910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:26:05.592769 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ab3ae-5bd0-4f78-82b7-1381e9e63910 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:26:05.599592 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444f33c-091b-4e5b-9d5c-a9dc50e5c9a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:26:05.600252 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444f33c-091b-4e5b-9d5c-a9dc50e5c9a0 service nova] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:05.601058 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444f33c-091b-4e5b-9d5c-a9dc50e5c9a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:05.601409 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444f33c-091b-4e5b-9d5c-a9dc50e5c9a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:05.604064 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-e444f33c-091b-4e5b-9d5c-a9dc50e5c9a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:26:05.719303 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444f33c-091b-4e5b-9d5c-a9dc50e5c9a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:26:05.720955 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444f33c-091b-4e5b-9d5c-a9dc50e5c9a0 service nova] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:26:05.739806 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1237/2479] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:26:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:26:06.608986 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6317c-6bae-48e2-b0ea-7c0f3feb0e08 service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:26:06.622146 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6317c-6bae-48e2-b0ea-7c0f3feb0e08 service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:26:06.629084 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7d61a-da6c-45fb-9116-9f475447fd15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:26:06.632202 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7d61a-da6c-45fb-9116-9f475447fd15 service nova] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:06.632202 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7d61a-da6c-45fb-9116-9f475447fd15 service nova] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:06.632202 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7d61a-da6c-45fb-9116-9f475447fd15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:06.633112 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a3a7d61a-da6c-45fb-9116-9f475447fd15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:26:06.650649 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7d61a-da6c-45fb-9116-9f475447fd15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:26:06.652729 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7d61a-da6c-45fb-9116-9f475447fd15 service nova] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:26:06.683560 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1243/2480] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:26:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:26:06.893576 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9f1dc-e458-44c1-9b4a-680f8a8e3806 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:06.894107 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9f1dc-e458-44c1-9b4a-680f8a8e3806 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:06.894205 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9f1dc-e458-44c1-9b4a-680f8a8e3806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:06.921825 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-8ba9f1dc-e458-44c1-9b4a-680f8a8e3806 None None] MFA Rules not processed for user `756b474793a84ca9af8702de02434af9`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:26:06.923038 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-8ba9f1dc-e458-44c1-9b4a-680f8a8e3806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:26:06.989915 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1238/2481] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:26:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:26:07.002258 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7d61a-da6c-45fb-9116-9f475447fd15 service nova] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:26:07.003684 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a3a7d61a-da6c-45fb-9116-9f475447fd15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:26:07.018587 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7d61a-da6c-45fb-9116-9f475447fd15 service nova] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:26:07.024059 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c09be1-67af-4f51-980f-77df39e0dde4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:26:07.024697 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c09be1-67af-4f51-980f-77df39e0dde4 service nova] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:07.024980 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c09be1-67af-4f51-980f-77df39e0dde4 service nova] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:07.025258 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c09be1-67af-4f51-980f-77df39e0dde4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:07.034404 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c09be1-67af-4f51-980f-77df39e0dde4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:26:07.036073 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c09be1-67af-4f51-980f-77df39e0dde4 service nova] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:26:07.046810 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1244/2482] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:26:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:26:09.964356 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea8095-e22b-4dfa-ad18-0e4fadd3bf4b None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:09.964931 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea8095-e22b-4dfa-ad18-0e4fadd3bf4b None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:09.964931 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea8095-e22b-4dfa-ad18-0e4fadd3bf4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:09.993890 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-edea8095-e22b-4dfa-ad18-0e4fadd3bf4b None None] MFA Rules not processed for user `756b474793a84ca9af8702de02434af9`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:26:09.995224 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-edea8095-e22b-4dfa-ad18-0e4fadd3bf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:26:10.003415 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1239/2483] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:26:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:26:10.476304 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c09be1-67af-4f51-980f-77df39e0dde4 service nova] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:26:10.493484 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c09be1-67af-4f51-980f-77df39e0dde4 service nova] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:26:10.499472 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5306047-2fbf-4c79-abdf-f456cf6b9dca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:26:10.500245 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5306047-2fbf-4c79-abdf-f456cf6b9dca service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:10.500778 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5306047-2fbf-4c79-abdf-f456cf6b9dca service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:10.501147 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5306047-2fbf-4c79-abdf-f456cf6b9dca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:10.503130 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e5306047-2fbf-4c79-abdf-f456cf6b9dca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:26:10.518063 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5306047-2fbf-4c79-abdf-f456cf6b9dca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:26:10.520103 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5306047-2fbf-4c79-abdf-f456cf6b9dca service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:26:10.531313 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1245/2484] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:26:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:26:14.965170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea8095-e22b-4dfa-ad18-0e4fadd3bf4b None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:26:14.980015 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea8095-e22b-4dfa-ad18-0e4fadd3bf4b None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:26:14.986712 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e333bf-9766-486a-afd6-0d337fad34de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:26:14.988172 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e333bf-9766-486a-afd6-0d337fad34de service nova] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:14.988575 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e333bf-9766-486a-afd6-0d337fad34de service nova] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:14.989214 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e333bf-9766-486a-afd6-0d337fad34de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:14.991338 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-f6e333bf-9766-486a-afd6-0d337fad34de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:26:15.016260 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e333bf-9766-486a-afd6-0d337fad34de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:26:15.018074 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e333bf-9766-486a-afd6-0d337fad34de service nova] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:26:15.035799 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1240/2485] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:26:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:26:26.861732 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5306047-2fbf-4c79-abdf-f456cf6b9dca service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:26:26.875523 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5306047-2fbf-4c79-abdf-f456cf6b9dca service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:26:26.882431 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea19c34-c229-482d-b2eb-7e77ee89092c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:26:26.883164 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea19c34-c229-482d-b2eb-7e77ee89092c service nova] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:26.883445 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea19c34-c229-482d-b2eb-7e77ee89092c service nova] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:26.883726 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea19c34-c229-482d-b2eb-7e77ee89092c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:26.885612 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-cea19c34-c229-482d-b2eb-7e77ee89092c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:26:26.983932 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea19c34-c229-482d-b2eb-7e77ee89092c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:26:26.987031 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea19c34-c229-482d-b2eb-7e77ee89092c service nova] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:26:26.998425 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1246/2486] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:26:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:26:27.351683 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcbede-93cc-4824-8b7d-aeef312c199c None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:27.352232 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcbede-93cc-4824-8b7d-aeef312c199c None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:27.352604 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcbede-93cc-4824-8b7d-aeef312c199c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:27.370887 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-16fcbede-93cc-4824-8b7d-aeef312c199c None None] MFA Rules not processed for user `a706b6d0163549bc80285c4158331b94`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:26:27.372659 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-16fcbede-93cc-4824-8b7d-aeef312c199c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:26:27.430241 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1241/2487] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Mar 29 20:26:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:26:27.639041 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea19c34-c229-482d-b2eb-7e77ee89092c service nova] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:26:27.640588 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-cea19c34-c229-482d-b2eb-7e77ee89092c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:26:27.721881 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea19c34-c229-482d-b2eb-7e77ee89092c service nova] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:26:27.727519 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be8bb6-6593-4d63-8734-d774f35bcda4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d6d8e7788494f2c92ad5c183c8fa283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:26:27.728328 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be8bb6-6593-4d63-8734-d774f35bcda4 service swift] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:27.728616 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be8bb6-6593-4d63-8734-d774f35bcda4 service swift] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:27.728978 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be8bb6-6593-4d63-8734-d774f35bcda4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:27.738497 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be8bb6-6593-4d63-8734-d774f35bcda4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:26:27.740134 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be8bb6-6593-4d63-8734-d774f35bcda4 service swift] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:26:27.749853 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1247/2488] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Mar 29 20:26:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 20:26:28.336422 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89197fd5-f835-4e7e-b2fe-df970333b586 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:28.337565 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89197fd5-f835-4e7e-b2fe-df970333b586 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:28.337850 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89197fd5-f835-4e7e-b2fe-df970333b586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:28.359354 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-89197fd5-f835-4e7e-b2fe-df970333b586 None None] MFA Rules not processed for user `a706b6d0163549bc80285c4158331b94`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:26:28.361327 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-89197fd5-f835-4e7e-b2fe-df970333b586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:26:28.369208 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1242/2489] 10.222.0.43 () {58 vars in 967 bytes} [Tue Mar 29 20:26:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:26:28.385233 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be8bb6-6593-4d63-8734-d774f35bcda4 service swift] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:26:28.398248 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be8bb6-6593-4d63-8734-d774f35bcda4 service swift] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:26:28.404541 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b0e9a-f54d-47e5-9f05-48b336095ec7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d6d8e7788494f2c92ad5c183c8fa283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:26:28.404882 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b0e9a-f54d-47e5-9f05-48b336095ec7 service swift] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:28.405171 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b0e9a-f54d-47e5-9f05-48b336095ec7 service swift] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:28.405501 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b0e9a-f54d-47e5-9f05-48b336095ec7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:28.416920 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b0e9a-f54d-47e5-9f05-48b336095ec7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:26:28.420284 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b0e9a-f54d-47e5-9f05-48b336095ec7 service swift] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:26:28.427824 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1248/2490] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Mar 29 20:26:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 29 20:26:42.368820 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89197fd5-f835-4e7e-b2fe-df970333b586 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:26:42.370036 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-89197fd5-f835-4e7e-b2fe-df970333b586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:26:42.387482 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89197fd5-f835-4e7e-b2fe-df970333b586 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:26:42.393677 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8407c-182a-455b-a77f-7f825edec316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:26:42.394560 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8407c-182a-455b-a77f-7f825edec316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:42.394839 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8407c-182a-455b-a77f-7f825edec316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:42.395113 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8407c-182a-455b-a77f-7f825edec316 admin admin] PATH_INFO: `/v3/users/6aaa0c43a8d64df294186dbde0edd025` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:42.396511 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8407c-182a-455b-a77f-7f825edec316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aaa0c43a8d64df294186dbde0edd025)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:26:42.398547 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8407c-182a-455b-a77f-7f825edec316 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:26:42.711612 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a6a8407c-182a-455b-a77f-7f825edec316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aaa0c43a8d64df294186dbde0edd025'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:26:42.798896 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a6a8407c-182a-455b-a77f-7f825edec316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aaa0c43a8d64df294186dbde0edd025'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:26:42.799561 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a6a8407c-182a-455b-a77f-7f825edec316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aaa0c43a8d64df294186dbde0edd025'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:26:42.806955 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a6a8407c-182a-455b-a77f-7f825edec316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aaa0c43a8d64df294186dbde0edd025'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:26:42.819514 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a6a8407c-182a-455b-a77f-7f825edec316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aaa0c43a8d64df294186dbde0edd025'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:26:42.825600 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1243/2491] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:26:42 2022] DELETE /identity/v3/users/6aaa0c43a8d64df294186dbde0edd025 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:26:43.064237 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b0e9a-f54d-47e5-9f05-48b336095ec7 service swift] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:26:43.082433 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b0e9a-f54d-47e5-9f05-48b336095ec7 service swift] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:26:43.141930 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab19cd8-7759-4271-9c42-6e4c67e44c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:26:43.142797 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab19cd8-7759-4271-9c42-6e4c67e44c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:43.145547 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab19cd8-7759-4271-9c42-6e4c67e44c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:43.145547 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab19cd8-7759-4271-9c42-6e4c67e44c45 admin admin] PATH_INFO: `/v3/projects/2f6b0dd8bfcc425ab8ede8ef9179704f` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:43.145547 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab19cd8-7759-4271-9c42-6e4c67e44c45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f6b0dd8bfcc425ab8ede8ef9179704f)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:26:43.146512 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab19cd8-7759-4271-9c42-6e4c67e44c45 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:26:43.303315 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9ab19cd8-7759-4271-9c42-6e4c67e44c45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f6b0dd8bfcc425ab8ede8ef9179704f', 'request_id': 'req-9ab19cd8-7759-4271-9c42-6e4c67e44c45'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:26:43.308938 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9ab19cd8-7759-4271-9c42-6e4c67e44c45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f6b0dd8bfcc425ab8ede8ef9179704f', 'request_id': 'req-9ab19cd8-7759-4271-9c42-6e4c67e44c45'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:26:43.315252 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9ab19cd8-7759-4271-9c42-6e4c67e44c45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f6b0dd8bfcc425ab8ede8ef9179704f', 'request_id': 'req-9ab19cd8-7759-4271-9c42-6e4c67e44c45'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:26:43.524169 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9ab19cd8-7759-4271-9c42-6e4c67e44c45 admin admin] The token cache is being invalidate because project 2f6b0dd8bfcc425ab8ede8ef9179704f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:26:43.524455 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9ab19cd8-7759-4271-9c42-6e4c67e44c45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:26:43.525232 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9ab19cd8-7759-4271-9c42-6e4c67e44c45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:26:43.526807 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1249/2492] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:26:43 2022] DELETE /identity/v3/projects/2f6b0dd8bfcc425ab8ede8ef9179704f => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:26:43.531175 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8407c-182a-455b-a77f-7f825edec316 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:26:43.533636 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-a6a8407c-182a-455b-a77f-7f825edec316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:26:43.547339 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8407c-182a-455b-a77f-7f825edec316 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:26:43.606516 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc62533-a485-41b3-b2de-a84ded25c5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:26:43.607401 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc62533-a485-41b3-b2de-a84ded25c5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:43.607676 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc62533-a485-41b3-b2de-a84ded25c5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:43.607954 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc62533-a485-41b3-b2de-a84ded25c5ba admin admin] PATH_INFO: `/v3/users/fd598446c55c48e385ef1c92f438388b` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:43.609212 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc62533-a485-41b3-b2de-a84ded25c5ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd598446c55c48e385ef1c92f438388b)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:26:43.611164 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc62533-a485-41b3-b2de-a84ded25c5ba admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:26:43.915644 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-5fc62533-a485-41b3-b2de-a84ded25c5ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd598446c55c48e385ef1c92f438388b'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:26:44.039195 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-5fc62533-a485-41b3-b2de-a84ded25c5ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd598446c55c48e385ef1c92f438388b'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:26:44.039829 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-5fc62533-a485-41b3-b2de-a84ded25c5ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd598446c55c48e385ef1c92f438388b'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:26:44.047776 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-5fc62533-a485-41b3-b2de-a84ded25c5ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd598446c55c48e385ef1c92f438388b'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:26:44.059895 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-5fc62533-a485-41b3-b2de-a84ded25c5ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd598446c55c48e385ef1c92f438388b'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:26:44.067890 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1244/2493] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:26:43 2022] DELETE /identity/v3/users/fd598446c55c48e385ef1c92f438388b => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:26:44.337684 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab19cd8-7759-4271-9c42-6e4c67e44c45 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:26:44.339253 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-9ab19cd8-7759-4271-9c42-6e4c67e44c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:26:44.356959 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab19cd8-7759-4271-9c42-6e4c67e44c45 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:26:44.417416 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadc42f-5234-479a-9d8b-c69443cd898d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:26:44.418402 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadc42f-5234-479a-9d8b-c69443cd898d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:44.418689 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadc42f-5234-479a-9d8b-c69443cd898d admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:44.418963 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadc42f-5234-479a-9d8b-c69443cd898d admin admin] PATH_INFO: `/v3/projects/a7eb3a2cad5c4b7ca6a3c8ed9a9297f5` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:44.420163 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cadc42f-5234-479a-9d8b-c69443cd898d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7eb3a2cad5c4b7ca6a3c8ed9a9297f5)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:26:44.422864 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cadc42f-5234-479a-9d8b-c69443cd898d admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:26:44.548694 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9cadc42f-5234-479a-9d8b-c69443cd898d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7eb3a2cad5c4b7ca6a3c8ed9a9297f5', 'request_id': 'req-9cadc42f-5234-479a-9d8b-c69443cd898d'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:26:44.554220 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9cadc42f-5234-479a-9d8b-c69443cd898d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7eb3a2cad5c4b7ca6a3c8ed9a9297f5', 'request_id': 'req-9cadc42f-5234-479a-9d8b-c69443cd898d'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:26:44.560324 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9cadc42f-5234-479a-9d8b-c69443cd898d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7eb3a2cad5c4b7ca6a3c8ed9a9297f5', 'request_id': 'req-9cadc42f-5234-479a-9d8b-c69443cd898d'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:26:44.679671 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9cadc42f-5234-479a-9d8b-c69443cd898d admin admin] The token cache is being invalidate because project a7eb3a2cad5c4b7ca6a3c8ed9a9297f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:26:44.679959 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9cadc42f-5234-479a-9d8b-c69443cd898d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:26:44.680573 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9cadc42f-5234-479a-9d8b-c69443cd898d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:26:44.682385 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1250/2494] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:26:44 2022] DELETE /identity/v3/projects/a7eb3a2cad5c4b7ca6a3c8ed9a9297f5 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:26:48.744231 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d1635-aab5-4f45-9f56-e576991ba907 None None] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:48.744757 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d1635-aab5-4f45-9f56-e576991ba907 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:48.744757 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d1635-aab5-4f45-9f56-e576991ba907 None None] PATH_INFO: `/` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:48.746732 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1245/2495] 10.222.0.43 () {54 vars in 921 bytes} [Tue Mar 29 20:26:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 20:26:48.753670 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b56e5-bd68-4772-9d23-5baadf96559b None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:48.754262 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b56e5-bd68-4772-9d23-5baadf96559b None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:48.754262 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b56e5-bd68-4772-9d23-5baadf96559b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:48.773577 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-2b3b56e5-bd68-4772-9d23-5baadf96559b None None] MFA Rules not processed for user `b797e15939694c9abf1f2b8e9aee4d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:26:48.774802 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-2b3b56e5-bd68-4772-9d23-5baadf96559b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:26:48.850232 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1251/2496] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Mar 29 20:26:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:26:48.864750 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d1635-aab5-4f45-9f56-e576991ba907 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:26:48.866567 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-e88d1635-aab5-4f45-9f56-e576991ba907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:26:48.927941 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d1635-aab5-4f45-9f56-e576991ba907 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:26:48.931544 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ae43d-9e40-4bba-b317-29326f289356 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b169395c92c4fbfbbe4fd14a235f81f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:26:48.932160 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ae43d-9e40-4bba-b317-29326f289356 service glance] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:48.932499 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ae43d-9e40-4bba-b317-29326f289356 service glance] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:48.932735 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ae43d-9e40-4bba-b317-29326f289356 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:48.944331 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ae43d-9e40-4bba-b317-29326f289356 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:26:48.946335 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ae43d-9e40-4bba-b317-29326f289356 service glance] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:26:48.958755 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1246/2497] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:26:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:26:52.253975 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca52ae-33d0-4922-a75f-596a0f341058 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:52.257395 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca52ae-33d0-4922-a75f-596a0f341058 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:52.257395 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca52ae-33d0-4922-a75f-596a0f341058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:52.273819 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-7cca52ae-33d0-4922-a75f-596a0f341058 None None] MFA Rules not processed for user `a706b6d0163549bc80285c4158331b94`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:26:52.274998 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-7cca52ae-33d0-4922-a75f-596a0f341058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:26:52.342928 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1252/2498] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Mar 29 20:26:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:26:52.355198 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ae43d-9e40-4bba-b317-29326f289356 service glance] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:26:52.356622 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-002ae43d-9e40-4bba-b317-29326f289356 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:26:52.430176 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ae43d-9e40-4bba-b317-29326f289356 service glance] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:26:52.435630 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5690f1-3555-4c20-98c0-eef4435bd22f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d6d8e7788494f2c92ad5c183c8fa283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:26:52.436313 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5690f1-3555-4c20-98c0-eef4435bd22f service swift] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:26:52.436599 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5690f1-3555-4c20-98c0-eef4435bd22f service swift] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:26:52.436878 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5690f1-3555-4c20-98c0-eef4435bd22f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:26:52.446866 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5690f1-3555-4c20-98c0-eef4435bd22f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:26:52.448446 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5690f1-3555-4c20-98c0-eef4435bd22f service swift] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:26:52.456705 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1247/2499] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Mar 29 20:26:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 20:27:08.570529 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d0de5-75be-4c84-88e4-12aa0709f283 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:08.571136 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d0de5-75be-4c84-88e4-12aa0709f283 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:08.571136 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d0de5-75be-4c84-88e4-12aa0709f283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:08.590478 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-e48d0de5-75be-4c84-88e4-12aa0709f283 None None] MFA Rules not processed for user `a706b6d0163549bc80285c4158331b94`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:27:08.591680 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e48d0de5-75be-4c84-88e4-12aa0709f283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:08.600121 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1253/2500] 10.222.0.43 () {58 vars in 967 bytes} [Tue Mar 29 20:27:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:27:08.614825 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5690f1-3555-4c20-98c0-eef4435bd22f service swift] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:08.625821 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5690f1-3555-4c20-98c0-eef4435bd22f service swift] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:08.632258 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fec8d-3520-404d-b95b-55449794880d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d6d8e7788494f2c92ad5c183c8fa283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:08.632967 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fec8d-3520-404d-b95b-55449794880d service swift] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:08.633317 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fec8d-3520-404d-b95b-55449794880d service swift] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:08.633671 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fec8d-3520-404d-b95b-55449794880d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:08.643041 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1fec8d-3520-404d-b95b-55449794880d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:08.645916 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1fec8d-3520-404d-b95b-55449794880d service swift] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:08.655388 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1248/2501] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Mar 29 20:27:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 29 20:27:17.793838 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d0de5-75be-4c84-88e4-12aa0709f283 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:17.795545 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e48d0de5-75be-4c84-88e4-12aa0709f283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:17.863115 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d0de5-75be-4c84-88e4-12aa0709f283 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:17.867046 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d8ce7-0ada-41f1-abb2-e84e9411ac3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:17.867737 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d8ce7-0ada-41f1-abb2-e84e9411ac3d service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:17.868038 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d8ce7-0ada-41f1-abb2-e84e9411ac3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:17.868324 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d8ce7-0ada-41f1-abb2-e84e9411ac3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:17.870218 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-042d8ce7-0ada-41f1-abb2-e84e9411ac3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:17.937535 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d8ce7-0ada-41f1-abb2-e84e9411ac3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:17.939093 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d8ce7-0ada-41f1-abb2-e84e9411ac3d service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:17.952195 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1254/2502] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:27:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:27:22.069503 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fec8d-3520-404d-b95b-55449794880d service swift] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:22.071073 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-ad1fec8d-3520-404d-b95b-55449794880d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:22.088840 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fec8d-3520-404d-b95b-55449794880d service swift] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:22.094014 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e1100-f6bd-47fa-82f1-ace7be5785d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:22.094940 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e1100-f6bd-47fa-82f1-ace7be5785d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:22.095255 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e1100-f6bd-47fa-82f1-ace7be5785d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:22.095543 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e1100-f6bd-47fa-82f1-ace7be5785d7 admin admin] PATH_INFO: `/v3/users/b608c6b9c7ef48c2abe8ec8ebb61d75c` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:22.096965 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e1100-f6bd-47fa-82f1-ace7be5785d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b608c6b9c7ef48c2abe8ec8ebb61d75c)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:22.098949 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e1100-f6bd-47fa-82f1-ace7be5785d7 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:22.371953 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-178e1100-f6bd-47fa-82f1-ace7be5785d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b608c6b9c7ef48c2abe8ec8ebb61d75c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:22.520363 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-178e1100-f6bd-47fa-82f1-ace7be5785d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b608c6b9c7ef48c2abe8ec8ebb61d75c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:22.525841 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-178e1100-f6bd-47fa-82f1-ace7be5785d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b608c6b9c7ef48c2abe8ec8ebb61d75c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:22.529034 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-178e1100-f6bd-47fa-82f1-ace7be5785d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b608c6b9c7ef48c2abe8ec8ebb61d75c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:22.541470 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-178e1100-f6bd-47fa-82f1-ace7be5785d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b608c6b9c7ef48c2abe8ec8ebb61d75c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:22.547866 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1249/2503] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:27:22 2022] DELETE /identity/v3/users/b608c6b9c7ef48c2abe8ec8ebb61d75c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:27:23.080612 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d8ce7-0ada-41f1-abb2-e84e9411ac3d service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:23.091046 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d8ce7-0ada-41f1-abb2-e84e9411ac3d service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:23.158804 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76dbce-6a9d-4332-b73b-2b5ae3bcbacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:23.160348 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76dbce-6a9d-4332-b73b-2b5ae3bcbacb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:23.160722 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76dbce-6a9d-4332-b73b-2b5ae3bcbacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:23.161065 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76dbce-6a9d-4332-b73b-2b5ae3bcbacb admin admin] PATH_INFO: `/v3/projects/249ba837300b4e59a05f6c432c2d47b7` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:23.162506 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76dbce-6a9d-4332-b73b-2b5ae3bcbacb admin admin] RBAC: Authorizing `identity:delete_project(project_id=249ba837300b4e59a05f6c432c2d47b7)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:23.164783 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76dbce-6a9d-4332-b73b-2b5ae3bcbacb admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:23.331817 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3b76dbce-6a9d-4332-b73b-2b5ae3bcbacb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '249ba837300b4e59a05f6c432c2d47b7', 'request_id': 'req-3b76dbce-6a9d-4332-b73b-2b5ae3bcbacb'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:23.337906 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3b76dbce-6a9d-4332-b73b-2b5ae3bcbacb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '249ba837300b4e59a05f6c432c2d47b7', 'request_id': 'req-3b76dbce-6a9d-4332-b73b-2b5ae3bcbacb'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:23.343108 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff40aef-0632-4901-8fae-4506124749bb None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:23.343676 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff40aef-0632-4901-8fae-4506124749bb None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:23.343898 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff40aef-0632-4901-8fae-4506124749bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:23.345184 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3b76dbce-6a9d-4332-b73b-2b5ae3bcbacb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '249ba837300b4e59a05f6c432c2d47b7', 'request_id': 'req-3b76dbce-6a9d-4332-b73b-2b5ae3bcbacb'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:23.367110 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-eff40aef-0632-4901-8fae-4506124749bb None None] MFA Rules not processed for user `756b474793a84ca9af8702de02434af9`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:27:23.368821 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-eff40aef-0632-4901-8fae-4506124749bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:23.431432 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1250/2504] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:27:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:27:23.432703 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3b76dbce-6a9d-4332-b73b-2b5ae3bcbacb admin admin] The token cache is being invalidate because project 249ba837300b4e59a05f6c432c2d47b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:27:23.433008 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3b76dbce-6a9d-4332-b73b-2b5ae3bcbacb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:23.433652 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3b76dbce-6a9d-4332-b73b-2b5ae3bcbacb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:23.435183 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1255/2505] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:27:23 2022] DELETE /identity/v3/projects/249ba837300b4e59a05f6c432c2d47b7 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:27:23.447580 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24260cf-a3b3-43dc-a5b1-37b55aa32d45 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:23.447580 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24260cf-a3b3-43dc-a5b1-37b55aa32d45 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:23.447998 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24260cf-a3b3-43dc-a5b1-37b55aa32d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:23.470768 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-b24260cf-a3b3-43dc-a5b1-37b55aa32d45 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:27:23.473422 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-b24260cf-a3b3-43dc-a5b1-37b55aa32d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:23.545829 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1251/2506] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:27:23.553886 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e91e2c-1458-4f77-b0e8-abcf86b17ea6 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:23.554184 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e91e2c-1458-4f77-b0e8-abcf86b17ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:23.554470 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e91e2c-1458-4f77-b0e8-abcf86b17ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:23.575454 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-45e91e2c-1458-4f77-b0e8-abcf86b17ea6 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:27:23.576679 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-45e91e2c-1458-4f77-b0e8-abcf86b17ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:23.585925 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1256/2507] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:27:23.590187 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24260cf-a3b3-43dc-a5b1-37b55aa32d45 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:23.600896 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24260cf-a3b3-43dc-a5b1-37b55aa32d45 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:23.605907 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145b285-bf99-4c22-92fe-8dbbbf9d4f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:23.606570 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145b285-bf99-4c22-92fe-8dbbbf9d4f05 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:23.606865 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145b285-bf99-4c22-92fe-8dbbbf9d4f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:23.607150 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145b285-bf99-4c22-92fe-8dbbbf9d4f05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:23.607884 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145b285-bf99-4c22-92fe-8dbbbf9d4f05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:27:23.608200 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145b285-bf99-4c22-92fe-8dbbbf9d4f05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:23.609869 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145b285-bf99-4c22-92fe-8dbbbf9d4f05 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:23.622972 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1252/2508] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:27:23.629112 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e91e2c-1458-4f77-b0e8-abcf86b17ea6 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:23.641350 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e91e2c-1458-4f77-b0e8-abcf86b17ea6 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:23.649513 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8ff3e-4235-4663-bba4-8bf530140947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:23.650203 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8ff3e-4235-4663-bba4-8bf530140947 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:23.650543 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8ff3e-4235-4663-bba4-8bf530140947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:23.650911 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8ff3e-4235-4663-bba4-8bf530140947 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:23.651622 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8ff3e-4235-4663-bba4-8bf530140947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:23.653684 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8ff3e-4235-4663-bba4-8bf530140947 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:23.777199 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1257/2509] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:27:23 2022] POST /identity/v3/projects => generated 401 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:27:23.785189 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145b285-bf99-4c22-92fe-8dbbbf9d4f05 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:23.799205 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145b285-bf99-4c22-92fe-8dbbbf9d4f05 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:23.873531 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6322dd9-0b2d-40c6-bb24-07fe43b8e268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:23.874150 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6322dd9-0b2d-40c6-bb24-07fe43b8e268 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:23.874449 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6322dd9-0b2d-40c6-bb24-07fe43b8e268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:23.874748 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6322dd9-0b2d-40c6-bb24-07fe43b8e268 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:23.875510 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6322dd9-0b2d-40c6-bb24-07fe43b8e268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:23.877617 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6322dd9-0b2d-40c6-bb24-07fe43b8e268 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:23.982457 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1253/2510] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:27:23 2022] POST /identity/v3/users => generated 301 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:27:23.983736 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8ff3e-4235-4663-bba4-8bf530140947 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:23.995810 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8ff3e-4235-4663-bba4-8bf530140947 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:24.002194 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073ca09-6e25-480a-adf6-aac9e6afa230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:24.002963 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073ca09-6e25-480a-adf6-aac9e6afa230 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:24.003981 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073ca09-6e25-480a-adf6-aac9e6afa230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:24.004269 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073ca09-6e25-480a-adf6-aac9e6afa230 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:24.005034 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073ca09-6e25-480a-adf6-aac9e6afa230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:24.006710 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073ca09-6e25-480a-adf6-aac9e6afa230 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:24.020791 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1258/2511] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:27:24.028105 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6322dd9-0b2d-40c6-bb24-07fe43b8e268 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:24.040000 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6322dd9-0b2d-40c6-bb24-07fe43b8e268 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:24.045113 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037e23f-dedd-46ba-8aa7-0d61bd06c8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:24.045816 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037e23f-dedd-46ba-8aa7-0d61bd06c8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:24.046452 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037e23f-dedd-46ba-8aa7-0d61bd06c8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:24.046452 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037e23f-dedd-46ba-8aa7-0d61bd06c8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:24.047110 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037e23f-dedd-46ba-8aa7-0d61bd06c8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:24.048810 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037e23f-dedd-46ba-8aa7-0d61bd06c8a5 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:24.060193 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1254/2512] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:27:24.064988 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073ca09-6e25-480a-adf6-aac9e6afa230 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:24.082313 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073ca09-6e25-480a-adf6-aac9e6afa230 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:24.090104 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8071194-482f-4992-86a3-428d9c69f323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:24.091539 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8071194-482f-4992-86a3-428d9c69f323 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:24.092111 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8071194-482f-4992-86a3-428d9c69f323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:24.092494 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8071194-482f-4992-86a3-428d9c69f323 admin admin] PATH_INFO: `/v3/projects/72bd6b71df264c558e723c818829de2d/users/f0663e4422f24e719c17a3a6db427444/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:24.111015 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8071194-482f-4992-86a3-428d9c69f323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72bd6b71df264c558e723c818829de2d, user_id=f0663e4422f24e719c17a3a6db427444, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:24.113791 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8071194-482f-4992-86a3-428d9c69f323 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:24.177215 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1259/2513] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:27:24 2022] PUT /identity/v3/projects/72bd6b71df264c558e723c818829de2d/users/f0663e4422f24e719c17a3a6db427444/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:27:24.182831 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aadf0f-57d1-4f2b-828a-58f0a2526cca None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:24.183122 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aadf0f-57d1-4f2b-828a-58f0a2526cca None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:24.183411 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aadf0f-57d1-4f2b-828a-58f0a2526cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:24.202019 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-67aadf0f-57d1-4f2b-828a-58f0a2526cca None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:27:24.203217 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-67aadf0f-57d1-4f2b-828a-58f0a2526cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:24.285980 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1255/2514] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:27:24.299084 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8071194-482f-4992-86a3-428d9c69f323 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:24.301754 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a8071194-482f-4992-86a3-428d9c69f323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:24.382309 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8071194-482f-4992-86a3-428d9c69f323 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:24.386334 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa166b-c218-42c6-b424-1399fc85453c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:24.386992 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa166b-c218-42c6-b424-1399fc85453c service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:24.387280 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa166b-c218-42c6-b424-1399fc85453c service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:24.387603 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa166b-c218-42c6-b424-1399fc85453c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:24.399375 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa166b-c218-42c6-b424-1399fc85453c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:24.400974 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa166b-c218-42c6-b424-1399fc85453c service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:24.421781 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1260/2515] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:27:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:27:25.772554 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bfea6-8e26-437b-b233-051e91bf009b None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:25.777454 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bfea6-8e26-437b-b233-051e91bf009b None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:25.777454 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bfea6-8e26-437b-b233-051e91bf009b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:25.811307 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-bc1bfea6-8e26-437b-b233-051e91bf009b None None] MFA Rules not processed for user `f0663e4422f24e719c17a3a6db427444`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:27:25.812550 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-bc1bfea6-8e26-437b-b233-051e91bf009b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:25.901203 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1256/2516] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:27:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:27:25.906273 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa166b-c218-42c6-b424-1399fc85453c service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:25.916884 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa166b-c218-42c6-b424-1399fc85453c service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:25.922044 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e572e76-e9bd-4a2c-adbe-61b9cd368782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:25.922836 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e572e76-e9bd-4a2c-adbe-61b9cd368782 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:25.923143 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e572e76-e9bd-4a2c-adbe-61b9cd368782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:25.923425 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e572e76-e9bd-4a2c-adbe-61b9cd368782 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:25.924143 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e572e76-e9bd-4a2c-adbe-61b9cd368782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:25.927279 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e572e76-e9bd-4a2c-adbe-61b9cd368782 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:26.016248 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1261/2517] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:27:25 2022] POST /identity/v3/projects => generated 403 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:27:26.021461 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bfea6-8e26-437b-b233-051e91bf009b None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:26.033458 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bfea6-8e26-437b-b233-051e91bf009b None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:26.101837 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273a8fc-6890-4e0a-b8cd-40731f0e7c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:26.102645 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273a8fc-6890-4e0a-b8cd-40731f0e7c2e admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:26.103005 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273a8fc-6890-4e0a-b8cd-40731f0e7c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:26.103341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273a8fc-6890-4e0a-b8cd-40731f0e7c2e admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:26.104218 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e273a8fc-6890-4e0a-b8cd-40731f0e7c2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:26.106688 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e273a8fc-6890-4e0a-b8cd-40731f0e7c2e admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:26.217170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1257/2518] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:27:26 2022] POST /identity/v3/users => generated 308 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:27:26.222109 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e572e76-e9bd-4a2c-adbe-61b9cd368782 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:26.235809 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e572e76-e9bd-4a2c-adbe-61b9cd368782 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:26.242274 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab2b9f-34ac-41a0-89cf-58c4ab95766c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:26.242964 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab2b9f-34ac-41a0-89cf-58c4ab95766c admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:26.243267 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab2b9f-34ac-41a0-89cf-58c4ab95766c admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:26.243520 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab2b9f-34ac-41a0-89cf-58c4ab95766c admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:26.244249 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab2b9f-34ac-41a0-89cf-58c4ab95766c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:26.245909 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab2b9f-34ac-41a0-89cf-58c4ab95766c admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:26.257798 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1262/2519] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:27:26.263331 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273a8fc-6890-4e0a-b8cd-40731f0e7c2e admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:26.275881 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273a8fc-6890-4e0a-b8cd-40731f0e7c2e admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:26.280601 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d03a42-392a-4a10-9149-59056dc59fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:26.281689 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d03a42-392a-4a10-9149-59056dc59fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:26.281978 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d03a42-392a-4a10-9149-59056dc59fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:26.282258 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d03a42-392a-4a10-9149-59056dc59fcf admin admin] PATH_INFO: `/v3/projects/de5ab1d56e8140708dd6e983c90502d8/users/5af2ad8ad0ab4c478e31664558f8bae4/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:26.299207 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d03a42-392a-4a10-9149-59056dc59fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5ab1d56e8140708dd6e983c90502d8, user_id=5af2ad8ad0ab4c478e31664558f8bae4, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:26.302661 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d03a42-392a-4a10-9149-59056dc59fcf admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:26.400918 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1258/2520] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:27:26 2022] PUT /identity/v3/projects/de5ab1d56e8140708dd6e983c90502d8/users/5af2ad8ad0ab4c478e31664558f8bae4/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:27:26.405936 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab2b9f-34ac-41a0-89cf-58c4ab95766c admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:26.420435 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab2b9f-34ac-41a0-89cf-58c4ab95766c admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:26.505756 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a31a1-440f-48ed-bb8a-f93c61cee06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:26.506612 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a31a1-440f-48ed-bb8a-f93c61cee06a admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:26.506994 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a31a1-440f-48ed-bb8a-f93c61cee06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:26.507373 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a31a1-440f-48ed-bb8a-f93c61cee06a admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:26.510951 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a31a1-440f-48ed-bb8a-f93c61cee06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:26.511258 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a31a1-440f-48ed-bb8a-f93c61cee06a admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:26.523083 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1263/2521] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:27:26.531928 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d03a42-392a-4a10-9149-59056dc59fcf admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:26.546197 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d03a42-392a-4a10-9149-59056dc59fcf admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:26.558988 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9302898-044f-49c4-90cf-61a1bcc7748c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:26.560533 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9302898-044f-49c4-90cf-61a1bcc7748c admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:26.561235 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9302898-044f-49c4-90cf-61a1bcc7748c admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:26.561838 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9302898-044f-49c4-90cf-61a1bcc7748c admin admin] PATH_INFO: `/v3/projects/de5ab1d56e8140708dd6e983c90502d8/users/5af2ad8ad0ab4c478e31664558f8bae4/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:26.565207 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9302898-044f-49c4-90cf-61a1bcc7748c admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5ab1d56e8140708dd6e983c90502d8, user_id=5af2ad8ad0ab4c478e31664558f8bae4, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:26.569666 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9302898-044f-49c4-90cf-61a1bcc7748c admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:26.605611 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1259/2522] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:27:26 2022] PUT /identity/v3/projects/de5ab1d56e8140708dd6e983c90502d8/users/5af2ad8ad0ab4c478e31664558f8bae4/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:27:28.102145 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d799f-63fa-426b-b902-20ccd2c25e40 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:28.102727 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d799f-63fa-426b-b902-20ccd2c25e40 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:28.103118 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d799f-63fa-426b-b902-20ccd2c25e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:28.141648 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-5f5d799f-63fa-426b-b902-20ccd2c25e40 None None] MFA Rules not processed for user `5af2ad8ad0ab4c478e31664558f8bae4`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:27:28.144323 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-5f5d799f-63fa-426b-b902-20ccd2c25e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:28.256551 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1264/2523] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:27:28 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:27:30.130221 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9302898-044f-49c4-90cf-61a1bcc7748c admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:30.199566 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9302898-044f-49c4-90cf-61a1bcc7748c admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:30.204500 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa4cf1-fa9f-4cf3-b3e9-4d913c0e045d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:30.205459 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa4cf1-fa9f-4cf3-b3e9-4d913c0e045d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:30.205749 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa4cf1-fa9f-4cf3-b3e9-4d913c0e045d admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:30.206027 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa4cf1-fa9f-4cf3-b3e9-4d913c0e045d admin admin] PATH_INFO: `/v3/users/f0663e4422f24e719c17a3a6db427444` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:30.207613 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa4cf1-fa9f-4cf3-b3e9-4d913c0e045d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0663e4422f24e719c17a3a6db427444)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:30.209771 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa4cf1-fa9f-4cf3-b3e9-4d913c0e045d admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:30.365456 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-24fa4cf1-fa9f-4cf3-b3e9-4d913c0e045d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0663e4422f24e719c17a3a6db427444'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:30.479338 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-24fa4cf1-fa9f-4cf3-b3e9-4d913c0e045d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0663e4422f24e719c17a3a6db427444'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:30.480100 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-24fa4cf1-fa9f-4cf3-b3e9-4d913c0e045d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0663e4422f24e719c17a3a6db427444'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:30.489608 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-24fa4cf1-fa9f-4cf3-b3e9-4d913c0e045d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0663e4422f24e719c17a3a6db427444'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:30.503395 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-24fa4cf1-fa9f-4cf3-b3e9-4d913c0e045d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0663e4422f24e719c17a3a6db427444'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:30.511535 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1260/2524] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:27:30 2022] DELETE /identity/v3/users/f0663e4422f24e719c17a3a6db427444 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:27:30.835399 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d799f-63fa-426b-b902-20ccd2c25e40 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:30.849577 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d799f-63fa-426b-b902-20ccd2c25e40 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:30.912849 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d206d1-4b5f-4c21-8644-d0f18f62af94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:30.914020 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d206d1-4b5f-4c21-8644-d0f18f62af94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:30.914470 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d206d1-4b5f-4c21-8644-d0f18f62af94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:30.914892 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d206d1-4b5f-4c21-8644-d0f18f62af94 admin admin] PATH_INFO: `/v3/projects/72bd6b71df264c558e723c818829de2d` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:30.916307 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d206d1-4b5f-4c21-8644-d0f18f62af94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72bd6b71df264c558e723c818829de2d)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:30.918373 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d206d1-4b5f-4c21-8644-d0f18f62af94 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:31.068854 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-35d206d1-4b5f-4c21-8644-d0f18f62af94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72bd6b71df264c558e723c818829de2d', 'request_id': 'req-35d206d1-4b5f-4c21-8644-d0f18f62af94'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:31.074509 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-35d206d1-4b5f-4c21-8644-d0f18f62af94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72bd6b71df264c558e723c818829de2d', 'request_id': 'req-35d206d1-4b5f-4c21-8644-d0f18f62af94'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:31.082101 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-35d206d1-4b5f-4c21-8644-d0f18f62af94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72bd6b71df264c558e723c818829de2d', 'request_id': 'req-35d206d1-4b5f-4c21-8644-d0f18f62af94'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:31.221504 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-35d206d1-4b5f-4c21-8644-d0f18f62af94 admin admin] The token cache is being invalidate because project 72bd6b71df264c558e723c818829de2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:27:31.221926 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-35d206d1-4b5f-4c21-8644-d0f18f62af94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:31.222707 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-35d206d1-4b5f-4c21-8644-d0f18f62af94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:31.227792 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1265/2525] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:27:30 2022] DELETE /identity/v3/projects/72bd6b71df264c558e723c818829de2d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:27:31.229170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa4cf1-fa9f-4cf3-b3e9-4d913c0e045d admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:31.230643 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-24fa4cf1-fa9f-4cf3-b3e9-4d913c0e045d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:31.249382 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa4cf1-fa9f-4cf3-b3e9-4d913c0e045d admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:31.315905 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e7bda-5f56-4020-a938-32621f7ff80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:31.317866 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e7bda-5f56-4020-a938-32621f7ff80d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:31.318150 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e7bda-5f56-4020-a938-32621f7ff80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:31.318426 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e7bda-5f56-4020-a938-32621f7ff80d admin admin] PATH_INFO: `/v3/users/5af2ad8ad0ab4c478e31664558f8bae4` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:31.319707 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e7bda-5f56-4020-a938-32621f7ff80d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5af2ad8ad0ab4c478e31664558f8bae4)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:31.321658 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e7bda-5f56-4020-a938-32621f7ff80d admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:31.572559 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8f3e7bda-5f56-4020-a938-32621f7ff80d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5af2ad8ad0ab4c478e31664558f8bae4'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:31.644561 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8f3e7bda-5f56-4020-a938-32621f7ff80d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5af2ad8ad0ab4c478e31664558f8bae4'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:31.645317 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8f3e7bda-5f56-4020-a938-32621f7ff80d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5af2ad8ad0ab4c478e31664558f8bae4'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:31.654187 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8f3e7bda-5f56-4020-a938-32621f7ff80d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5af2ad8ad0ab4c478e31664558f8bae4'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:31.668945 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-8f3e7bda-5f56-4020-a938-32621f7ff80d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5af2ad8ad0ab4c478e31664558f8bae4'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:31.678336 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1261/2526] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:27:31 2022] DELETE /identity/v3/users/5af2ad8ad0ab4c478e31664558f8bae4 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:27:32.029361 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d206d1-4b5f-4c21-8644-d0f18f62af94 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:32.031873 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-35d206d1-4b5f-4c21-8644-d0f18f62af94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:32.047199 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d206d1-4b5f-4c21-8644-d0f18f62af94 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:32.109996 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc0bda-8776-4388-8a49-5e34f9624ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:32.110877 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc0bda-8776-4388-8a49-5e34f9624ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:32.111186 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc0bda-8776-4388-8a49-5e34f9624ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:32.111468 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc0bda-8776-4388-8a49-5e34f9624ac4 admin admin] PATH_INFO: `/v3/projects/de5ab1d56e8140708dd6e983c90502d8` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:32.112685 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc0bda-8776-4388-8a49-5e34f9624ac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de5ab1d56e8140708dd6e983c90502d8)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:32.114636 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc0bda-8776-4388-8a49-5e34f9624ac4 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:32.334058 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c1cc0bda-8776-4388-8a49-5e34f9624ac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de5ab1d56e8140708dd6e983c90502d8', 'request_id': 'req-c1cc0bda-8776-4388-8a49-5e34f9624ac4'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:32.339676 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c1cc0bda-8776-4388-8a49-5e34f9624ac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de5ab1d56e8140708dd6e983c90502d8', 'request_id': 'req-c1cc0bda-8776-4388-8a49-5e34f9624ac4'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:32.346161 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c1cc0bda-8776-4388-8a49-5e34f9624ac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de5ab1d56e8140708dd6e983c90502d8', 'request_id': 'req-c1cc0bda-8776-4388-8a49-5e34f9624ac4'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:32.465015 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c1cc0bda-8776-4388-8a49-5e34f9624ac4 admin admin] The token cache is being invalidate because project de5ab1d56e8140708dd6e983c90502d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:27:32.465341 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c1cc0bda-8776-4388-8a49-5e34f9624ac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:32.466030 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c1cc0bda-8776-4388-8a49-5e34f9624ac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:32.467580 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1266/2527] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:27:32 2022] DELETE /identity/v3/projects/de5ab1d56e8140708dd6e983c90502d8 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:27:32.475449 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbc811-97ff-4e09-9245-d89ef0f64a04 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:32.475982 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbc811-97ff-4e09-9245-d89ef0f64a04 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:32.475982 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbc811-97ff-4e09-9245-d89ef0f64a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:32.495575 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-03bbc811-97ff-4e09-9245-d89ef0f64a04 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:27:32.496796 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-03bbc811-97ff-4e09-9245-d89ef0f64a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:32.562049 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1262/2528] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:27:32.571927 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661dcb9-5183-4ffa-a88e-516ae81756a8 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:32.572217 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661dcb9-5183-4ffa-a88e-516ae81756a8 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:32.572504 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661dcb9-5183-4ffa-a88e-516ae81756a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:32.592922 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-6661dcb9-5183-4ffa-a88e-516ae81756a8 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:27:32.594112 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-6661dcb9-5183-4ffa-a88e-516ae81756a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:32.604314 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1267/2529] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:27:32.610444 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbc811-97ff-4e09-9245-d89ef0f64a04 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:32.621548 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbc811-97ff-4e09-9245-d89ef0f64a04 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:32.630328 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bde038-a7ae-49b2-9192-c2cf154f7ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:32.631102 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bde038-a7ae-49b2-9192-c2cf154f7ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:32.631463 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bde038-a7ae-49b2-9192-c2cf154f7ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:32.631817 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bde038-a7ae-49b2-9192-c2cf154f7ea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:32.632720 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bde038-a7ae-49b2-9192-c2cf154f7ea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:27:32.633039 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bde038-a7ae-49b2-9192-c2cf154f7ea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:32.634726 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bde038-a7ae-49b2-9192-c2cf154f7ea3 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:32.654202 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1263/2530] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:27:32.657431 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661dcb9-5183-4ffa-a88e-516ae81756a8 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:32.668550 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661dcb9-5183-4ffa-a88e-516ae81756a8 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:32.673473 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640b565-f275-45b2-b385-2ab1fa322280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:32.674231 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640b565-f275-45b2-b385-2ab1fa322280 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:32.675164 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640b565-f275-45b2-b385-2ab1fa322280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:32.675536 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640b565-f275-45b2-b385-2ab1fa322280 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:32.676317 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640b565-f275-45b2-b385-2ab1fa322280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:32.678305 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640b565-f275-45b2-b385-2ab1fa322280 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:32.783169 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1268/2531] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:27:32 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:27:32.787642 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bde038-a7ae-49b2-9192-c2cf154f7ea3 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:32.797836 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bde038-a7ae-49b2-9192-c2cf154f7ea3 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:32.860666 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9298a-801c-456c-bcfe-e976556cd4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:32.861500 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9298a-801c-456c-bcfe-e976556cd4b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:32.861819 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9298a-801c-456c-bcfe-e976556cd4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:32.863337 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9298a-801c-456c-bcfe-e976556cd4b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:32.864138 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9298a-801c-456c-bcfe-e976556cd4b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:32.866214 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9298a-801c-456c-bcfe-e976556cd4b3 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:33.096286 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1264/2532] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:27:32 2022] POST /identity/v3/users => generated 292 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:27:33.101282 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640b565-f275-45b2-b385-2ab1fa322280 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:33.111777 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640b565-f275-45b2-b385-2ab1fa322280 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:33.118260 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b61ee-cdcb-4e0f-b46e-59fc3cf1d7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:33.118942 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b61ee-cdcb-4e0f-b46e-59fc3cf1d7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:33.119225 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b61ee-cdcb-4e0f-b46e-59fc3cf1d7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:33.119509 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b61ee-cdcb-4e0f-b46e-59fc3cf1d7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:33.120239 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b61ee-cdcb-4e0f-b46e-59fc3cf1d7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:33.121891 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b61ee-cdcb-4e0f-b46e-59fc3cf1d7d5 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:33.133801 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1269/2533] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:27:33.138401 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9298a-801c-456c-bcfe-e976556cd4b3 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:33.149185 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9298a-801c-456c-bcfe-e976556cd4b3 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:33.155154 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c6db1-a38f-4599-8ae1-43082f0eacb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:33.155860 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c6db1-a38f-4599-8ae1-43082f0eacb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:33.156150 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c6db1-a38f-4599-8ae1-43082f0eacb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:33.156430 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c6db1-a38f-4599-8ae1-43082f0eacb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:33.157244 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c6db1-a38f-4599-8ae1-43082f0eacb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:33.158922 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c6db1-a38f-4599-8ae1-43082f0eacb6 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:33.170899 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1265/2534] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:27:33.175938 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b61ee-cdcb-4e0f-b46e-59fc3cf1d7d5 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:33.188431 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b61ee-cdcb-4e0f-b46e-59fc3cf1d7d5 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:33.202892 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc364555-db87-4698-a16c-5dc0ad59ded2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:33.204208 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc364555-db87-4698-a16c-5dc0ad59ded2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:33.204593 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc364555-db87-4698-a16c-5dc0ad59ded2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:33.204970 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc364555-db87-4698-a16c-5dc0ad59ded2 admin admin] PATH_INFO: `/v3/projects/dc70c62b75484fe5827c102090fe2463/users/c2d68ba9f7a54ae081d2b7730bfb974c/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:33.222673 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc364555-db87-4698-a16c-5dc0ad59ded2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc70c62b75484fe5827c102090fe2463, user_id=c2d68ba9f7a54ae081d2b7730bfb974c, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:33.226131 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc364555-db87-4698-a16c-5dc0ad59ded2 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:33.341955 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1270/2535] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:27:33 2022] PUT /identity/v3/projects/dc70c62b75484fe5827c102090fe2463/users/c2d68ba9f7a54ae081d2b7730bfb974c/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:27:33.354454 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b2d4c-5336-4e6c-a672-9789844c80cf None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:33.354657 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b2d4c-5336-4e6c-a672-9789844c80cf None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:33.354928 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b2d4c-5336-4e6c-a672-9789844c80cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:33.383272 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-7d4b2d4c-5336-4e6c-a672-9789844c80cf None None] MFA Rules not processed for user `c2d68ba9f7a54ae081d2b7730bfb974c`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:27:33.384645 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-7d4b2d4c-5336-4e6c-a672-9789844c80cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:33.458857 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1266/2536] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:27:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:27:33.463877 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc364555-db87-4698-a16c-5dc0ad59ded2 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:33.535841 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc364555-db87-4698-a16c-5dc0ad59ded2 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:33.542509 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7bf2f-aa72-495d-aaf0-4d0d0a716452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:33.543496 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7bf2f-aa72-495d-aaf0-4d0d0a716452 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:33.543883 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7bf2f-aa72-495d-aaf0-4d0d0a716452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:33.544331 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7bf2f-aa72-495d-aaf0-4d0d0a716452 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:33.545451 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7bf2f-aa72-495d-aaf0-4d0d0a716452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:33.548091 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7bf2f-aa72-495d-aaf0-4d0d0a716452 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:33.907341 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1271/2537] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:27:33 2022] POST /identity/v3/projects => generated 383 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:27:33.907457 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b2d4c-5336-4e6c-a672-9789844c80cf None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:33.916958 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b2d4c-5336-4e6c-a672-9789844c80cf None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:33.984380 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa192731-863a-40b8-92f8-e164d0a457e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:33.985417 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa192731-863a-40b8-92f8-e164d0a457e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:33.985902 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa192731-863a-40b8-92f8-e164d0a457e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:33.986295 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa192731-863a-40b8-92f8-e164d0a457e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:33.987265 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa192731-863a-40b8-92f8-e164d0a457e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:33.990240 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa192731-863a-40b8-92f8-e164d0a457e0 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:34.106527 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1267/2538] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:27:33 2022] POST /identity/v3/users => generated 298 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:27:34.110545 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7bf2f-aa72-495d-aaf0-4d0d0a716452 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:34.123464 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7bf2f-aa72-495d-aaf0-4d0d0a716452 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:34.130552 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a66b12-297d-4ea5-b52d-c69df47c0983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:34.131443 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a66b12-297d-4ea5-b52d-c69df47c0983 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:34.131727 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a66b12-297d-4ea5-b52d-c69df47c0983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:34.132005 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a66b12-297d-4ea5-b52d-c69df47c0983 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:34.132785 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a66b12-297d-4ea5-b52d-c69df47c0983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:34.134577 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a66b12-297d-4ea5-b52d-c69df47c0983 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:34.148788 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1272/2539] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:27:34.153348 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa192731-863a-40b8-92f8-e164d0a457e0 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:34.165678 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa192731-863a-40b8-92f8-e164d0a457e0 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:34.171336 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f010457-e932-453f-9c56-8707a527975b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:34.172411 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f010457-e932-453f-9c56-8707a527975b admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:34.172704 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f010457-e932-453f-9c56-8707a527975b admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:34.172983 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f010457-e932-453f-9c56-8707a527975b admin admin] PATH_INFO: `/v3/projects/744bf9c30cf3486a9c31fcc0ab02a0e9/users/1fdc26b98798435d8f54d90e840680e7/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:34.192781 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f010457-e932-453f-9c56-8707a527975b admin admin] RBAC: Authorizing `identity:create_grant(project_id=744bf9c30cf3486a9c31fcc0ab02a0e9, user_id=1fdc26b98798435d8f54d90e840680e7, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:34.195486 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f010457-e932-453f-9c56-8707a527975b admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:34.334171 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1268/2540] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:27:34 2022] PUT /identity/v3/projects/744bf9c30cf3486a9c31fcc0ab02a0e9/users/1fdc26b98798435d8f54d90e840680e7/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:27:34.338301 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a66b12-297d-4ea5-b52d-c69df47c0983 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:34.353100 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a66b12-297d-4ea5-b52d-c69df47c0983 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:34.432694 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa8250-2a4f-486f-b351-11f3fd1f7f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:34.433480 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa8250-2a4f-486f-b351-11f3fd1f7f0f admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:34.433792 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa8250-2a4f-486f-b351-11f3fd1f7f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:34.434032 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa8250-2a4f-486f-b351-11f3fd1f7f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:34.434943 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa8250-2a4f-486f-b351-11f3fd1f7f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:34.436611 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa8250-2a4f-486f-b351-11f3fd1f7f0f admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:34.449332 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1273/2541] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:27:34.453375 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f010457-e932-453f-9c56-8707a527975b admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:34.464855 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f010457-e932-453f-9c56-8707a527975b admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:34.469881 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cbc28-8ee3-49ce-bf0a-611c47ee5d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:34.470870 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cbc28-8ee3-49ce-bf0a-611c47ee5d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:34.471234 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cbc28-8ee3-49ce-bf0a-611c47ee5d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:34.471600 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cbc28-8ee3-49ce-bf0a-611c47ee5d38 admin admin] PATH_INFO: `/v3/projects/744bf9c30cf3486a9c31fcc0ab02a0e9/users/1fdc26b98798435d8f54d90e840680e7/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:34.474377 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cbc28-8ee3-49ce-bf0a-611c47ee5d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=744bf9c30cf3486a9c31fcc0ab02a0e9, user_id=1fdc26b98798435d8f54d90e840680e7, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:34.477153 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cbc28-8ee3-49ce-bf0a-611c47ee5d38 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:34.488834 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1269/2542] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:27:34 2022] PUT /identity/v3/projects/744bf9c30cf3486a9c31fcc0ab02a0e9/users/1fdc26b98798435d8f54d90e840680e7/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:27:34.499011 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481ea80-2ef3-42a8-a965-28f7c4fd2ae0 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:34.499309 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481ea80-2ef3-42a8-a965-28f7c4fd2ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:34.499596 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481ea80-2ef3-42a8-a965-28f7c4fd2ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:34.529330 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-b481ea80-2ef3-42a8-a965-28f7c4fd2ae0 None None] MFA Rules not processed for user `1fdc26b98798435d8f54d90e840680e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:27:34.530570 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b481ea80-2ef3-42a8-a965-28f7c4fd2ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:34.607660 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1274/2543] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:27:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:27:34.627275 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cbc28-8ee3-49ce-bf0a-611c47ee5d38 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:34.635562 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-3f4cbc28-8ee3-49ce-bf0a-611c47ee5d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:34.689125 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cbc28-8ee3-49ce-bf0a-611c47ee5d38 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:34.693968 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af580d-8614-4820-aa81-f8c042514a0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:34.694617 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af580d-8614-4820-aa81-f8c042514a0e service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:34.694905 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af580d-8614-4820-aa81-f8c042514a0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:34.695187 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af580d-8614-4820-aa81-f8c042514a0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:34.704911 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af580d-8614-4820-aa81-f8c042514a0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:34.706390 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af580d-8614-4820-aa81-f8c042514a0e service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:34.716892 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1270/2544] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:27:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:27:34.821563 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481ea80-2ef3-42a8-a965-28f7c4fd2ae0 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:34.830898 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481ea80-2ef3-42a8-a965-28f7c4fd2ae0 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:34.835430 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c1379-9cbe-49d6-b1bf-1b53dfa07f58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:34.836060 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c1379-9cbe-49d6-b1bf-1b53dfa07f58 service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:34.836341 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c1379-9cbe-49d6-b1bf-1b53dfa07f58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:34.836621 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c1379-9cbe-49d6-b1bf-1b53dfa07f58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:34.893835 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c1379-9cbe-49d6-b1bf-1b53dfa07f58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:34.895832 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c1379-9cbe-49d6-b1bf-1b53dfa07f58 service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:34.904749 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1275/2545] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:27:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:27:38.151926 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af580d-8614-4820-aa81-f8c042514a0e service cinder] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:38.245259 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af580d-8614-4820-aa81-f8c042514a0e service cinder] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:38.251191 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8d7ba-d367-4450-a47f-f1b8491a89cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:38.252881 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8d7ba-d367-4450-a47f-f1b8491a89cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:38.253751 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8d7ba-d367-4450-a47f-f1b8491a89cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:38.254284 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8d7ba-d367-4450-a47f-f1b8491a89cd admin admin] PATH_INFO: `/v3/users/c2d68ba9f7a54ae081d2b7730bfb974c` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:38.255435 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8d7ba-d367-4450-a47f-f1b8491a89cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2d68ba9f7a54ae081d2b7730bfb974c)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:38.257516 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8d7ba-d367-4450-a47f-f1b8491a89cd admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:38.467710 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-e0d8d7ba-d367-4450-a47f-f1b8491a89cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2d68ba9f7a54ae081d2b7730bfb974c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:38.545920 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-e0d8d7ba-d367-4450-a47f-f1b8491a89cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2d68ba9f7a54ae081d2b7730bfb974c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:38.546952 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-e0d8d7ba-d367-4450-a47f-f1b8491a89cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2d68ba9f7a54ae081d2b7730bfb974c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:38.554570 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-e0d8d7ba-d367-4450-a47f-f1b8491a89cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2d68ba9f7a54ae081d2b7730bfb974c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:38.568890 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-e0d8d7ba-d367-4450-a47f-f1b8491a89cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2d68ba9f7a54ae081d2b7730bfb974c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:38.575184 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1271/2546] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:27:38 2022] DELETE /identity/v3/users/c2d68ba9f7a54ae081d2b7730bfb974c => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:27:38.579690 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9966a1-afdb-4bf4-8ad9-48a82c4fa282 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:38.580196 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9966a1-afdb-4bf4-8ad9-48a82c4fa282 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:38.580334 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9966a1-afdb-4bf4-8ad9-48a82c4fa282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:38.599142 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-0d9966a1-afdb-4bf4-8ad9-48a82c4fa282 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:27:38.600382 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-0d9966a1-afdb-4bf4-8ad9-48a82c4fa282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:38.664493 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1276/2547] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:27:38.674762 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8d7ba-d367-4450-a47f-f1b8491a89cd admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:38.677475 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-e0d8d7ba-d367-4450-a47f-f1b8491a89cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:38.739468 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8d7ba-d367-4450-a47f-f1b8491a89cd admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:38.743319 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924dfce-7d6b-4fb4-8c2a-58cecd398b0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:38.743975 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924dfce-7d6b-4fb4-8c2a-58cecd398b0b service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:38.744256 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924dfce-7d6b-4fb4-8c2a-58cecd398b0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:38.744533 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924dfce-7d6b-4fb4-8c2a-58cecd398b0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:38.755132 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924dfce-7d6b-4fb4-8c2a-58cecd398b0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:38.756583 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924dfce-7d6b-4fb4-8c2a-58cecd398b0b service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:38.769858 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1272/2548] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:27:39.263119 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9966a1-afdb-4bf4-8ad9-48a82c4fa282 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:39.264482 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-0d9966a1-afdb-4bf4-8ad9-48a82c4fa282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:39.277629 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9966a1-afdb-4bf4-8ad9-48a82c4fa282 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:39.282329 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc89726-e2c0-4138-9922-ba615cd481bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:39.283200 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc89726-e2c0-4138-9922-ba615cd481bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:39.283477 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc89726-e2c0-4138-9922-ba615cd481bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:39.283751 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc89726-e2c0-4138-9922-ba615cd481bf admin admin] PATH_INFO: `/v3/projects/dc70c62b75484fe5827c102090fe2463` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:39.286062 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc89726-e2c0-4138-9922-ba615cd481bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc70c62b75484fe5827c102090fe2463)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:39.288309 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc89726-e2c0-4138-9922-ba615cd481bf admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:39.405152 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6dc89726-e2c0-4138-9922-ba615cd481bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc70c62b75484fe5827c102090fe2463', 'request_id': 'req-6dc89726-e2c0-4138-9922-ba615cd481bf'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:39.411347 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6dc89726-e2c0-4138-9922-ba615cd481bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc70c62b75484fe5827c102090fe2463', 'request_id': 'req-6dc89726-e2c0-4138-9922-ba615cd481bf'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:39.418161 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6dc89726-e2c0-4138-9922-ba615cd481bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc70c62b75484fe5827c102090fe2463', 'request_id': 'req-6dc89726-e2c0-4138-9922-ba615cd481bf'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:39.524030 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6dc89726-e2c0-4138-9922-ba615cd481bf admin admin] The token cache is being invalidate because project dc70c62b75484fe5827c102090fe2463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:27:39.524249 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6dc89726-e2c0-4138-9922-ba615cd481bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:39.524842 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-6dc89726-e2c0-4138-9922-ba615cd481bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:39.526399 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1277/2549] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:27:39 2022] DELETE /identity/v3/projects/dc70c62b75484fe5827c102090fe2463 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:27:39.530453 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924dfce-7d6b-4fb4-8c2a-58cecd398b0b service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:39.540331 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924dfce-7d6b-4fb4-8c2a-58cecd398b0b service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:39.595927 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e9e86-75b0-48bf-af8a-3397cdf8ba49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:39.596797 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e9e86-75b0-48bf-af8a-3397cdf8ba49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:39.598254 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e9e86-75b0-48bf-af8a-3397cdf8ba49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:39.598254 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e9e86-75b0-48bf-af8a-3397cdf8ba49 admin admin] PATH_INFO: `/v3/users/1fdc26b98798435d8f54d90e840680e7` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:39.599262 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e9e86-75b0-48bf-af8a-3397cdf8ba49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fdc26b98798435d8f54d90e840680e7)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:39.601224 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e9e86-75b0-48bf-af8a-3397cdf8ba49 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:39.848033 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-ca8e9e86-75b0-48bf-af8a-3397cdf8ba49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fdc26b98798435d8f54d90e840680e7'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:39.981574 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-ca8e9e86-75b0-48bf-af8a-3397cdf8ba49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fdc26b98798435d8f54d90e840680e7'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:39.982213 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-ca8e9e86-75b0-48bf-af8a-3397cdf8ba49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fdc26b98798435d8f54d90e840680e7'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:39.992515 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-ca8e9e86-75b0-48bf-af8a-3397cdf8ba49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fdc26b98798435d8f54d90e840680e7'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:40.005871 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-ca8e9e86-75b0-48bf-af8a-3397cdf8ba49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fdc26b98798435d8f54d90e840680e7'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:40.011933 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1273/2550] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:27:39 2022] DELETE /identity/v3/users/1fdc26b98798435d8f54d90e840680e7 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:27:40.456170 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc89726-e2c0-4138-9922-ba615cd481bf admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:40.458399 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-6dc89726-e2c0-4138-9922-ba615cd481bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:40.471850 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc89726-e2c0-4138-9922-ba615cd481bf admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:40.531257 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fd012-6cb2-4dde-b380-19691cc7a961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:40.537530 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fd012-6cb2-4dde-b380-19691cc7a961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:40.537530 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fd012-6cb2-4dde-b380-19691cc7a961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:40.537530 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fd012-6cb2-4dde-b380-19691cc7a961 admin admin] PATH_INFO: `/v3/projects/744bf9c30cf3486a9c31fcc0ab02a0e9` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:40.537530 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5fd012-6cb2-4dde-b380-19691cc7a961 admin admin] RBAC: Authorizing `identity:delete_project(project_id=744bf9c30cf3486a9c31fcc0ab02a0e9)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:40.537530 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5fd012-6cb2-4dde-b380-19691cc7a961 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:40.656531 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fb5fd012-6cb2-4dde-b380-19691cc7a961 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '744bf9c30cf3486a9c31fcc0ab02a0e9', 'request_id': 'req-fb5fd012-6cb2-4dde-b380-19691cc7a961'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:40.663532 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fb5fd012-6cb2-4dde-b380-19691cc7a961 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '744bf9c30cf3486a9c31fcc0ab02a0e9', 'request_id': 'req-fb5fd012-6cb2-4dde-b380-19691cc7a961'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:40.673835 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fb5fd012-6cb2-4dde-b380-19691cc7a961 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '744bf9c30cf3486a9c31fcc0ab02a0e9', 'request_id': 'req-fb5fd012-6cb2-4dde-b380-19691cc7a961'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:40.798515 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fb5fd012-6cb2-4dde-b380-19691cc7a961 admin admin] The token cache is being invalidate because project 744bf9c30cf3486a9c31fcc0ab02a0e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:27:40.798797 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fb5fd012-6cb2-4dde-b380-19691cc7a961 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:40.799421 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-fb5fd012-6cb2-4dde-b380-19691cc7a961 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:40.801982 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1278/2551] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:27:40 2022] DELETE /identity/v3/projects/744bf9c30cf3486a9c31fcc0ab02a0e9 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:27:40.806951 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd31ac-d27b-4152-b2e5-8e59e97628f5 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:40.807478 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd31ac-d27b-4152-b2e5-8e59e97628f5 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:40.812786 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd31ac-d27b-4152-b2e5-8e59e97628f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:40.825580 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-53dd31ac-d27b-4152-b2e5-8e59e97628f5 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:27:40.826781 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-53dd31ac-d27b-4152-b2e5-8e59e97628f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:40.887328 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1274/2552] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:27:40.896181 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86f46d-acab-4d5f-a397-0d8f00ce984f None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:40.896468 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86f46d-acab-4d5f-a397-0d8f00ce984f None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:40.896750 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86f46d-acab-4d5f-a397-0d8f00ce984f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:40.915944 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-3a86f46d-acab-4d5f-a397-0d8f00ce984f None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:27:40.917139 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-3a86f46d-acab-4d5f-a397-0d8f00ce984f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:40.924976 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1279/2553] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:27:40.929523 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd31ac-d27b-4152-b2e5-8e59e97628f5 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:40.939406 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd31ac-d27b-4152-b2e5-8e59e97628f5 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:40.946799 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4599dc-502f-4024-a409-f8a9f74b27a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:40.947786 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4599dc-502f-4024-a409-f8a9f74b27a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:40.948072 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4599dc-502f-4024-a409-f8a9f74b27a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:40.948345 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4599dc-502f-4024-a409-f8a9f74b27a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:40.949094 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4599dc-502f-4024-a409-f8a9f74b27a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:27:40.949413 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4599dc-502f-4024-a409-f8a9f74b27a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:40.951006 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4599dc-502f-4024-a409-f8a9f74b27a2 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:40.964133 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1275/2554] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:27:40.968628 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86f46d-acab-4d5f-a397-0d8f00ce984f None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:40.978907 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86f46d-acab-4d5f-a397-0d8f00ce984f None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:40.983703 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c4074-42db-4f11-a685-2d8bb06908f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:40.984398 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c4074-42db-4f11-a685-2d8bb06908f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:40.984685 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c4074-42db-4f11-a685-2d8bb06908f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:40.984961 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c4074-42db-4f11-a685-2d8bb06908f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:40.985718 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c4074-42db-4f11-a685-2d8bb06908f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:40.987743 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c4074-42db-4f11-a685-2d8bb06908f4 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:41.075179 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1280/2555] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:27:40 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:27:41.079284 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4599dc-502f-4024-a409-f8a9f74b27a2 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:41.090120 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4599dc-502f-4024-a409-f8a9f74b27a2 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:41.146655 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b10d7a-b59f-4b39-a124-aa177f399bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:41.147326 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b10d7a-b59f-4b39-a124-aa177f399bbe admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:41.147618 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b10d7a-b59f-4b39-a124-aa177f399bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:41.147902 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b10d7a-b59f-4b39-a124-aa177f399bbe admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:41.148614 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b10d7a-b59f-4b39-a124-aa177f399bbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:41.150562 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b10d7a-b59f-4b39-a124-aa177f399bbe admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:41.256697 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1276/2556] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:27:41 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:27:41.260982 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c4074-42db-4f11-a685-2d8bb06908f4 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:41.272391 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c4074-42db-4f11-a685-2d8bb06908f4 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:41.276964 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b4759-4cb5-4061-a14b-d17338b0ff93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:41.277649 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b4759-4cb5-4061-a14b-d17338b0ff93 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:41.277938 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b4759-4cb5-4061-a14b-d17338b0ff93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:41.278219 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b4759-4cb5-4061-a14b-d17338b0ff93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:41.278943 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b4759-4cb5-4061-a14b-d17338b0ff93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:41.280544 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b4759-4cb5-4061-a14b-d17338b0ff93 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:41.291437 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1281/2557] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:27:41.295688 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b10d7a-b59f-4b39-a124-aa177f399bbe admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:41.305729 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b10d7a-b59f-4b39-a124-aa177f399bbe admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:41.310397 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7e90a-0376-4bc1-aa7c-dbf751e11722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:41.311061 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7e90a-0376-4bc1-aa7c-dbf751e11722 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:41.311348 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7e90a-0376-4bc1-aa7c-dbf751e11722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:41.311630 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7e90a-0376-4bc1-aa7c-dbf751e11722 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:41.312355 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7e90a-0376-4bc1-aa7c-dbf751e11722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:41.313981 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7e90a-0376-4bc1-aa7c-dbf751e11722 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:41.325716 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1277/2558] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:27:41.329907 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b4759-4cb5-4061-a14b-d17338b0ff93 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:41.342646 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b4759-4cb5-4061-a14b-d17338b0ff93 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:41.348216 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38254cda-30fc-408f-8146-eacc2f7565a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:41.349146 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38254cda-30fc-408f-8146-eacc2f7565a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:41.349489 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38254cda-30fc-408f-8146-eacc2f7565a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:41.349766 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38254cda-30fc-408f-8146-eacc2f7565a9 admin admin] PATH_INFO: `/v3/projects/e8941598f71f4ea9bd4743aaa11fc97d/users/e5cdc964d1fc4a4695e244d999e2bf47/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:41.365454 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38254cda-30fc-408f-8146-eacc2f7565a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8941598f71f4ea9bd4743aaa11fc97d, user_id=e5cdc964d1fc4a4695e244d999e2bf47, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:41.368065 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38254cda-30fc-408f-8146-eacc2f7565a9 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:41.446448 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1282/2559] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:27:41 2022] PUT /identity/v3/projects/e8941598f71f4ea9bd4743aaa11fc97d/users/e5cdc964d1fc4a4695e244d999e2bf47/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:27:41.459070 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b171b25-81e8-488a-a078-9291009d312d None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:41.459356 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b171b25-81e8-488a-a078-9291009d312d None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:41.464381 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b171b25-81e8-488a-a078-9291009d312d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:41.486892 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-9b171b25-81e8-488a-a078-9291009d312d None None] MFA Rules not processed for user `e5cdc964d1fc4a4695e244d999e2bf47`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:27:41.488733 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9b171b25-81e8-488a-a078-9291009d312d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:41.556955 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1278/2560] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:27:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:27:41.561583 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38254cda-30fc-408f-8146-eacc2f7565a9 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:41.651976 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38254cda-30fc-408f-8146-eacc2f7565a9 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:41.657790 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ad1fd-5871-4a93-bbed-b367a8b8359d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:41.658496 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ad1fd-5871-4a93-bbed-b367a8b8359d admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:41.658782 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ad1fd-5871-4a93-bbed-b367a8b8359d admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:41.659061 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ad1fd-5871-4a93-bbed-b367a8b8359d admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:41.660799 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ad1fd-5871-4a93-bbed-b367a8b8359d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:41.662812 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ad1fd-5871-4a93-bbed-b367a8b8359d admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:41.783331 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1283/2561] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:27:41 2022] POST /identity/v3/projects => generated 377 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:27:41.795762 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b171b25-81e8-488a-a078-9291009d312d None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:41.807367 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b171b25-81e8-488a-a078-9291009d312d None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:41.868393 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcba76-8433-4ba6-9675-a8c7a8f67d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:41.869121 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcba76-8433-4ba6-9675-a8c7a8f67d88 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:41.869437 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcba76-8433-4ba6-9675-a8c7a8f67d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:41.869718 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcba76-8433-4ba6-9675-a8c7a8f67d88 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:41.870427 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edcba76-8433-4ba6-9675-a8c7a8f67d88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:41.872333 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edcba76-8433-4ba6-9675-a8c7a8f67d88 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:42.020998 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1279/2562] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:27:41 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:27:42.026099 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ad1fd-5871-4a93-bbed-b367a8b8359d admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:42.038056 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ad1fd-5871-4a93-bbed-b367a8b8359d admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:42.042744 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b1a88-e3a6-454d-936c-be6cebdfd842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:42.043705 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b1a88-e3a6-454d-936c-be6cebdfd842 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:42.043992 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b1a88-e3a6-454d-936c-be6cebdfd842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:42.044413 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b1a88-e3a6-454d-936c-be6cebdfd842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:42.045189 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b1a88-e3a6-454d-936c-be6cebdfd842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:42.046848 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b1a88-e3a6-454d-936c-be6cebdfd842 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:42.059162 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1284/2563] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:27:42.063425 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcba76-8433-4ba6-9675-a8c7a8f67d88 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:42.074134 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcba76-8433-4ba6-9675-a8c7a8f67d88 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:42.078886 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbfc16-707b-4039-966e-b1cf9e561a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:42.080155 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbfc16-707b-4039-966e-b1cf9e561a48 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:42.080451 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbfc16-707b-4039-966e-b1cf9e561a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:42.080733 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbfc16-707b-4039-966e-b1cf9e561a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:42.082530 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbfc16-707b-4039-966e-b1cf9e561a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:42.083985 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbfc16-707b-4039-966e-b1cf9e561a48 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:42.094551 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1280/2564] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:27:42.099592 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b1a88-e3a6-454d-936c-be6cebdfd842 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:42.110197 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b1a88-e3a6-454d-936c-be6cebdfd842 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:42.115883 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b320302-484e-4854-bc55-95c79adc2897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:42.117231 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b320302-484e-4854-bc55-95c79adc2897 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:42.117645 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b320302-484e-4854-bc55-95c79adc2897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:42.117927 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b320302-484e-4854-bc55-95c79adc2897 admin admin] PATH_INFO: `/v3/projects/f6900e2427464e8eb297ba405a80940f/users/aae35cb3548e434f82774f5ad648edc6/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:42.134816 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b320302-484e-4854-bc55-95c79adc2897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6900e2427464e8eb297ba405a80940f, user_id=aae35cb3548e434f82774f5ad648edc6, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:42.137608 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b320302-484e-4854-bc55-95c79adc2897 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:42.250542 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1285/2565] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:27:42 2022] PUT /identity/v3/projects/f6900e2427464e8eb297ba405a80940f/users/aae35cb3548e434f82774f5ad648edc6/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:27:42.261539 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b442694-205b-4c45-9f70-ddaeacf77418 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:42.261827 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b442694-205b-4c45-9f70-ddaeacf77418 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:42.262132 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b442694-205b-4c45-9f70-ddaeacf77418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:42.291010 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-1b442694-205b-4c45-9f70-ddaeacf77418 None None] MFA Rules not processed for user `aae35cb3548e434f82774f5ad648edc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:27:42.296205 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-1b442694-205b-4c45-9f70-ddaeacf77418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:42.358561 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1281/2566] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:27:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:27:42.363896 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b320302-484e-4854-bc55-95c79adc2897 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:42.429395 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b320302-484e-4854-bc55-95c79adc2897 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:42.434265 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acf64a-d917-40d6-b59e-aa535784dd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:42.434940 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acf64a-d917-40d6-b59e-aa535784dd10 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:42.435226 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acf64a-d917-40d6-b59e-aa535784dd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:42.435503 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acf64a-d917-40d6-b59e-aa535784dd10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:42.436193 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0acf64a-d917-40d6-b59e-aa535784dd10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:42.438144 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0acf64a-d917-40d6-b59e-aa535784dd10 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:42.554617 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1286/2567] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:27:42 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:27:42.558889 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b442694-205b-4c45-9f70-ddaeacf77418 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:42.570532 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b442694-205b-4c45-9f70-ddaeacf77418 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:42.626226 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbb5a5-9fa6-428f-84ff-9343afdb0031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:42.626905 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbb5a5-9fa6-428f-84ff-9343afdb0031 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:42.627189 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbb5a5-9fa6-428f-84ff-9343afdb0031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:42.627467 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbb5a5-9fa6-428f-84ff-9343afdb0031 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:42.628194 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbb5a5-9fa6-428f-84ff-9343afdb0031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:42.630713 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbb5a5-9fa6-428f-84ff-9343afdb0031 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:42.816101 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1282/2568] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:27:42 2022] POST /identity/v3/users => generated 295 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:27:42.819879 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acf64a-d917-40d6-b59e-aa535784dd10 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:42.830822 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acf64a-d917-40d6-b59e-aa535784dd10 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:42.836726 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1e67d-3fe9-4fd1-b792-20800725060a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:42.837523 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1e67d-3fe9-4fd1-b792-20800725060a admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:42.837807 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1e67d-3fe9-4fd1-b792-20800725060a admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:42.838077 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1e67d-3fe9-4fd1-b792-20800725060a admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:42.838797 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1e67d-3fe9-4fd1-b792-20800725060a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:42.840394 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1e67d-3fe9-4fd1-b792-20800725060a admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:42.852202 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1287/2569] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:27:42.856473 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbb5a5-9fa6-428f-84ff-9343afdb0031 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:42.867092 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbb5a5-9fa6-428f-84ff-9343afdb0031 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:42.871659 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746c34d-b48b-4e4e-9e6b-30a277fd00e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:42.872530 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746c34d-b48b-4e4e-9e6b-30a277fd00e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:42.872811 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746c34d-b48b-4e4e-9e6b-30a277fd00e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:42.873084 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746c34d-b48b-4e4e-9e6b-30a277fd00e2 admin admin] PATH_INFO: `/v3/projects/ac65b822cc0d412f8a8c03ec20f9f3d5/users/a21d48c2008740b3975c0189ea7b12a8/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:42.887547 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746c34d-b48b-4e4e-9e6b-30a277fd00e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac65b822cc0d412f8a8c03ec20f9f3d5, user_id=a21d48c2008740b3975c0189ea7b12a8, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:42.890239 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746c34d-b48b-4e4e-9e6b-30a277fd00e2 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:42.964507 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1283/2570] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:27:42 2022] PUT /identity/v3/projects/ac65b822cc0d412f8a8c03ec20f9f3d5/users/a21d48c2008740b3975c0189ea7b12a8/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:27:42.973397 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1e67d-3fe9-4fd1-b792-20800725060a admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:42.979149 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1e67d-3fe9-4fd1-b792-20800725060a admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:43.038192 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbbb2af-8dc0-4bfa-903d-c840d3d08df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:43.039059 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbb2af-8dc0-4bfa-903d-c840d3d08df4 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:43.039432 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbb2af-8dc0-4bfa-903d-c840d3d08df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:43.039719 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbb2af-8dc0-4bfa-903d-c840d3d08df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:43.040470 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbbb2af-8dc0-4bfa-903d-c840d3d08df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:43.042114 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbbb2af-8dc0-4bfa-903d-c840d3d08df4 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:43.056996 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1288/2571] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:27:43.058434 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746c34d-b48b-4e4e-9e6b-30a277fd00e2 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:43.070736 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746c34d-b48b-4e4e-9e6b-30a277fd00e2 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:43.075605 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03ba7e-daa1-4b7d-8ecc-2ede27ef0e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:43.076499 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03ba7e-daa1-4b7d-8ecc-2ede27ef0e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:43.076786 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03ba7e-daa1-4b7d-8ecc-2ede27ef0e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:43.077063 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03ba7e-daa1-4b7d-8ecc-2ede27ef0e56 admin admin] PATH_INFO: `/v3/projects/ac65b822cc0d412f8a8c03ec20f9f3d5/users/a21d48c2008740b3975c0189ea7b12a8/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:43.079079 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03ba7e-daa1-4b7d-8ecc-2ede27ef0e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac65b822cc0d412f8a8c03ec20f9f3d5, user_id=a21d48c2008740b3975c0189ea7b12a8, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:43.083211 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03ba7e-daa1-4b7d-8ecc-2ede27ef0e56 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:43.093912 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1284/2572] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:27:43 2022] PUT /identity/v3/projects/ac65b822cc0d412f8a8c03ec20f9f3d5/users/a21d48c2008740b3975c0189ea7b12a8/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:27:43.104597 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb58cc3-ac8e-48d7-9183-bde6acbe6a58 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:43.104904 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb58cc3-ac8e-48d7-9183-bde6acbe6a58 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:43.105156 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb58cc3-ac8e-48d7-9183-bde6acbe6a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:43.135426 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-fcb58cc3-ac8e-48d7-9183-bde6acbe6a58 None None] MFA Rules not processed for user `a21d48c2008740b3975c0189ea7b12a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:27:43.136919 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-fcb58cc3-ac8e-48d7-9183-bde6acbe6a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:43.226557 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1289/2573] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:27:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:27:43.238382 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03ba7e-daa1-4b7d-8ecc-2ede27ef0e56 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:43.240508 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-bc03ba7e-daa1-4b7d-8ecc-2ede27ef0e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:43.301670 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03ba7e-daa1-4b7d-8ecc-2ede27ef0e56 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:43.304186 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb58cc3-ac8e-48d7-9183-bde6acbe6a58 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:43.305584 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-fcb58cc3-ac8e-48d7-9183-bde6acbe6a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:43.305704 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b0c12-1345-4972-813b-7934b4a6256d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:43.306352 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b0c12-1345-4972-813b-7934b4a6256d service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:43.306634 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b0c12-1345-4972-813b-7934b4a6256d service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:43.306911 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b0c12-1345-4972-813b-7934b4a6256d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:43.318054 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b0c12-1345-4972-813b-7934b4a6256d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:43.319533 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b0c12-1345-4972-813b-7934b4a6256d service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:43.334299 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1285/2574] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:27:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:27:43.366665 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb58cc3-ac8e-48d7-9183-bde6acbe6a58 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:43.370476 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9e6f9-c058-420b-bd88-9f39cb1d212f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:43.371128 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9e6f9-c058-420b-bd88-9f39cb1d212f service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:43.371413 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9e6f9-c058-420b-bd88-9f39cb1d212f service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:43.371692 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9e6f9-c058-420b-bd88-9f39cb1d212f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:43.373499 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-0fe9e6f9-c058-420b-bd88-9f39cb1d212f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:43.435191 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9e6f9-c058-420b-bd88-9f39cb1d212f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:43.436727 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9e6f9-c058-420b-bd88-9f39cb1d212f service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:43.447260 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1290/2575] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:27:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:27:43.486154 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b0c12-1345-4972-813b-7934b4a6256d service cinder] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:43.488338 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-ad6b0c12-1345-4972-813b-7934b4a6256d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:43.500240 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b0c12-1345-4972-813b-7934b4a6256d service cinder] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:43.504308 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf248f-51eb-4a6d-a39f-c57adfb9632a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:43.504961 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf248f-51eb-4a6d-a39f-c57adfb9632a service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:43.505245 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf248f-51eb-4a6d-a39f-c57adfb9632a service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:43.505557 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf248f-51eb-4a6d-a39f-c57adfb9632a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:43.568223 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf248f-51eb-4a6d-a39f-c57adfb9632a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:43.569817 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf248f-51eb-4a6d-a39f-c57adfb9632a service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:43.579660 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1286/2576] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:27:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:27:48.133135 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9e6f9-c058-420b-bd88-9f39cb1d212f service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:48.233707 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9e6f9-c058-420b-bd88-9f39cb1d212f service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:48.240785 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba0257-91ac-495d-bbb6-9dde1e01edcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:48.241736 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba0257-91ac-495d-bbb6-9dde1e01edcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:48.242042 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba0257-91ac-495d-bbb6-9dde1e01edcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:48.242320 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba0257-91ac-495d-bbb6-9dde1e01edcf admin admin] PATH_INFO: `/v3/users/e5cdc964d1fc4a4695e244d999e2bf47` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:48.243591 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba0257-91ac-495d-bbb6-9dde1e01edcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5cdc964d1fc4a4695e244d999e2bf47)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:48.245617 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba0257-91ac-495d-bbb6-9dde1e01edcf admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:48.459699 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c4ba0257-91ac-495d-bbb6-9dde1e01edcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5cdc964d1fc4a4695e244d999e2bf47'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:48.585376 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c4ba0257-91ac-495d-bbb6-9dde1e01edcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5cdc964d1fc4a4695e244d999e2bf47'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:48.590460 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c4ba0257-91ac-495d-bbb6-9dde1e01edcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5cdc964d1fc4a4695e244d999e2bf47'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:48.590460 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c4ba0257-91ac-495d-bbb6-9dde1e01edcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5cdc964d1fc4a4695e244d999e2bf47'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:48.596177 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c4ba0257-91ac-495d-bbb6-9dde1e01edcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5cdc964d1fc4a4695e244d999e2bf47'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:48.622923 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1291/2577] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:27:48 2022] DELETE /identity/v3/users/e5cdc964d1fc4a4695e244d999e2bf47 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:27:48.627743 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7329b2-98ce-44b0-a83e-186e3850c98e None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:48.628256 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7329b2-98ce-44b0-a83e-186e3850c98e None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:48.628381 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7329b2-98ce-44b0-a83e-186e3850c98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:48.647140 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-ca7329b2-98ce-44b0-a83e-186e3850c98e None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:27:48.648360 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-ca7329b2-98ce-44b0-a83e-186e3850c98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:48.724812 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1287/2578] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:27:48.733343 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba0257-91ac-495d-bbb6-9dde1e01edcf admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:48.735429 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-c4ba0257-91ac-495d-bbb6-9dde1e01edcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:48.802876 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba0257-91ac-495d-bbb6-9dde1e01edcf admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:48.806813 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d188e-61cc-4531-b5c2-d8cc6cdaaec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:48.807473 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d188e-61cc-4531-b5c2-d8cc6cdaaec1 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:48.807816 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d188e-61cc-4531-b5c2-d8cc6cdaaec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:48.808152 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d188e-61cc-4531-b5c2-d8cc6cdaaec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:48.819463 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d188e-61cc-4531-b5c2-d8cc6cdaaec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:48.821000 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d188e-61cc-4531-b5c2-d8cc6cdaaec1 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:48.833216 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1292/2579] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:27:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:27:49.367215 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7329b2-98ce-44b0-a83e-186e3850c98e None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:49.368783 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-ca7329b2-98ce-44b0-a83e-186e3850c98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:49.387690 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7329b2-98ce-44b0-a83e-186e3850c98e None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:49.392894 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07998b-4b07-4fff-ae27-1d8c202a72ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:49.393656 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07998b-4b07-4fff-ae27-1d8c202a72ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:49.393950 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07998b-4b07-4fff-ae27-1d8c202a72ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:49.394263 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07998b-4b07-4fff-ae27-1d8c202a72ad admin admin] PATH_INFO: `/v3/projects/e8941598f71f4ea9bd4743aaa11fc97d` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:49.396487 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07998b-4b07-4fff-ae27-1d8c202a72ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8941598f71f4ea9bd4743aaa11fc97d)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:49.398448 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07998b-4b07-4fff-ae27-1d8c202a72ad admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:49.521317 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-4d07998b-4b07-4fff-ae27-1d8c202a72ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8941598f71f4ea9bd4743aaa11fc97d', 'request_id': 'req-4d07998b-4b07-4fff-ae27-1d8c202a72ad'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:49.598763 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-4d07998b-4b07-4fff-ae27-1d8c202a72ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8941598f71f4ea9bd4743aaa11fc97d', 'request_id': 'req-4d07998b-4b07-4fff-ae27-1d8c202a72ad'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:49.605005 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-4d07998b-4b07-4fff-ae27-1d8c202a72ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8941598f71f4ea9bd4743aaa11fc97d', 'request_id': 'req-4d07998b-4b07-4fff-ae27-1d8c202a72ad'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:49.622583 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-4d07998b-4b07-4fff-ae27-1d8c202a72ad admin admin] The token cache is being invalidate because project e8941598f71f4ea9bd4743aaa11fc97d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:27:49.623105 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-4d07998b-4b07-4fff-ae27-1d8c202a72ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:49.624191 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-4d07998b-4b07-4fff-ae27-1d8c202a72ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:49.626752 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1288/2580] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:27:49 2022] DELETE /identity/v3/projects/e8941598f71f4ea9bd4743aaa11fc97d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:27:49.631721 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d188e-61cc-4531-b5c2-d8cc6cdaaec1 service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:49.642018 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d188e-61cc-4531-b5c2-d8cc6cdaaec1 service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:49.700874 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab6229-7176-44e6-bbd3-0bd521f7b584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:49.701789 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab6229-7176-44e6-bbd3-0bd521f7b584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:49.702070 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab6229-7176-44e6-bbd3-0bd521f7b584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:49.702345 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab6229-7176-44e6-bbd3-0bd521f7b584 admin admin] PATH_INFO: `/v3/users/aae35cb3548e434f82774f5ad648edc6` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:49.703525 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab6229-7176-44e6-bbd3-0bd521f7b584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aae35cb3548e434f82774f5ad648edc6)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:49.705601 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab6229-7176-44e6-bbd3-0bd521f7b584 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:49.950525 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-30ab6229-7176-44e6-bbd3-0bd521f7b584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aae35cb3548e434f82774f5ad648edc6'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:50.032637 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-30ab6229-7176-44e6-bbd3-0bd521f7b584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aae35cb3548e434f82774f5ad648edc6'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:50.033332 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-30ab6229-7176-44e6-bbd3-0bd521f7b584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aae35cb3548e434f82774f5ad648edc6'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:50.033942 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-30ab6229-7176-44e6-bbd3-0bd521f7b584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aae35cb3548e434f82774f5ad648edc6'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:50.042088 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-30ab6229-7176-44e6-bbd3-0bd521f7b584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aae35cb3548e434f82774f5ad648edc6'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:50.061760 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1293/2581] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:27:49 2022] DELETE /identity/v3/users/aae35cb3548e434f82774f5ad648edc6 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:27:50.277939 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07998b-4b07-4fff-ae27-1d8c202a72ad admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:50.280019 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-4d07998b-4b07-4fff-ae27-1d8c202a72ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:50.356732 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07998b-4b07-4fff-ae27-1d8c202a72ad admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:50.413792 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba3762-8d7f-4823-a9da-c75c40096646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:50.414744 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba3762-8d7f-4823-a9da-c75c40096646 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:50.415208 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba3762-8d7f-4823-a9da-c75c40096646 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:50.415659 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba3762-8d7f-4823-a9da-c75c40096646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:50.418435 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-6dba3762-8d7f-4823-a9da-c75c40096646 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:50.508093 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba3762-8d7f-4823-a9da-c75c40096646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:50.509590 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba3762-8d7f-4823-a9da-c75c40096646 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:50.510092 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab6229-7176-44e6-bbd3-0bd521f7b584 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:50.511618 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-30ab6229-7176-44e6-bbd3-0bd521f7b584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:50.520142 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1289/2582] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:27:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:27:50.527679 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab6229-7176-44e6-bbd3-0bd521f7b584 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:50.532445 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1104d6-3013-40c7-84eb-ba37ce3bafc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:50.533627 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1104d6-3013-40c7-84eb-ba37ce3bafc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:50.533912 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1104d6-3013-40c7-84eb-ba37ce3bafc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:50.534191 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1104d6-3013-40c7-84eb-ba37ce3bafc5 admin admin] PATH_INFO: `/v3/projects/f6900e2427464e8eb297ba405a80940f` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:50.536169 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1104d6-3013-40c7-84eb-ba37ce3bafc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6900e2427464e8eb297ba405a80940f)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:50.538456 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1104d6-3013-40c7-84eb-ba37ce3bafc5 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:50.674207 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-2d1104d6-3013-40c7-84eb-ba37ce3bafc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6900e2427464e8eb297ba405a80940f', 'request_id': 'req-2d1104d6-3013-40c7-84eb-ba37ce3bafc5'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:50.680117 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-2d1104d6-3013-40c7-84eb-ba37ce3bafc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6900e2427464e8eb297ba405a80940f', 'request_id': 'req-2d1104d6-3013-40c7-84eb-ba37ce3bafc5'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:50.686649 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-2d1104d6-3013-40c7-84eb-ba37ce3bafc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6900e2427464e8eb297ba405a80940f', 'request_id': 'req-2d1104d6-3013-40c7-84eb-ba37ce3bafc5'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:50.861194 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-2d1104d6-3013-40c7-84eb-ba37ce3bafc5 admin admin] The token cache is being invalidate because project f6900e2427464e8eb297ba405a80940f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:27:50.861513 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-2d1104d6-3013-40c7-84eb-ba37ce3bafc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:50.862167 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-2d1104d6-3013-40c7-84eb-ba37ce3bafc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:50.863970 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1294/2583] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:27:50 2022] DELETE /identity/v3/projects/f6900e2427464e8eb297ba405a80940f => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:27:50.868014 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba3762-8d7f-4823-a9da-c75c40096646 service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:50.877998 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba3762-8d7f-4823-a9da-c75c40096646 service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:50.946984 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b92d7c-936a-41f6-aa89-5597705775c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:50.947915 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b92d7c-936a-41f6-aa89-5597705775c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:50.948197 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b92d7c-936a-41f6-aa89-5597705775c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:50.948473 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b92d7c-936a-41f6-aa89-5597705775c0 admin admin] PATH_INFO: `/v3/users/a21d48c2008740b3975c0189ea7b12a8` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:50.949800 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b92d7c-936a-41f6-aa89-5597705775c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a21d48c2008740b3975c0189ea7b12a8)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:50.951816 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b92d7c-936a-41f6-aa89-5597705775c0 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:51.286642 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b3b92d7c-936a-41f6-aa89-5597705775c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a21d48c2008740b3975c0189ea7b12a8'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:51.403740 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b3b92d7c-936a-41f6-aa89-5597705775c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a21d48c2008740b3975c0189ea7b12a8'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:51.404491 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b3b92d7c-936a-41f6-aa89-5597705775c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a21d48c2008740b3975c0189ea7b12a8'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:51.413021 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b3b92d7c-936a-41f6-aa89-5597705775c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a21d48c2008740b3975c0189ea7b12a8'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:51.426529 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b3b92d7c-936a-41f6-aa89-5597705775c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a21d48c2008740b3975c0189ea7b12a8'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:51.432431 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1290/2584] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:27:50 2022] DELETE /identity/v3/users/a21d48c2008740b3975c0189ea7b12a8 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:27:51.983700 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1104d6-3013-40c7-84eb-ba37ce3bafc5 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:51.985282 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-2d1104d6-3013-40c7-84eb-ba37ce3bafc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:52.002053 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1104d6-3013-40c7-84eb-ba37ce3bafc5 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:52.067631 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993f447-c849-487d-8565-bbdff0303f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:52.068590 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993f447-c849-487d-8565-bbdff0303f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:52.068880 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993f447-c849-487d-8565-bbdff0303f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:52.069165 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993f447-c849-487d-8565-bbdff0303f52 admin admin] PATH_INFO: `/v3/projects/ac65b822cc0d412f8a8c03ec20f9f3d5` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:52.070503 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993f447-c849-487d-8565-bbdff0303f52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac65b822cc0d412f8a8c03ec20f9f3d5)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:52.072436 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993f447-c849-487d-8565-bbdff0303f52 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:52.223663 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-2993f447-c849-487d-8565-bbdff0303f52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac65b822cc0d412f8a8c03ec20f9f3d5', 'request_id': 'req-2993f447-c849-487d-8565-bbdff0303f52'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:52.230364 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-2993f447-c849-487d-8565-bbdff0303f52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac65b822cc0d412f8a8c03ec20f9f3d5', 'request_id': 'req-2993f447-c849-487d-8565-bbdff0303f52'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:52.237111 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-2993f447-c849-487d-8565-bbdff0303f52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac65b822cc0d412f8a8c03ec20f9f3d5', 'request_id': 'req-2993f447-c849-487d-8565-bbdff0303f52'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:52.364351 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-2993f447-c849-487d-8565-bbdff0303f52 admin admin] The token cache is being invalidate because project ac65b822cc0d412f8a8c03ec20f9f3d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:27:52.364611 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-2993f447-c849-487d-8565-bbdff0303f52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:52.365230 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-2993f447-c849-487d-8565-bbdff0303f52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:52.366999 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1295/2585] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:27:51 2022] DELETE /identity/v3/projects/ac65b822cc0d412f8a8c03ec20f9f3d5 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:27:52.375653 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785cd2e-3127-44bf-9fa7-98170a6ef12a None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:52.376662 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785cd2e-3127-44bf-9fa7-98170a6ef12a None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:52.376955 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785cd2e-3127-44bf-9fa7-98170a6ef12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:52.402794 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-5785cd2e-3127-44bf-9fa7-98170a6ef12a None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:27:52.406311 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-5785cd2e-3127-44bf-9fa7-98170a6ef12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:52.474789 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1291/2586] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:27:52.483549 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c6c5b-d882-410f-b17a-aaa810b85c06 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:52.483910 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c6c5b-d882-410f-b17a-aaa810b85c06 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:52.484263 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c6c5b-d882-410f-b17a-aaa810b85c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:52.489633 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785cd2e-3127-44bf-9fa7-98170a6ef12a None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:52.491326 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-5785cd2e-3127-44bf-9fa7-98170a6ef12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:52.504767 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-518c6c5b-d882-410f-b17a-aaa810b85c06 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:27:52.509560 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-518c6c5b-d882-410f-b17a-aaa810b85c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:52.515113 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1296/2587] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:27:52.519226 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c6c5b-d882-410f-b17a-aaa810b85c06 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:52.529505 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c6c5b-d882-410f-b17a-aaa810b85c06 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:52.534919 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55b357-5b22-4caf-b898-fcb05adaf745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:52.535705 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55b357-5b22-4caf-b898-fcb05adaf745 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:52.536056 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55b357-5b22-4caf-b898-fcb05adaf745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:52.536435 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55b357-5b22-4caf-b898-fcb05adaf745 admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:52.537169 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55b357-5b22-4caf-b898-fcb05adaf745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:27:52.537510 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55b357-5b22-4caf-b898-fcb05adaf745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:52.539120 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55b357-5b22-4caf-b898-fcb05adaf745 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:52.551781 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1297/2588] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:27:52.556147 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55b357-5b22-4caf-b898-fcb05adaf745 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:52.558451 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785cd2e-3127-44bf-9fa7-98170a6ef12a None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:52.567050 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cd542-88d3-4e2f-95bb-d0f3474bc24e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:52.567050 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cd542-88d3-4e2f-95bb-d0f3474bc24e service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:52.567050 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cd542-88d3-4e2f-95bb-d0f3474bc24e service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:52.567050 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cd542-88d3-4e2f-95bb-d0f3474bc24e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:52.568053 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55b357-5b22-4caf-b898-fcb05adaf745 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:52.568706 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-c02cd542-88d3-4e2f-95bb-d0f3474bc24e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:52.573695 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e03702-2a52-4219-b849-9a16761f0dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:52.574514 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e03702-2a52-4219-b849-9a16761f0dec admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:52.575022 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e03702-2a52-4219-b849-9a16761f0dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:52.575364 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e03702-2a52-4219-b849-9a16761f0dec admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:52.576122 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e03702-2a52-4219-b849-9a16761f0dec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:52.578263 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e03702-2a52-4219-b849-9a16761f0dec admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:52.592382 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cd542-88d3-4e2f-95bb-d0f3474bc24e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:52.594468 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cd542-88d3-4e2f-95bb-d0f3474bc24e service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:52.607412 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1292/2589] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:27:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:27:52.671745 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1298/2590] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:27:52 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:27:52.678798 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cd542-88d3-4e2f-95bb-d0f3474bc24e service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:52.698855 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cd542-88d3-4e2f-95bb-d0f3474bc24e service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:52.777347 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6863d-d86e-49b3-8ff3-e9652b82f2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:52.778175 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6863d-d86e-49b3-8ff3-e9652b82f2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:52.778668 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6863d-d86e-49b3-8ff3-e9652b82f2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:52.779051 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6863d-d86e-49b3-8ff3-e9652b82f2a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:52.780163 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6863d-d86e-49b3-8ff3-e9652b82f2a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:52.783600 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6863d-d86e-49b3-8ff3-e9652b82f2a6 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:52.894012 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1293/2591] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:27:52 2022] POST /identity/v3/users => generated 283 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:27:52.900024 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e03702-2a52-4219-b849-9a16761f0dec admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:52.912501 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e03702-2a52-4219-b849-9a16761f0dec admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:52.917691 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ee06c-14cc-4230-b8b0-340db76d9392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:52.918578 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ee06c-14cc-4230-b8b0-340db76d9392 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:52.918699 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ee06c-14cc-4230-b8b0-340db76d9392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:52.918909 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ee06c-14cc-4230-b8b0-340db76d9392 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:52.919632 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ee06c-14cc-4230-b8b0-340db76d9392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:52.921231 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ee06c-14cc-4230-b8b0-340db76d9392 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:52.935298 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1299/2592] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:27:52.939655 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6863d-d86e-49b3-8ff3-e9652b82f2a6 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:52.960614 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6863d-d86e-49b3-8ff3-e9652b82f2a6 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:52.969799 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa001b8-a2f5-415f-8338-5b9f9becfb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:52.970491 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa001b8-a2f5-415f-8338-5b9f9becfb27 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:52.970782 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa001b8-a2f5-415f-8338-5b9f9becfb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:52.971115 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa001b8-a2f5-415f-8338-5b9f9becfb27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:52.971778 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa001b8-a2f5-415f-8338-5b9f9becfb27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:52.974603 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa001b8-a2f5-415f-8338-5b9f9becfb27 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:52.993857 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1294/2593] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:27:52.995862 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ee06c-14cc-4230-b8b0-340db76d9392 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:53.012563 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ee06c-14cc-4230-b8b0-340db76d9392 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:53.019470 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c47d4-7138-4033-806a-115a71a0231d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:53.020421 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c47d4-7138-4033-806a-115a71a0231d admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:53.020707 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c47d4-7138-4033-806a-115a71a0231d admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:53.021032 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c47d4-7138-4033-806a-115a71a0231d admin admin] PATH_INFO: `/v3/projects/52a3ae0ab6be4ad49fb475892dbcb6b9/users/033fa499b9014936b819c324ea92d34c/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:53.037736 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c47d4-7138-4033-806a-115a71a0231d admin admin] RBAC: Authorizing `identity:create_grant(project_id=52a3ae0ab6be4ad49fb475892dbcb6b9, user_id=033fa499b9014936b819c324ea92d34c, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:53.039428 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c47d4-7138-4033-806a-115a71a0231d admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:53.132278 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1300/2594] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:27:52 2022] PUT /identity/v3/projects/52a3ae0ab6be4ad49fb475892dbcb6b9/users/033fa499b9014936b819c324ea92d34c/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:27:53.143664 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555c283-d669-4145-b0f9-f17ee6e91399 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:53.148555 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555c283-d669-4145-b0f9-f17ee6e91399 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:53.148555 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555c283-d669-4145-b0f9-f17ee6e91399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:53.179527 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-3555c283-d669-4145-b0f9-f17ee6e91399 None None] MFA Rules not processed for user `033fa499b9014936b819c324ea92d34c`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:27:53.180657 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-3555c283-d669-4145-b0f9-f17ee6e91399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:53.260508 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1295/2595] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:27:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:27:53.264951 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c47d4-7138-4033-806a-115a71a0231d admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:53.330761 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c47d4-7138-4033-806a-115a71a0231d admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:53.338113 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b47d1a-9d91-49a0-9373-2424074cc8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:53.338725 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b47d1a-9d91-49a0-9373-2424074cc8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:53.339017 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b47d1a-9d91-49a0-9373-2424074cc8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:53.339308 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b47d1a-9d91-49a0-9373-2424074cc8e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:53.340032 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b47d1a-9d91-49a0-9373-2424074cc8e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:53.341963 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b47d1a-9d91-49a0-9373-2424074cc8e1 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:53.439491 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1301/2596] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:27:53 2022] POST /identity/v3/projects => generated 367 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:27:53.444329 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555c283-d669-4145-b0f9-f17ee6e91399 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:53.455638 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555c283-d669-4145-b0f9-f17ee6e91399 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:53.514783 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d4104-37ae-451e-a21c-16963b491ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:53.515457 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d4104-37ae-451e-a21c-16963b491ace admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:53.515747 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d4104-37ae-451e-a21c-16963b491ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:53.516031 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d4104-37ae-451e-a21c-16963b491ace admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:53.516731 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d4104-37ae-451e-a21c-16963b491ace admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:53.518654 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d4104-37ae-451e-a21c-16963b491ace admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:53.657207 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1296/2597] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:27:53 2022] POST /identity/v3/users => generated 290 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:27:53.662369 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b47d1a-9d91-49a0-9373-2424074cc8e1 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:53.676984 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b47d1a-9d91-49a0-9373-2424074cc8e1 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:53.680610 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bca687-0d3f-404a-993d-e5a0cefc256e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:53.681548 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bca687-0d3f-404a-993d-e5a0cefc256e admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:53.681959 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bca687-0d3f-404a-993d-e5a0cefc256e admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:53.682369 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bca687-0d3f-404a-993d-e5a0cefc256e admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:53.683544 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bca687-0d3f-404a-993d-e5a0cefc256e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:53.685393 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bca687-0d3f-404a-993d-e5a0cefc256e admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:53.701106 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1302/2598] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:27:53.704680 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d4104-37ae-451e-a21c-16963b491ace admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:53.717685 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d4104-37ae-451e-a21c-16963b491ace admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:53.723858 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b07890-b2e0-4397-9702-25798a4d110d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:53.725147 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b07890-b2e0-4397-9702-25798a4d110d admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:53.725684 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b07890-b2e0-4397-9702-25798a4d110d admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:53.726451 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b07890-b2e0-4397-9702-25798a4d110d admin admin] PATH_INFO: `/v3/projects/b4850def59784609999f0cb15fe227ec/users/823a2932f2d54a36b498fdbf5141c5fc/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:53.744454 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b07890-b2e0-4397-9702-25798a4d110d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4850def59784609999f0cb15fe227ec, user_id=823a2932f2d54a36b498fdbf5141c5fc, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:53.748380 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b07890-b2e0-4397-9702-25798a4d110d admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:53.850117 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1297/2599] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:27:53 2022] PUT /identity/v3/projects/b4850def59784609999f0cb15fe227ec/users/823a2932f2d54a36b498fdbf5141c5fc/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:27:53.854563 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bca687-0d3f-404a-993d-e5a0cefc256e admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:53.868050 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bca687-0d3f-404a-993d-e5a0cefc256e admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:53.979073 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7903830-8a42-48ef-b1de-eac74cb8f463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:53.979959 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7903830-8a42-48ef-b1de-eac74cb8f463 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:53.981797 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7903830-8a42-48ef-b1de-eac74cb8f463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:53.981797 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7903830-8a42-48ef-b1de-eac74cb8f463 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:53.982972 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7903830-8a42-48ef-b1de-eac74cb8f463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:53.986548 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7903830-8a42-48ef-b1de-eac74cb8f463 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:54.004327 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1303/2600] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:27:54.008676 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b07890-b2e0-4397-9702-25798a4d110d admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:54.019934 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b07890-b2e0-4397-9702-25798a4d110d admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:54.024759 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81e109-6d30-4e39-9090-76697d2fd940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:54.025771 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81e109-6d30-4e39-9090-76697d2fd940 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:54.026055 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81e109-6d30-4e39-9090-76697d2fd940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:54.026353 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81e109-6d30-4e39-9090-76697d2fd940 admin admin] PATH_INFO: `/v3/projects/b4850def59784609999f0cb15fe227ec/users/823a2932f2d54a36b498fdbf5141c5fc/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:54.028515 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81e109-6d30-4e39-9090-76697d2fd940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4850def59784609999f0cb15fe227ec, user_id=823a2932f2d54a36b498fdbf5141c5fc, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:54.031204 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81e109-6d30-4e39-9090-76697d2fd940 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:54.042742 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1298/2601] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:27:54 2022] PUT /identity/v3/projects/b4850def59784609999f0cb15fe227ec/users/823a2932f2d54a36b498fdbf5141c5fc/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:27:54.056822 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc886e-e88b-40b1-bca7-8d54e82ace2a None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:54.057453 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc886e-e88b-40b1-bca7-8d54e82ace2a None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:54.057917 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc886e-e88b-40b1-bca7-8d54e82ace2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:54.091257 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-b9dc886e-e88b-40b1-bca7-8d54e82ace2a None None] MFA Rules not processed for user `823a2932f2d54a36b498fdbf5141c5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:27:54.092627 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b9dc886e-e88b-40b1-bca7-8d54e82ace2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:54.168149 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1304/2602] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:27:54 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:27:54.181642 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81e109-6d30-4e39-9090-76697d2fd940 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:54.183432 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-4a81e109-6d30-4e39-9090-76697d2fd940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:54.263149 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81e109-6d30-4e39-9090-76697d2fd940 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:54.268318 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb99ea-b90d-43dc-9aab-f821a4577a6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:54.269533 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb99ea-b90d-43dc-9aab-f821a4577a6c service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:54.270113 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb99ea-b90d-43dc-9aab-f821a4577a6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:54.270531 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb99ea-b90d-43dc-9aab-f821a4577a6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:54.281615 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb99ea-b90d-43dc-9aab-f821a4577a6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:54.283139 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb99ea-b90d-43dc-9aab-f821a4577a6c service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:54.294160 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1299/2603] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:27:54 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:27:54.575915 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc886e-e88b-40b1-bca7-8d54e82ace2a None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:54.588558 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc886e-e88b-40b1-bca7-8d54e82ace2a None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:54.592561 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176de96-2b9d-40bc-b833-972ebf2ae820 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:54.593394 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176de96-2b9d-40bc-b833-972ebf2ae820 service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:54.593750 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176de96-2b9d-40bc-b833-972ebf2ae820 service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:54.594101 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176de96-2b9d-40bc-b833-972ebf2ae820 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:54.665708 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176de96-2b9d-40bc-b833-972ebf2ae820 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:54.673148 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176de96-2b9d-40bc-b833-972ebf2ae820 service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:54.677662 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1305/2604] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:27:54 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:27:58.672529 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb99ea-b90d-43dc-9aab-f821a4577a6c service cinder] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:58.674430 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-78fb99ea-b90d-43dc-9aab-f821a4577a6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:58.749690 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb99ea-b90d-43dc-9aab-f821a4577a6c service cinder] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:58.761366 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ecc85-1d5c-4218-ab94-9ed25f39c57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:58.761366 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ecc85-1d5c-4218-ab94-9ed25f39c57b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:58.761366 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ecc85-1d5c-4218-ab94-9ed25f39c57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:58.761366 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ecc85-1d5c-4218-ab94-9ed25f39c57b admin admin] PATH_INFO: `/v3/users/1c4e8920f33a4ae1a68811d68dd5d58f` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:58.761861 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ecc85-1d5c-4218-ab94-9ed25f39c57b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c4e8920f33a4ae1a68811d68dd5d58f)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:58.762252 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ecc85-1d5c-4218-ab94-9ed25f39c57b admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:59.025511 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-971ecc85-1d5c-4218-ab94-9ed25f39c57b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c4e8920f33a4ae1a68811d68dd5d58f'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:59.118566 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-971ecc85-1d5c-4218-ab94-9ed25f39c57b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c4e8920f33a4ae1a68811d68dd5d58f'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:59.119964 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-971ecc85-1d5c-4218-ab94-9ed25f39c57b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c4e8920f33a4ae1a68811d68dd5d58f'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:59.133177 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-971ecc85-1d5c-4218-ab94-9ed25f39c57b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c4e8920f33a4ae1a68811d68dd5d58f'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:59.147617 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-971ecc85-1d5c-4218-ab94-9ed25f39c57b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c4e8920f33a4ae1a68811d68dd5d58f'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:59.154816 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1300/2605] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:27:58 2022] DELETE /identity/v3/users/1c4e8920f33a4ae1a68811d68dd5d58f => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:27:59.486216 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176de96-2b9d-40bc-b833-972ebf2ae820 service cinder] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:27:59.518411 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176de96-2b9d-40bc-b833-972ebf2ae820 service cinder] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:27:59.588680 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bb747-3927-4337-85e0-0c1f14f2e6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:27:59.589634 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bb747-3927-4337-85e0-0c1f14f2e6ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:59.589921 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bb747-3927-4337-85e0-0c1f14f2e6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:59.590280 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bb747-3927-4337-85e0-0c1f14f2e6ea admin admin] PATH_INFO: `/v3/projects/4dd80d1f5dd744e8bd5cea87c84f184b` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:59.591839 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96bb747-3927-4337-85e0-0c1f14f2e6ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dd80d1f5dd744e8bd5cea87c84f184b)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:27:59.593999 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96bb747-3927-4337-85e0-0c1f14f2e6ea admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:27:59.742212 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c96bb747-3927-4337-85e0-0c1f14f2e6ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dd80d1f5dd744e8bd5cea87c84f184b', 'request_id': 'req-c96bb747-3927-4337-85e0-0c1f14f2e6ea'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:59.749285 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c96bb747-3927-4337-85e0-0c1f14f2e6ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dd80d1f5dd744e8bd5cea87c84f184b', 'request_id': 'req-c96bb747-3927-4337-85e0-0c1f14f2e6ea'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:59.756279 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c96bb747-3927-4337-85e0-0c1f14f2e6ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dd80d1f5dd744e8bd5cea87c84f184b', 'request_id': 'req-c96bb747-3927-4337-85e0-0c1f14f2e6ea'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:59.877885 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c96bb747-3927-4337-85e0-0c1f14f2e6ea admin admin] The token cache is being invalidate because project 4dd80d1f5dd744e8bd5cea87c84f184b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:27:59.878181 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c96bb747-3927-4337-85e0-0c1f14f2e6ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:59.878997 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-c96bb747-3927-4337-85e0-0c1f14f2e6ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:27:59.880538 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1306/2606] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:27:59 2022] DELETE /identity/v3/projects/4dd80d1f5dd744e8bd5cea87c84f184b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:27:59.885587 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f459e-4077-4a60-a7d7-087bacedbe5d None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:59.886078 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f459e-4077-4a60-a7d7-087bacedbe5d None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:59.886190 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f459e-4077-4a60-a7d7-087bacedbe5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:59.904109 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-175f459e-4077-4a60-a7d7-087bacedbe5d None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:27:59.905362 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-175f459e-4077-4a60-a7d7-087bacedbe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:27:59.972510 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1301/2607] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:27:59.977947 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2ac1e-0f74-46be-92fe-44839fd96868 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:27:59.978478 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2ac1e-0f74-46be-92fe-44839fd96868 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:27:59.978766 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2ac1e-0f74-46be-92fe-44839fd96868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:27:59.998859 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-fde2ac1e-0f74-46be-92fe-44839fd96868 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:00.000114 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-fde2ac1e-0f74-46be-92fe-44839fd96868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:00.013882 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1307/2608] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:28:00.026946 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f459e-4077-4a60-a7d7-087bacedbe5d None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:00.035495 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f459e-4077-4a60-a7d7-087bacedbe5d None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:00.041668 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ac172-4635-45ac-b0dd-e91fff07e1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:00.042415 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ac172-4635-45ac-b0dd-e91fff07e1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:00.042894 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ac172-4635-45ac-b0dd-e91fff07e1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:00.043172 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ac172-4635-45ac-b0dd-e91fff07e1a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:00.043954 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ac172-4635-45ac-b0dd-e91fff07e1a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:28:00.044432 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ac172-4635-45ac-b0dd-e91fff07e1a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:00.047022 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ac172-4635-45ac-b0dd-e91fff07e1a1 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:00.064139 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1302/2609] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:28:00.070432 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2ac1e-0f74-46be-92fe-44839fd96868 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:00.091713 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2ac1e-0f74-46be-92fe-44839fd96868 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:00.102075 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98359b2d-a6ed-4b35-afa7-0acac86b1562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:00.102778 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98359b2d-a6ed-4b35-afa7-0acac86b1562 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:00.103069 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98359b2d-a6ed-4b35-afa7-0acac86b1562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:00.103360 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98359b2d-a6ed-4b35-afa7-0acac86b1562 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:00.104210 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98359b2d-a6ed-4b35-afa7-0acac86b1562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:00.106255 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98359b2d-a6ed-4b35-afa7-0acac86b1562 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:00.194246 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1308/2610] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:28:00 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:28:00.198723 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ac172-4635-45ac-b0dd-e91fff07e1a1 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:00.210150 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ac172-4635-45ac-b0dd-e91fff07e1a1 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:00.291321 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57469d70-922e-4a2f-a9c8-c845093cf715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:00.292199 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57469d70-922e-4a2f-a9c8-c845093cf715 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:00.292494 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57469d70-922e-4a2f-a9c8-c845093cf715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:00.292775 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57469d70-922e-4a2f-a9c8-c845093cf715 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:00.293579 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57469d70-922e-4a2f-a9c8-c845093cf715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:00.295514 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57469d70-922e-4a2f-a9c8-c845093cf715 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:00.439350 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1303/2611] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:28:00 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:28:00.446221 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98359b2d-a6ed-4b35-afa7-0acac86b1562 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:00.456651 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98359b2d-a6ed-4b35-afa7-0acac86b1562 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:00.462385 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13855e-218c-41ac-8af9-6caf934550be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:00.463128 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13855e-218c-41ac-8af9-6caf934550be admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:00.463485 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13855e-218c-41ac-8af9-6caf934550be admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:00.464677 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13855e-218c-41ac-8af9-6caf934550be admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:00.465593 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13855e-218c-41ac-8af9-6caf934550be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:00.467296 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13855e-218c-41ac-8af9-6caf934550be admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:00.483407 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1309/2612] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:28:00.491668 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57469d70-922e-4a2f-a9c8-c845093cf715 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:00.502840 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57469d70-922e-4a2f-a9c8-c845093cf715 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:00.508496 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a95a1-3d6a-4e43-be06-92daebf9c200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:00.509115 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a95a1-3d6a-4e43-be06-92daebf9c200 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:00.509427 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a95a1-3d6a-4e43-be06-92daebf9c200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:00.510056 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a95a1-3d6a-4e43-be06-92daebf9c200 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:00.510426 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a95a1-3d6a-4e43-be06-92daebf9c200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:00.512047 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a95a1-3d6a-4e43-be06-92daebf9c200 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:00.526074 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1304/2613] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:28:00.530290 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13855e-218c-41ac-8af9-6caf934550be admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:00.542220 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13855e-218c-41ac-8af9-6caf934550be admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:00.546944 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdeecb4-0200-4fc4-9005-ad75eba76e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:00.547855 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdeecb4-0200-4fc4-9005-ad75eba76e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:00.551179 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdeecb4-0200-4fc4-9005-ad75eba76e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:00.551179 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdeecb4-0200-4fc4-9005-ad75eba76e36 admin admin] PATH_INFO: `/v3/projects/7e7f877b17ed4e8fb2f20c1ea361a77b/users/350c634872974e9bbfc9bf3aa83c85c4/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:00.564564 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdeecb4-0200-4fc4-9005-ad75eba76e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e7f877b17ed4e8fb2f20c1ea361a77b, user_id=350c634872974e9bbfc9bf3aa83c85c4, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:00.567734 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdeecb4-0200-4fc4-9005-ad75eba76e36 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:00.658777 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1310/2614] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:28:00 2022] PUT /identity/v3/projects/7e7f877b17ed4e8fb2f20c1ea361a77b/users/350c634872974e9bbfc9bf3aa83c85c4/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:28:00.677678 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d9ab2-bcd8-434b-9d55-a097d339fde0 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:00.678100 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d9ab2-bcd8-434b-9d55-a097d339fde0 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:00.678533 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d9ab2-bcd8-434b-9d55-a097d339fde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:00.715175 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-2e6d9ab2-bcd8-434b-9d55-a097d339fde0 None None] MFA Rules not processed for user `350c634872974e9bbfc9bf3aa83c85c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:00.716491 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-2e6d9ab2-bcd8-434b-9d55-a097d339fde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:00.790656 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1305/2615] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:28:00.803089 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdeecb4-0200-4fc4-9005-ad75eba76e36 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:00.805240 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-7cdeecb4-0200-4fc4-9005-ad75eba76e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:00.933357 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdeecb4-0200-4fc4-9005-ad75eba76e36 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:00.940109 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2456c8-d121-482d-b789-8ba1ff10374d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:00.941453 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2456c8-d121-482d-b789-8ba1ff10374d service nova] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:00.942968 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2456c8-d121-482d-b789-8ba1ff10374d service nova] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:00.943363 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2456c8-d121-482d-b789-8ba1ff10374d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:00.952281 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2456c8-d121-482d-b789-8ba1ff10374d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:00.954207 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2456c8-d121-482d-b789-8ba1ff10374d service nova] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:00.965742 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1311/2616] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:28:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:28:01.221857 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d9ab2-bcd8-434b-9d55-a097d339fde0 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:01.224082 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-2e6d9ab2-bcd8-434b-9d55-a097d339fde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:01.295095 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d9ab2-bcd8-434b-9d55-a097d339fde0 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:01.299679 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73aea45-f7ed-468c-878a-5ff613fab79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:01.301147 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73aea45-f7ed-468c-878a-5ff613fab79c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:01.301737 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73aea45-f7ed-468c-878a-5ff613fab79c admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:01.301843 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73aea45-f7ed-468c-878a-5ff613fab79c admin admin] PATH_INFO: `/v3/users/411f7901d39449bc831859d0a5d98ef9` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:01.303008 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73aea45-f7ed-468c-878a-5ff613fab79c admin admin] RBAC: Authorizing `identity:delete_user(user_id=411f7901d39449bc831859d0a5d98ef9)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:01.304903 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73aea45-f7ed-468c-878a-5ff613fab79c admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:01.555474 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-d73aea45-f7ed-468c-878a-5ff613fab79c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '411f7901d39449bc831859d0a5d98ef9'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:01.603666 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-d73aea45-f7ed-468c-878a-5ff613fab79c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '411f7901d39449bc831859d0a5d98ef9'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:01.604284 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-d73aea45-f7ed-468c-878a-5ff613fab79c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '411f7901d39449bc831859d0a5d98ef9'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:01.611434 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-d73aea45-f7ed-468c-878a-5ff613fab79c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '411f7901d39449bc831859d0a5d98ef9'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:01.624692 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-d73aea45-f7ed-468c-878a-5ff613fab79c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '411f7901d39449bc831859d0a5d98ef9'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:01.631467 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1306/2617] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:28:01 2022] DELETE /identity/v3/users/411f7901d39449bc831859d0a5d98ef9 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:28:01.965460 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2456c8-d121-482d-b789-8ba1ff10374d service nova] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:01.977756 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2456c8-d121-482d-b789-8ba1ff10374d service nova] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:02.060248 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b21569-34b0-4e94-9cb5-48ff8d08c403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:02.061638 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b21569-34b0-4e94-9cb5-48ff8d08c403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:02.062087 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b21569-34b0-4e94-9cb5-48ff8d08c403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:02.062462 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b21569-34b0-4e94-9cb5-48ff8d08c403 admin admin] PATH_INFO: `/v3/projects/2edfa256a0874cc7afc8c01ea3e810be` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:02.070957 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b21569-34b0-4e94-9cb5-48ff8d08c403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2edfa256a0874cc7afc8c01ea3e810be)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:02.073557 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b21569-34b0-4e94-9cb5-48ff8d08c403 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:02.089078 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73aea45-f7ed-468c-878a-5ff613fab79c admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:02.092258 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-d73aea45-f7ed-468c-878a-5ff613fab79c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:02.128201 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73aea45-f7ed-468c-878a-5ff613fab79c admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:02.137723 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b63465-791d-4b60-a6a5-c942eef2e9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:02.139017 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b63465-791d-4b60-a6a5-c942eef2e9ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:02.139497 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b63465-791d-4b60-a6a5-c942eef2e9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:02.139974 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b63465-791d-4b60-a6a5-c942eef2e9ec admin admin] PATH_INFO: `/v3/users/033fa499b9014936b819c324ea92d34c` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:02.142679 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b63465-791d-4b60-a6a5-c942eef2e9ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=033fa499b9014936b819c324ea92d34c)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:02.145828 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b63465-791d-4b60-a6a5-c942eef2e9ec admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:02.243345 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-90b21569-34b0-4e94-9cb5-48ff8d08c403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2edfa256a0874cc7afc8c01ea3e810be', 'request_id': 'req-90b21569-34b0-4e94-9cb5-48ff8d08c403'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:02.254823 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-90b21569-34b0-4e94-9cb5-48ff8d08c403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2edfa256a0874cc7afc8c01ea3e810be', 'request_id': 'req-90b21569-34b0-4e94-9cb5-48ff8d08c403'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:02.261703 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-90b21569-34b0-4e94-9cb5-48ff8d08c403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2edfa256a0874cc7afc8c01ea3e810be', 'request_id': 'req-90b21569-34b0-4e94-9cb5-48ff8d08c403'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:02.334272 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-90b21569-34b0-4e94-9cb5-48ff8d08c403 admin admin] The token cache is being invalidate because project 2edfa256a0874cc7afc8c01ea3e810be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:28:02.341028 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-90b21569-34b0-4e94-9cb5-48ff8d08c403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:02.341028 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-90b21569-34b0-4e94-9cb5-48ff8d08c403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:02.341028 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1312/2618] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:28:01 2022] DELETE /identity/v3/projects/2edfa256a0874cc7afc8c01ea3e810be => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:28:02.341028 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b21569-34b0-4e94-9cb5-48ff8d08c403 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:02.342197 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-90b21569-34b0-4e94-9cb5-48ff8d08c403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:02.406194 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b21569-34b0-4e94-9cb5-48ff8d08c403 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:02.412243 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0552754-1be0-47bb-a999-91cb9244401a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:02.413130 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0552754-1be0-47bb-a999-91cb9244401a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:02.413455 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0552754-1be0-47bb-a999-91cb9244401a admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:02.413755 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0552754-1be0-47bb-a999-91cb9244401a admin admin] PATH_INFO: `/v3/users/f53e5c9cebdb405aacf39c5f1b0e3fb1` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:02.415003 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0552754-1be0-47bb-a999-91cb9244401a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f53e5c9cebdb405aacf39c5f1b0e3fb1)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:02.416936 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0552754-1be0-47bb-a999-91cb9244401a admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:02.423711 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b9b63465-791d-4b60-a6a5-c942eef2e9ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '033fa499b9014936b819c324ea92d34c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:02.494321 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b9b63465-791d-4b60-a6a5-c942eef2e9ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '033fa499b9014936b819c324ea92d34c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:02.495051 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b9b63465-791d-4b60-a6a5-c942eef2e9ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '033fa499b9014936b819c324ea92d34c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:02.502475 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b9b63465-791d-4b60-a6a5-c942eef2e9ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '033fa499b9014936b819c324ea92d34c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:02.515088 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b9b63465-791d-4b60-a6a5-c942eef2e9ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '033fa499b9014936b819c324ea92d34c'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:02.522405 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1307/2619] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:28:02 2022] DELETE /identity/v3/users/033fa499b9014936b819c324ea92d34c => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:28:02.526959 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6976f-9cf9-497f-8a3a-5a0a879e5f4b None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:02.527254 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6976f-9cf9-497f-8a3a-5a0a879e5f4b None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:02.527596 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6976f-9cf9-497f-8a3a-5a0a879e5f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:02.546754 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-e2d6976f-9cf9-497f-8a3a-5a0a879e5f4b None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:02.547952 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-e2d6976f-9cf9-497f-8a3a-5a0a879e5f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:02.609627 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1308/2620] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:28:02.620105 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6976f-9cf9-497f-8a3a-5a0a879e5f4b None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:02.621653 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-e2d6976f-9cf9-497f-8a3a-5a0a879e5f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:02.695890 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-b0552754-1be0-47bb-a999-91cb9244401a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f53e5c9cebdb405aacf39c5f1b0e3fb1'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:02.709750 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6976f-9cf9-497f-8a3a-5a0a879e5f4b None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:02.714827 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb00e4-beb2-4c73-9fc1-bef697bf4d84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:02.715889 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb00e4-beb2-4c73-9fc1-bef697bf4d84 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:02.716574 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb00e4-beb2-4c73-9fc1-bef697bf4d84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:02.717069 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb00e4-beb2-4c73-9fc1-bef697bf4d84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:02.732693 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb00e4-beb2-4c73-9fc1-bef697bf4d84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:02.735231 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb00e4-beb2-4c73-9fc1-bef697bf4d84 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:02.748895 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1309/2621] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:28:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:28:02.781102 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-b0552754-1be0-47bb-a999-91cb9244401a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f53e5c9cebdb405aacf39c5f1b0e3fb1'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:02.782042 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-b0552754-1be0-47bb-a999-91cb9244401a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f53e5c9cebdb405aacf39c5f1b0e3fb1'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:02.782983 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-b0552754-1be0-47bb-a999-91cb9244401a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f53e5c9cebdb405aacf39c5f1b0e3fb1'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:02.793677 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-b0552754-1be0-47bb-a999-91cb9244401a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f53e5c9cebdb405aacf39c5f1b0e3fb1'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:02.818475 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1313/2622] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:28:02 2022] DELETE /identity/v3/users/f53e5c9cebdb405aacf39c5f1b0e3fb1 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:28:03.162149 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb00e4-beb2-4c73-9fc1-bef697bf4d84 service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:03.162149 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-20cb00e4-beb2-4c73-9fc1-bef697bf4d84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:03.235814 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb00e4-beb2-4c73-9fc1-bef697bf4d84 service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:03.319578 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933c824-c245-4c07-abd5-a0cfc77566bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:03.320675 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933c824-c245-4c07-abd5-a0cfc77566bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:03.321156 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933c824-c245-4c07-abd5-a0cfc77566bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:03.321575 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933c824-c245-4c07-abd5-a0cfc77566bd admin admin] PATH_INFO: `/v3/projects/24043468612f42a688144ebaf9ce4c6b` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:03.323096 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933c824-c245-4c07-abd5-a0cfc77566bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=24043468612f42a688144ebaf9ce4c6b)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:03.326480 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933c824-c245-4c07-abd5-a0cfc77566bd admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:03.352164 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0552754-1be0-47bb-a999-91cb9244401a admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:03.352164 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b0552754-1be0-47bb-a999-91cb9244401a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:03.365914 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0552754-1be0-47bb-a999-91cb9244401a admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:03.372952 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4d199-4d2c-4018-bad4-29aa703ff14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:03.375370 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4d199-4d2c-4018-bad4-29aa703ff14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:03.376600 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4d199-4d2c-4018-bad4-29aa703ff14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:03.377576 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4d199-4d2c-4018-bad4-29aa703ff14d admin admin] PATH_INFO: `/v3/projects/52a3ae0ab6be4ad49fb475892dbcb6b9` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:03.382320 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4d199-4d2c-4018-bad4-29aa703ff14d admin admin] RBAC: Authorizing `identity:delete_project(project_id=52a3ae0ab6be4ad49fb475892dbcb6b9)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:03.384266 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4d199-4d2c-4018-bad4-29aa703ff14d admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:03.473562 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-c933c824-c245-4c07-abd5-a0cfc77566bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24043468612f42a688144ebaf9ce4c6b', 'request_id': 'req-c933c824-c245-4c07-abd5-a0cfc77566bd'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:03.583895 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-e0d4d199-4d2c-4018-bad4-29aa703ff14d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52a3ae0ab6be4ad49fb475892dbcb6b9', 'request_id': 'req-e0d4d199-4d2c-4018-bad4-29aa703ff14d'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:03.590482 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-e0d4d199-4d2c-4018-bad4-29aa703ff14d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52a3ae0ab6be4ad49fb475892dbcb6b9', 'request_id': 'req-e0d4d199-4d2c-4018-bad4-29aa703ff14d'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:03.597759 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-e0d4d199-4d2c-4018-bad4-29aa703ff14d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52a3ae0ab6be4ad49fb475892dbcb6b9', 'request_id': 'req-e0d4d199-4d2c-4018-bad4-29aa703ff14d'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:03.835463 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-c933c824-c245-4c07-abd5-a0cfc77566bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24043468612f42a688144ebaf9ce4c6b', 'request_id': 'req-c933c824-c245-4c07-abd5-a0cfc77566bd'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:03.847515 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-c933c824-c245-4c07-abd5-a0cfc77566bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24043468612f42a688144ebaf9ce4c6b', 'request_id': 'req-c933c824-c245-4c07-abd5-a0cfc77566bd'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:03.872365 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-c933c824-c245-4c07-abd5-a0cfc77566bd admin admin] The token cache is being invalidate because project 24043468612f42a688144ebaf9ce4c6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:28:03.872688 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-c933c824-c245-4c07-abd5-a0cfc77566bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:03.873578 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-c933c824-c245-4c07-abd5-a0cfc77566bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:03.876132 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1310/2623] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:28:03 2022] DELETE /identity/v3/projects/24043468612f42a688144ebaf9ce4c6b => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:28:03.935831 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-e0d4d199-4d2c-4018-bad4-29aa703ff14d admin admin] The token cache is being invalidate because project 52a3ae0ab6be4ad49fb475892dbcb6b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:28:03.936811 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-e0d4d199-4d2c-4018-bad4-29aa703ff14d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:03.937729 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-e0d4d199-4d2c-4018-bad4-29aa703ff14d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:03.948597 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1314/2624] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:28:03 2022] DELETE /identity/v3/projects/52a3ae0ab6be4ad49fb475892dbcb6b9 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:28:03.954425 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933c824-c245-4c07-abd5-a0cfc77566bd admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:03.957118 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-c933c824-c245-4c07-abd5-a0cfc77566bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:04.036675 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933c824-c245-4c07-abd5-a0cfc77566bd admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:04.097550 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7d5d0-54ea-444f-a5cf-021c8f4c4c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:04.098536 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7d5d0-54ea-444f-a5cf-021c8f4c4c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:04.098847 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7d5d0-54ea-444f-a5cf-021c8f4c4c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:04.099129 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7d5d0-54ea-444f-a5cf-021c8f4c4c61 admin admin] PATH_INFO: `/v3/users/823a2932f2d54a36b498fdbf5141c5fc` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:04.100509 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7d5d0-54ea-444f-a5cf-021c8f4c4c61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=823a2932f2d54a36b498fdbf5141c5fc)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:04.102498 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7d5d0-54ea-444f-a5cf-021c8f4c4c61 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:04.274089 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-58e7d5d0-54ea-444f-a5cf-021c8f4c4c61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '823a2932f2d54a36b498fdbf5141c5fc'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:04.345709 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-58e7d5d0-54ea-444f-a5cf-021c8f4c4c61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '823a2932f2d54a36b498fdbf5141c5fc'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:04.346454 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-58e7d5d0-54ea-444f-a5cf-021c8f4c4c61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '823a2932f2d54a36b498fdbf5141c5fc'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:04.354708 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-58e7d5d0-54ea-444f-a5cf-021c8f4c4c61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '823a2932f2d54a36b498fdbf5141c5fc'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:04.367772 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-58e7d5d0-54ea-444f-a5cf-021c8f4c4c61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '823a2932f2d54a36b498fdbf5141c5fc'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:04.374187 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1311/2625] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:28:03 2022] DELETE /identity/v3/users/823a2932f2d54a36b498fdbf5141c5fc => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:28:04.489764 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a05c7e-f8f2-4687-97ff-fde5fd9821c5 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:04.490337 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a05c7e-f8f2-4687-97ff-fde5fd9821c5 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:04.490337 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a05c7e-f8f2-4687-97ff-fde5fd9821c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:04.510872 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-a1a05c7e-f8f2-4687-97ff-fde5fd9821c5 None None] MFA Rules not processed for user `a0ce08fda1014dff843c40970cf3af11`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:04.512094 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a1a05c7e-f8f2-4687-97ff-fde5fd9821c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:04.707279 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1315/2626] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:28:04.857632 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7d5d0-54ea-444f-a5cf-021c8f4c4c61 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:04.859202 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-58e7d5d0-54ea-444f-a5cf-021c8f4c4c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:04.950131 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7d5d0-54ea-444f-a5cf-021c8f4c4c61 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:04.954998 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d83509-ce61-44b4-b1ac-d0a7ee5a2cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:04.955867 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d83509-ce61-44b4-b1ac-d0a7ee5a2cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:04.956325 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d83509-ce61-44b4-b1ac-d0a7ee5a2cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:04.956434 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d83509-ce61-44b4-b1ac-d0a7ee5a2cd0 admin admin] PATH_INFO: `/v3/projects/b4850def59784609999f0cb15fe227ec` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:04.957933 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d83509-ce61-44b4-b1ac-d0a7ee5a2cd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4850def59784609999f0cb15fe227ec)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:04.959765 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d83509-ce61-44b4-b1ac-d0a7ee5a2cd0 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:05.098363 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-70d83509-ce61-44b4-b1ac-d0a7ee5a2cd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4850def59784609999f0cb15fe227ec', 'request_id': 'req-70d83509-ce61-44b4-b1ac-d0a7ee5a2cd0'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:05.164017 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-70d83509-ce61-44b4-b1ac-d0a7ee5a2cd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4850def59784609999f0cb15fe227ec', 'request_id': 'req-70d83509-ce61-44b4-b1ac-d0a7ee5a2cd0'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:05.170817 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-70d83509-ce61-44b4-b1ac-d0a7ee5a2cd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4850def59784609999f0cb15fe227ec', 'request_id': 'req-70d83509-ce61-44b4-b1ac-d0a7ee5a2cd0'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:05.182344 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-70d83509-ce61-44b4-b1ac-d0a7ee5a2cd0 admin admin] The token cache is being invalidate because project b4850def59784609999f0cb15fe227ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:28:05.182639 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-70d83509-ce61-44b4-b1ac-d0a7ee5a2cd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:05.183348 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-70d83509-ce61-44b4-b1ac-d0a7ee5a2cd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:05.184872 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1312/2627] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:28:04 2022] DELETE /identity/v3/projects/b4850def59784609999f0cb15fe227ec => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:28:05.189738 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fe66b-6ef1-4944-9f8b-b3a9eceb018d None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:05.190036 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fe66b-6ef1-4944-9f8b-b3a9eceb018d None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:05.190315 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fe66b-6ef1-4944-9f8b-b3a9eceb018d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:05.209696 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-0a5fe66b-6ef1-4944-9f8b-b3a9eceb018d None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:05.210908 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-0a5fe66b-6ef1-4944-9f8b-b3a9eceb018d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:05.270449 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1316/2628] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:28:05.278138 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34162ff-611d-4243-a378-0fa0de5bae9a None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:05.278431 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34162ff-611d-4243-a378-0fa0de5bae9a None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:05.278711 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34162ff-611d-4243-a378-0fa0de5bae9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:05.297120 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-e34162ff-611d-4243-a378-0fa0de5bae9a None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:05.298379 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-e34162ff-611d-4243-a378-0fa0de5bae9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:05.306525 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1313/2629] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:28:05.311323 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fe66b-6ef1-4944-9f8b-b3a9eceb018d None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:05.322462 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fe66b-6ef1-4944-9f8b-b3a9eceb018d None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:05.327131 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4bfd4-4374-4695-93f1-6f5a98fd4ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:05.327797 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4bfd4-4374-4695-93f1-6f5a98fd4ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:05.328085 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4bfd4-4374-4695-93f1-6f5a98fd4ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:05.328366 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4bfd4-4374-4695-93f1-6f5a98fd4ce0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:05.329092 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4bfd4-4374-4695-93f1-6f5a98fd4ce0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:28:05.329439 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4bfd4-4374-4695-93f1-6f5a98fd4ce0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:05.331053 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4bfd4-4374-4695-93f1-6f5a98fd4ce0 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:05.343811 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1317/2630] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:28:05.348519 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34162ff-611d-4243-a378-0fa0de5bae9a None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:05.357914 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34162ff-611d-4243-a378-0fa0de5bae9a None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:05.363483 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6a267-72a3-40d0-87e0-6ffb1af2a1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:05.364173 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6a267-72a3-40d0-87e0-6ffb1af2a1db admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:05.364537 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6a267-72a3-40d0-87e0-6ffb1af2a1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:05.364773 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6a267-72a3-40d0-87e0-6ffb1af2a1db admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:05.365589 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6a267-72a3-40d0-87e0-6ffb1af2a1db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:05.367506 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6a267-72a3-40d0-87e0-6ffb1af2a1db admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:05.507113 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1314/2631] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:28:05 2022] POST /identity/v3/projects => generated 359 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:28:05.511967 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4bfd4-4374-4695-93f1-6f5a98fd4ce0 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:05.523011 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4bfd4-4374-4695-93f1-6f5a98fd4ce0 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:05.578337 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448b4b0-0716-4e15-b1f3-8f5125bd73ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:05.579011 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448b4b0-0716-4e15-b1f3-8f5125bd73ec admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:05.579295 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448b4b0-0716-4e15-b1f3-8f5125bd73ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:05.579579 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448b4b0-0716-4e15-b1f3-8f5125bd73ec admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:05.580262 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448b4b0-0716-4e15-b1f3-8f5125bd73ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:05.582723 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448b4b0-0716-4e15-b1f3-8f5125bd73ec admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:05.689844 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1318/2632] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:28:05 2022] POST /identity/v3/users => generated 280 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:28:05.694608 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6a267-72a3-40d0-87e0-6ffb1af2a1db admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:05.704780 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6a267-72a3-40d0-87e0-6ffb1af2a1db admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:05.710466 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac840ff-fb68-41b1-a9ce-41819969c048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:05.711120 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac840ff-fb68-41b1-a9ce-41819969c048 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:05.711407 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac840ff-fb68-41b1-a9ce-41819969c048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:05.711687 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac840ff-fb68-41b1-a9ce-41819969c048 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:05.712411 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac840ff-fb68-41b1-a9ce-41819969c048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:05.714023 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac840ff-fb68-41b1-a9ce-41819969c048 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:05.725491 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1315/2633] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:28:05.734962 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448b4b0-0716-4e15-b1f3-8f5125bd73ec admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:05.745335 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448b4b0-0716-4e15-b1f3-8f5125bd73ec admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:05.750027 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8a23f-4e3a-4799-bd13-28811234bcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:05.750796 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8a23f-4e3a-4799-bd13-28811234bcd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:05.751079 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8a23f-4e3a-4799-bd13-28811234bcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:05.751353 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8a23f-4e3a-4799-bd13-28811234bcd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:05.752115 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8a23f-4e3a-4799-bd13-28811234bcd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:05.754074 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8a23f-4e3a-4799-bd13-28811234bcd7 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:05.764569 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1319/2634] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:28:05.769442 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac840ff-fb68-41b1-a9ce-41819969c048 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:05.779982 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac840ff-fb68-41b1-a9ce-41819969c048 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:05.785358 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2bf9e-e8d2-468e-ab34-7078d21cae02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:05.786262 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2bf9e-e8d2-468e-ab34-7078d21cae02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:05.786545 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2bf9e-e8d2-468e-ab34-7078d21cae02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:05.786844 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2bf9e-e8d2-468e-ab34-7078d21cae02 admin admin] PATH_INFO: `/v3/projects/2da795828d1f4ae596ed581a9dc46c44/users/83a70f0ed72a4550855393940523cef5/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:05.802346 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2bf9e-e8d2-468e-ab34-7078d21cae02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da795828d1f4ae596ed581a9dc46c44, user_id=83a70f0ed72a4550855393940523cef5, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:05.805101 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2bf9e-e8d2-468e-ab34-7078d21cae02 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:05.880813 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1316/2635] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:28:05 2022] PUT /identity/v3/projects/2da795828d1f4ae596ed581a9dc46c44/users/83a70f0ed72a4550855393940523cef5/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:28:05.892872 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b21ea-981a-418b-9647-30bd50f8954d None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:05.892872 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b21ea-981a-418b-9647-30bd50f8954d None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:05.893124 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b21ea-981a-418b-9647-30bd50f8954d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:05.933264 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-9c9b21ea-981a-418b-9647-30bd50f8954d None None] MFA Rules not processed for user `83a70f0ed72a4550855393940523cef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:05.934561 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-9c9b21ea-981a-418b-9647-30bd50f8954d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:06.002968 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1320/2636] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:05 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:28:06.033811 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2bf9e-e8d2-468e-ab34-7078d21cae02 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:06.037515 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-aea2bf9e-e8d2-468e-ab34-7078d21cae02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:06.099081 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2bf9e-e8d2-468e-ab34-7078d21cae02 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:06.102103 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb2446-3d17-4687-baa0-f35a913ffde5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:06.102751 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb2446-3d17-4687-baa0-f35a913ffde5 service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:06.103040 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb2446-3d17-4687-baa0-f35a913ffde5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:06.103320 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb2446-3d17-4687-baa0-f35a913ffde5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:06.111600 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb2446-3d17-4687-baa0-f35a913ffde5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:06.113840 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb2446-3d17-4687-baa0-f35a913ffde5 service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:06.122489 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1317/2637] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:28:06 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:28:06.136871 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b21ea-981a-418b-9647-30bd50f8954d None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:06.199712 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b21ea-981a-418b-9647-30bd50f8954d None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:06.204651 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a9fd4-eed0-4a30-9040-795948643e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:06.205554 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a9fd4-eed0-4a30-9040-795948643e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:06.205840 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a9fd4-eed0-4a30-9040-795948643e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:06.206117 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a9fd4-eed0-4a30-9040-795948643e58 admin admin] PATH_INFO: `/v3/users/83a70f0ed72a4550855393940523cef5` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:06.207367 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a9fd4-eed0-4a30-9040-795948643e58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83a70f0ed72a4550855393940523cef5)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:06.209279 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a9fd4-eed0-4a30-9040-795948643e58 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:06.379203 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-e62a9fd4-eed0-4a30-9040-795948643e58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83a70f0ed72a4550855393940523cef5'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:06.466498 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-e62a9fd4-eed0-4a30-9040-795948643e58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83a70f0ed72a4550855393940523cef5'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:06.467116 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-e62a9fd4-eed0-4a30-9040-795948643e58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83a70f0ed72a4550855393940523cef5'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:06.467729 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-e62a9fd4-eed0-4a30-9040-795948643e58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83a70f0ed72a4550855393940523cef5'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:06.475314 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-e62a9fd4-eed0-4a30-9040-795948643e58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83a70f0ed72a4550855393940523cef5'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:06.493695 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1321/2638] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:28:06 2022] DELETE /identity/v3/users/83a70f0ed72a4550855393940523cef5 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:28:06.498369 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b11325-f68c-4a96-a697-4d8d56e92c5a None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:06.498659 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b11325-f68c-4a96-a697-4d8d56e92c5a None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:06.498944 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b11325-f68c-4a96-a697-4d8d56e92c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:06.517181 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-24b11325-f68c-4a96-a697-4d8d56e92c5a None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:06.518394 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-24b11325-f68c-4a96-a697-4d8d56e92c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:06.576577 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1318/2639] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:28:06.587107 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a9fd4-eed0-4a30-9040-795948643e58 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:06.588503 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e62a9fd4-eed0-4a30-9040-795948643e58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:06.645306 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a9fd4-eed0-4a30-9040-795948643e58 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:06.648962 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e173e-7add-4181-a97b-a70abe25784f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:06.649645 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e173e-7add-4181-a97b-a70abe25784f service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:06.649932 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e173e-7add-4181-a97b-a70abe25784f service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:06.650211 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e173e-7add-4181-a97b-a70abe25784f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:06.659273 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e173e-7add-4181-a97b-a70abe25784f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:06.661587 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e173e-7add-4181-a97b-a70abe25784f service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:06.670957 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1322/2640] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:28:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:28:07.087279 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b11325-f68c-4a96-a697-4d8d56e92c5a None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:07.087279 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-24b11325-f68c-4a96-a697-4d8d56e92c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:07.102398 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b11325-f68c-4a96-a697-4d8d56e92c5a None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:07.107921 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b9856-3fcc-4802-9f2f-01348344ddf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:07.108600 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b9856-3fcc-4802-9f2f-01348344ddf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:07.108883 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b9856-3fcc-4802-9f2f-01348344ddf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:07.109153 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b9856-3fcc-4802-9f2f-01348344ddf1 admin admin] PATH_INFO: `/v3/projects/2da795828d1f4ae596ed581a9dc46c44` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:07.110520 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b9856-3fcc-4802-9f2f-01348344ddf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2da795828d1f4ae596ed581a9dc46c44)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:07.113038 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b9856-3fcc-4802-9f2f-01348344ddf1 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:07.228538 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b06b9856-3fcc-4802-9f2f-01348344ddf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2da795828d1f4ae596ed581a9dc46c44', 'request_id': 'req-b06b9856-3fcc-4802-9f2f-01348344ddf1'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:07.341309 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b06b9856-3fcc-4802-9f2f-01348344ddf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2da795828d1f4ae596ed581a9dc46c44', 'request_id': 'req-b06b9856-3fcc-4802-9f2f-01348344ddf1'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:07.348628 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b06b9856-3fcc-4802-9f2f-01348344ddf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2da795828d1f4ae596ed581a9dc46c44', 'request_id': 'req-b06b9856-3fcc-4802-9f2f-01348344ddf1'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:07.359965 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b06b9856-3fcc-4802-9f2f-01348344ddf1 admin admin] The token cache is being invalidate because project 2da795828d1f4ae596ed581a9dc46c44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:28:07.360297 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b06b9856-3fcc-4802-9f2f-01348344ddf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:07.360962 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b06b9856-3fcc-4802-9f2f-01348344ddf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:07.362562 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1319/2641] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:28:07 2022] DELETE /identity/v3/projects/2da795828d1f4ae596ed581a9dc46c44 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:28:07.367906 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b1df2-4786-4c69-9cae-f5fb9d91dc36 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:07.368230 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b1df2-4786-4c69-9cae-f5fb9d91dc36 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:07.368517 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b1df2-4786-4c69-9cae-f5fb9d91dc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:07.386334 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-541b1df2-4786-4c69-9cae-f5fb9d91dc36 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:07.387528 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-541b1df2-4786-4c69-9cae-f5fb9d91dc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:07.451351 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1323/2642] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:28:07.460603 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2618e67-796b-4c3d-a347-9a6fc1ae84a6 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:07.460914 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2618e67-796b-4c3d-a347-9a6fc1ae84a6 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:07.461178 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2618e67-796b-4c3d-a347-9a6fc1ae84a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:07.480446 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-d2618e67-796b-4c3d-a347-9a6fc1ae84a6 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:07.481691 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-d2618e67-796b-4c3d-a347-9a6fc1ae84a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:07.489960 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1320/2643] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:28:07.494206 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b1df2-4786-4c69-9cae-f5fb9d91dc36 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:07.505088 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b1df2-4786-4c69-9cae-f5fb9d91dc36 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:07.509751 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e9f11-d290-471d-b108-c29ff1bdc7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:07.510403 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e9f11-d290-471d-b108-c29ff1bdc7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:07.510691 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e9f11-d290-471d-b108-c29ff1bdc7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:07.514027 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e9f11-d290-471d-b108-c29ff1bdc7f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:07.514027 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e9f11-d290-471d-b108-c29ff1bdc7f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:28:07.514027 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e9f11-d290-471d-b108-c29ff1bdc7f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:07.514027 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e9f11-d290-471d-b108-c29ff1bdc7f2 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:07.525594 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1324/2644] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:28:07.529899 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2618e67-796b-4c3d-a347-9a6fc1ae84a6 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:07.539591 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2618e67-796b-4c3d-a347-9a6fc1ae84a6 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:07.544597 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbfa1d-30e9-496e-bd74-42bd91c5dedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:07.545254 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbfa1d-30e9-496e-bd74-42bd91c5dedc admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:07.545569 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbfa1d-30e9-496e-bd74-42bd91c5dedc admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:07.545844 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbfa1d-30e9-496e-bd74-42bd91c5dedc admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:07.546543 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbfa1d-30e9-496e-bd74-42bd91c5dedc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:07.548423 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbfa1d-30e9-496e-bd74-42bd91c5dedc admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:07.674873 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1321/2645] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:28:07 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:28:07.679072 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e9f11-d290-471d-b108-c29ff1bdc7f2 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:07.688928 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e9f11-d290-471d-b108-c29ff1bdc7f2 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:07.745794 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9ba16-cfc6-41c5-9f72-ff9e0eeb4ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:07.746474 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9ba16-cfc6-41c5-9f72-ff9e0eeb4ceb admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:07.746759 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9ba16-cfc6-41c5-9f72-ff9e0eeb4ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:07.747038 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9ba16-cfc6-41c5-9f72-ff9e0eeb4ceb admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:07.747718 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9ba16-cfc6-41c5-9f72-ff9e0eeb4ceb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:07.749651 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9ba16-cfc6-41c5-9f72-ff9e0eeb4ceb admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:07.843371 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1325/2646] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:28:07 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:28:07.849475 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbfa1d-30e9-496e-bd74-42bd91c5dedc admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:07.866082 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbfa1d-30e9-496e-bd74-42bd91c5dedc admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:07.870805 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad72d6c-7a26-4a47-bd2c-7514bdf2ce86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:07.871480 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad72d6c-7a26-4a47-bd2c-7514bdf2ce86 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:07.871765 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad72d6c-7a26-4a47-bd2c-7514bdf2ce86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:07.872045 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad72d6c-7a26-4a47-bd2c-7514bdf2ce86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:07.872776 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad72d6c-7a26-4a47-bd2c-7514bdf2ce86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:07.874400 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad72d6c-7a26-4a47-bd2c-7514bdf2ce86 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:07.886229 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1322/2647] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:28:07.890059 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9ba16-cfc6-41c5-9f72-ff9e0eeb4ceb admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:07.900802 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9ba16-cfc6-41c5-9f72-ff9e0eeb4ceb admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:07.906155 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c0eb2-b1e0-4975-9e80-fe882c2bf042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:07.906924 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c0eb2-b1e0-4975-9e80-fe882c2bf042 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:07.907304 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c0eb2-b1e0-4975-9e80-fe882c2bf042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:07.907627 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c0eb2-b1e0-4975-9e80-fe882c2bf042 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:07.908470 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c0eb2-b1e0-4975-9e80-fe882c2bf042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:07.910336 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c0eb2-b1e0-4975-9e80-fe882c2bf042 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:07.921115 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1326/2648] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:28:07.924830 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad72d6c-7a26-4a47-bd2c-7514bdf2ce86 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:07.938484 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad72d6c-7a26-4a47-bd2c-7514bdf2ce86 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:07.946085 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd48ba2-0c8b-4e27-a975-f35e6cf682c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:07.947330 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd48ba2-0c8b-4e27-a975-f35e6cf682c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:07.948414 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd48ba2-0c8b-4e27-a975-f35e6cf682c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:07.948867 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd48ba2-0c8b-4e27-a975-f35e6cf682c7 admin admin] PATH_INFO: `/v3/projects/3ce069a24cba44dd833dcb24a8d23d27/users/356fe8f323e74f8c92fc1ec8d7587281/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:07.971093 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd48ba2-0c8b-4e27-a975-f35e6cf682c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce069a24cba44dd833dcb24a8d23d27, user_id=356fe8f323e74f8c92fc1ec8d7587281, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:07.975186 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd48ba2-0c8b-4e27-a975-f35e6cf682c7 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:08.050775 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1323/2649] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:28:07 2022] PUT /identity/v3/projects/3ce069a24cba44dd833dcb24a8d23d27/users/356fe8f323e74f8c92fc1ec8d7587281/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:28:08.060998 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffacc0-9b5f-452d-ac46-e34f48d2c4ec None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:08.061305 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffacc0-9b5f-452d-ac46-e34f48d2c4ec None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:08.061610 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffacc0-9b5f-452d-ac46-e34f48d2c4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:08.092306 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-56ffacc0-9b5f-452d-ac46-e34f48d2c4ec None None] MFA Rules not processed for user `356fe8f323e74f8c92fc1ec8d7587281`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:08.093677 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-56ffacc0-9b5f-452d-ac46-e34f48d2c4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:08.170827 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1327/2650] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:28:08.183308 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd48ba2-0c8b-4e27-a975-f35e6cf682c7 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:08.186064 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-4dd48ba2-0c8b-4e27-a975-f35e6cf682c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:08.252124 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd48ba2-0c8b-4e27-a975-f35e6cf682c7 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:08.256370 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124527a6-7dac-4e72-b45b-72ecfd897543 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:08.257018 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124527a6-7dac-4e72-b45b-72ecfd897543 service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:08.257332 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124527a6-7dac-4e72-b45b-72ecfd897543 service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:08.257619 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124527a6-7dac-4e72-b45b-72ecfd897543 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:08.265782 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124527a6-7dac-4e72-b45b-72ecfd897543 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:08.267211 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124527a6-7dac-4e72-b45b-72ecfd897543 service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:08.276566 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1324/2651] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:28:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:28:10.438914 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffacc0-9b5f-452d-ac46-e34f48d2c4ec None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:10.448012 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-56ffacc0-9b5f-452d-ac46-e34f48d2c4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:10.546431 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffacc0-9b5f-452d-ac46-e34f48d2c4ec None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:10.552828 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e24922-5cf3-4d4c-ae78-dc8c0f3fbff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:10.553967 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e24922-5cf3-4d4c-ae78-dc8c0f3fbff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:10.554239 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e24922-5cf3-4d4c-ae78-dc8c0f3fbff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:10.554697 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e24922-5cf3-4d4c-ae78-dc8c0f3fbff1 admin admin] PATH_INFO: `/v3/users/350c634872974e9bbfc9bf3aa83c85c4` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:10.556194 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e24922-5cf3-4d4c-ae78-dc8c0f3fbff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=350c634872974e9bbfc9bf3aa83c85c4)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:10.558392 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e24922-5cf3-4d4c-ae78-dc8c0f3fbff1 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:10.876970 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-18e24922-5cf3-4d4c-ae78-dc8c0f3fbff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '350c634872974e9bbfc9bf3aa83c85c4'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:10.985633 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-18e24922-5cf3-4d4c-ae78-dc8c0f3fbff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '350c634872974e9bbfc9bf3aa83c85c4'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:10.986269 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-18e24922-5cf3-4d4c-ae78-dc8c0f3fbff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '350c634872974e9bbfc9bf3aa83c85c4'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:10.986890 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-18e24922-5cf3-4d4c-ae78-dc8c0f3fbff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '350c634872974e9bbfc9bf3aa83c85c4'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:10.994930 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-18e24922-5cf3-4d4c-ae78-dc8c0f3fbff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '350c634872974e9bbfc9bf3aa83c85c4'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:11.019407 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1328/2652] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:28:10 2022] DELETE /identity/v3/users/350c634872974e9bbfc9bf3aa83c85c4 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:28:11.022601 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf8715-b6af-41fb-866c-139ccba9b0ef None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:11.023160 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf8715-b6af-41fb-866c-139ccba9b0ef None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:11.023279 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf8715-b6af-41fb-866c-139ccba9b0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:11.042276 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-77bf8715-b6af-41fb-866c-139ccba9b0ef None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:11.043563 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-77bf8715-b6af-41fb-866c-139ccba9b0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:11.107941 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1325/2653] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:28:11.117743 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e24922-5cf3-4d4c-ae78-dc8c0f3fbff1 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:11.119304 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-18e24922-5cf3-4d4c-ae78-dc8c0f3fbff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:11.181419 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e24922-5cf3-4d4c-ae78-dc8c0f3fbff1 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:11.184933 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7688f7-1785-4aec-b592-dc9c83b96fd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:11.185742 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7688f7-1785-4aec-b592-dc9c83b96fd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:11.186027 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7688f7-1785-4aec-b592-dc9c83b96fd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:11.186300 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7688f7-1785-4aec-b592-dc9c83b96fd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:11.197059 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7688f7-1785-4aec-b592-dc9c83b96fd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:11.198539 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7688f7-1785-4aec-b592-dc9c83b96fd2 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:11.209238 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1329/2654] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:28:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:28:11.628745 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf8715-b6af-41fb-866c-139ccba9b0ef None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:11.630528 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-77bf8715-b6af-41fb-866c-139ccba9b0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:11.644050 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf8715-b6af-41fb-866c-139ccba9b0ef None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:11.649087 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f33e83-6820-4755-bb65-a3a18f517fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:11.650092 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f33e83-6820-4755-bb65-a3a18f517fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:11.650386 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f33e83-6820-4755-bb65-a3a18f517fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:11.650672 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f33e83-6820-4755-bb65-a3a18f517fb2 admin admin] PATH_INFO: `/v3/projects/7e7f877b17ed4e8fb2f20c1ea361a77b` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:11.651976 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f33e83-6820-4755-bb65-a3a18f517fb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e7f877b17ed4e8fb2f20c1ea361a77b)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:11.654023 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f33e83-6820-4755-bb65-a3a18f517fb2 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:11.668161 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7688f7-1785-4aec-b592-dc9c83b96fd2 service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:11.669754 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-8c7688f7-1785-4aec-b592-dc9c83b96fd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:11.683306 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7688f7-1785-4aec-b592-dc9c83b96fd2 service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:11.689234 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ebe59-3ca6-4dbc-9d61-80c6d6858f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:11.690149 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ebe59-3ca6-4dbc-9d61-80c6d6858f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:11.690433 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ebe59-3ca6-4dbc-9d61-80c6d6858f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:11.691302 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ebe59-3ca6-4dbc-9d61-80c6d6858f60 admin admin] PATH_INFO: `/v3/users/356fe8f323e74f8c92fc1ec8d7587281` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:11.692891 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ebe59-3ca6-4dbc-9d61-80c6d6858f60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=356fe8f323e74f8c92fc1ec8d7587281)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:11.694829 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ebe59-3ca6-4dbc-9d61-80c6d6858f60 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:11.805200 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-28f33e83-6820-4755-bb65-a3a18f517fb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e7f877b17ed4e8fb2f20c1ea361a77b', 'request_id': 'req-28f33e83-6820-4755-bb65-a3a18f517fb2'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:11.872495 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-28f33e83-6820-4755-bb65-a3a18f517fb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e7f877b17ed4e8fb2f20c1ea361a77b', 'request_id': 'req-28f33e83-6820-4755-bb65-a3a18f517fb2'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:11.879211 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-28f33e83-6820-4755-bb65-a3a18f517fb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e7f877b17ed4e8fb2f20c1ea361a77b', 'request_id': 'req-28f33e83-6820-4755-bb65-a3a18f517fb2'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:11.890315 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-28f33e83-6820-4755-bb65-a3a18f517fb2 admin admin] The token cache is being invalidate because project 7e7f877b17ed4e8fb2f20c1ea361a77b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:28:11.890606 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-28f33e83-6820-4755-bb65-a3a18f517fb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:11.891242 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-28f33e83-6820-4755-bb65-a3a18f517fb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:11.892844 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1326/2655] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:28:11 2022] DELETE /identity/v3/projects/7e7f877b17ed4e8fb2f20c1ea361a77b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:28:11.898331 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b060184-f4e7-4448-b5ce-c0dad62ccf67 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:11.898622 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b060184-f4e7-4448-b5ce-c0dad62ccf67 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:11.898903 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b060184-f4e7-4448-b5ce-c0dad62ccf67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:11.917915 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-7b060184-f4e7-4448-b5ce-c0dad62ccf67 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:11.919108 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-7b060184-f4e7-4448-b5ce-c0dad62ccf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:11.920827 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3e1ebe59-3ca6-4dbc-9d61-80c6d6858f60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '356fe8f323e74f8c92fc1ec8d7587281'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:11.980248 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1327/2656] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:28:11.986703 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3e1ebe59-3ca6-4dbc-9d61-80c6d6858f60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '356fe8f323e74f8c92fc1ec8d7587281'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:11.988125 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3e1ebe59-3ca6-4dbc-9d61-80c6d6858f60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '356fe8f323e74f8c92fc1ec8d7587281'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:11.988343 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c9d7c-20ad-4a3e-9ab2-53afcb4c43b5 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:11.989078 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c9d7c-20ad-4a3e-9ab2-53afcb4c43b5 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:11.989284 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3e1ebe59-3ca6-4dbc-9d61-80c6d6858f60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '356fe8f323e74f8c92fc1ec8d7587281'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:11.989503 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c9d7c-20ad-4a3e-9ab2-53afcb4c43b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:11.997503 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-3e1ebe59-3ca6-4dbc-9d61-80c6d6858f60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '356fe8f323e74f8c92fc1ec8d7587281'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:12.009392 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-f27c9d7c-20ad-4a3e-9ab2-53afcb4c43b5 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:12.010592 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-f27c9d7c-20ad-4a3e-9ab2-53afcb4c43b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:12.016290 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1330/2657] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:28:11 2022] DELETE /identity/v3/users/356fe8f323e74f8c92fc1ec8d7587281 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:28:12.020039 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1328/2658] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:28:12.023262 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4551c-4520-47b7-9dd7-4a55af3e08ec None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:12.023262 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4551c-4520-47b7-9dd7-4a55af3e08ec None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:12.023262 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4551c-4520-47b7-9dd7-4a55af3e08ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:12.024095 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c9d7c-20ad-4a3e-9ab2-53afcb4c43b5 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:12.033577 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c9d7c-20ad-4a3e-9ab2-53afcb4c43b5 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:12.040732 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-6ba4551c-4520-47b7-9dd7-4a55af3e08ec None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:12.041958 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-6ba4551c-4520-47b7-9dd7-4a55af3e08ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:12.090945 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d483f29-77b0-4737-ae55-bb25ce0b1e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:12.091617 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d483f29-77b0-4737-ae55-bb25ce0b1e3b admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:12.091908 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d483f29-77b0-4737-ae55-bb25ce0b1e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:12.092185 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d483f29-77b0-4737-ae55-bb25ce0b1e3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:12.092913 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d483f29-77b0-4737-ae55-bb25ce0b1e3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:28:12.093260 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d483f29-77b0-4737-ae55-bb25ce0b1e3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:12.094852 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d483f29-77b0-4737-ae55-bb25ce0b1e3b admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:12.103341 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1331/2659] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:28:12.109902 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1329/2660] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:28:12.117748 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4551c-4520-47b7-9dd7-4a55af3e08ec None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:12.123969 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d483f29-77b0-4737-ae55-bb25ce0b1e3b admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:12.125687 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-5d483f29-77b0-4737-ae55-bb25ce0b1e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:12.127373 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4551c-4520-47b7-9dd7-4a55af3e08ec None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:12.132698 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4e9c5-f4f9-4aa9-937e-4585049f3ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:12.133392 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4e9c5-f4f9-4aa9-937e-4585049f3ebe admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:12.133680 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4e9c5-f4f9-4aa9-937e-4585049f3ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:12.134097 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4e9c5-f4f9-4aa9-937e-4585049f3ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:12.134798 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4e9c5-f4f9-4aa9-937e-4585049f3ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:12.136744 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4e9c5-f4f9-4aa9-937e-4585049f3ebe admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:12.198345 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d483f29-77b0-4737-ae55-bb25ce0b1e3b admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:12.202751 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806ca3a-fbe7-40e1-a868-e11a239290bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:12.203410 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806ca3a-fbe7-40e1-a868-e11a239290bf service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:12.203706 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806ca3a-fbe7-40e1-a868-e11a239290bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:12.203986 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806ca3a-fbe7-40e1-a868-e11a239290bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:12.214494 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5806ca3a-fbe7-40e1-a868-e11a239290bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:12.218106 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5806ca3a-fbe7-40e1-a868-e11a239290bf service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:12.226694 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1330/2661] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:28:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:28:12.250547 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1332/2662] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:28:12 2022] POST /identity/v3/projects => generated 365 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:28:12.255119 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806ca3a-fbe7-40e1-a868-e11a239290bf service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:12.264898 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806ca3a-fbe7-40e1-a868-e11a239290bf service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:12.332216 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c30b4-76b7-494b-bafc-d9f3ce8d760b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:12.332962 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c30b4-76b7-494b-bafc-d9f3ce8d760b admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:12.333252 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c30b4-76b7-494b-bafc-d9f3ce8d760b admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:12.333569 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c30b4-76b7-494b-bafc-d9f3ce8d760b admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:12.334310 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c30b4-76b7-494b-bafc-d9f3ce8d760b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:12.336229 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c30b4-76b7-494b-bafc-d9f3ce8d760b admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:12.438545 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1331/2663] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:28:12 2022] POST /identity/v3/users => generated 283 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:28:12.443496 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4e9c5-f4f9-4aa9-937e-4585049f3ebe admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:12.454133 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4e9c5-f4f9-4aa9-937e-4585049f3ebe admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:12.459243 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc4d5d-9046-41fb-a7ed-4afb57494b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:12.467308 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc4d5d-9046-41fb-a7ed-4afb57494b1d admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:12.467308 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc4d5d-9046-41fb-a7ed-4afb57494b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:12.467308 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc4d5d-9046-41fb-a7ed-4afb57494b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:12.467308 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc4d5d-9046-41fb-a7ed-4afb57494b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:12.467308 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc4d5d-9046-41fb-a7ed-4afb57494b1d admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:12.477923 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1333/2664] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:28:12.479914 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c30b4-76b7-494b-bafc-d9f3ce8d760b admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:12.492601 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c30b4-76b7-494b-bafc-d9f3ce8d760b admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:12.497510 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee65fd8-5bc4-46f1-98b6-273ae8599574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:12.498644 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee65fd8-5bc4-46f1-98b6-273ae8599574 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:12.498936 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee65fd8-5bc4-46f1-98b6-273ae8599574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:12.499365 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee65fd8-5bc4-46f1-98b6-273ae8599574 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:12.499954 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee65fd8-5bc4-46f1-98b6-273ae8599574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:12.501558 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee65fd8-5bc4-46f1-98b6-273ae8599574 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:12.514283 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1332/2665] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:28:12.518141 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc4d5d-9046-41fb-a7ed-4afb57494b1d admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:12.529769 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc4d5d-9046-41fb-a7ed-4afb57494b1d admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:12.536140 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373a432-d1a6-403c-84ba-78c45291bdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:12.537347 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373a432-d1a6-403c-84ba-78c45291bdca admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:12.537662 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373a432-d1a6-403c-84ba-78c45291bdca admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:12.537941 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373a432-d1a6-403c-84ba-78c45291bdca admin admin] PATH_INFO: `/v3/projects/e0af22acc97947778139ce7bebbbb08f/users/3e301e403ef34202b239ac63a9979706/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:12.555022 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373a432-d1a6-403c-84ba-78c45291bdca admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0af22acc97947778139ce7bebbbb08f, user_id=3e301e403ef34202b239ac63a9979706, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:12.557658 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373a432-d1a6-403c-84ba-78c45291bdca admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:12.671676 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1334/2666] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:28:12 2022] PUT /identity/v3/projects/e0af22acc97947778139ce7bebbbb08f/users/3e301e403ef34202b239ac63a9979706/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:28:12.684180 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e591d-6839-4a62-b4b0-8db600a9a9a5 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:12.684472 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e591d-6839-4a62-b4b0-8db600a9a9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:12.684751 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e591d-6839-4a62-b4b0-8db600a9a9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:12.701603 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373a432-d1a6-403c-84ba-78c45291bdca admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:12.703790 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-9373a432-d1a6-403c-84ba-78c45291bdca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:12.720125 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-dd8e591d-6839-4a62-b4b0-8db600a9a9a5 None None] MFA Rules not processed for user `3e301e403ef34202b239ac63a9979706`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:12.721380 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-dd8e591d-6839-4a62-b4b0-8db600a9a9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:12.770875 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373a432-d1a6-403c-84ba-78c45291bdca admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:12.775706 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30071266-73b2-44ec-b3a1-4596a19c04d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:12.776573 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30071266-73b2-44ec-b3a1-4596a19c04d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:12.776860 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30071266-73b2-44ec-b3a1-4596a19c04d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:12.777235 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30071266-73b2-44ec-b3a1-4596a19c04d1 admin admin] PATH_INFO: `/v3/projects/3ce069a24cba44dd833dcb24a8d23d27` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:12.778333 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30071266-73b2-44ec-b3a1-4596a19c04d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce069a24cba44dd833dcb24a8d23d27)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:12.780240 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30071266-73b2-44ec-b3a1-4596a19c04d1 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:12.791224 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1333/2667] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:28:12.805094 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e591d-6839-4a62-b4b0-8db600a9a9a5 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:12.806540 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-dd8e591d-6839-4a62-b4b0-8db600a9a9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:12.866030 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e591d-6839-4a62-b4b0-8db600a9a9a5 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:12.870023 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72002119-6e98-4175-b34a-a0efb1cf6111 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:12.870680 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72002119-6e98-4175-b34a-a0efb1cf6111 service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:12.870967 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72002119-6e98-4175-b34a-a0efb1cf6111 service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:12.871252 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72002119-6e98-4175-b34a-a0efb1cf6111 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:12.881313 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72002119-6e98-4175-b34a-a0efb1cf6111 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:12.882827 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72002119-6e98-4175-b34a-a0efb1cf6111 service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:12.885949 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-30071266-73b2-44ec-b3a1-4596a19c04d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce069a24cba44dd833dcb24a8d23d27', 'request_id': 'req-30071266-73b2-44ec-b3a1-4596a19c04d1'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:12.891452 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-30071266-73b2-44ec-b3a1-4596a19c04d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce069a24cba44dd833dcb24a8d23d27', 'request_id': 'req-30071266-73b2-44ec-b3a1-4596a19c04d1'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:12.894798 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1334/2668] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:28:12 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:28:12.899532 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-30071266-73b2-44ec-b3a1-4596a19c04d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce069a24cba44dd833dcb24a8d23d27', 'request_id': 'req-30071266-73b2-44ec-b3a1-4596a19c04d1'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:12.974813 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-30071266-73b2-44ec-b3a1-4596a19c04d1 admin admin] The token cache is being invalidate because project 3ce069a24cba44dd833dcb24a8d23d27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:28:12.975117 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-30071266-73b2-44ec-b3a1-4596a19c04d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:12.975784 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-30071266-73b2-44ec-b3a1-4596a19c04d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:12.977864 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1335/2669] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:28:12 2022] DELETE /identity/v3/projects/3ce069a24cba44dd833dcb24a8d23d27 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:28:22.842070 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72002119-6e98-4175-b34a-a0efb1cf6111 service cinder] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:22.853900 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72002119-6e98-4175-b34a-a0efb1cf6111 service cinder] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:22.920441 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e0066-45ef-41f2-9aee-fce3d37270be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:22.921355 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e0066-45ef-41f2-9aee-fce3d37270be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:22.921697 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e0066-45ef-41f2-9aee-fce3d37270be admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:22.922040 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e0066-45ef-41f2-9aee-fce3d37270be admin admin] PATH_INFO: `/v3/users/3e301e403ef34202b239ac63a9979706` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:22.923264 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e0066-45ef-41f2-9aee-fce3d37270be admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e301e403ef34202b239ac63a9979706)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:22.925284 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e0066-45ef-41f2-9aee-fce3d37270be admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:23.117398 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-2c4e0066-45ef-41f2-9aee-fce3d37270be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e301e403ef34202b239ac63a9979706'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:23.179690 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-2c4e0066-45ef-41f2-9aee-fce3d37270be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e301e403ef34202b239ac63a9979706'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:23.180023 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-2c4e0066-45ef-41f2-9aee-fce3d37270be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e301e403ef34202b239ac63a9979706'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:23.187321 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-2c4e0066-45ef-41f2-9aee-fce3d37270be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e301e403ef34202b239ac63a9979706'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:23.201058 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-2c4e0066-45ef-41f2-9aee-fce3d37270be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e301e403ef34202b239ac63a9979706'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:23.207412 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1335/2670] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:28:22 2022] DELETE /identity/v3/users/3e301e403ef34202b239ac63a9979706 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:28:23.212635 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584b99e-e43d-4264-8cfe-508d3b7f367c None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:23.213154 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584b99e-e43d-4264-8cfe-508d3b7f367c None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:23.213409 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584b99e-e43d-4264-8cfe-508d3b7f367c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:23.238348 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-6584b99e-e43d-4264-8cfe-508d3b7f367c None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:23.239669 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-6584b99e-e43d-4264-8cfe-508d3b7f367c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:23.298957 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1336/2671] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:28:23.308872 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e0066-45ef-41f2-9aee-fce3d37270be admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:23.310290 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-2c4e0066-45ef-41f2-9aee-fce3d37270be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:23.370350 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e0066-45ef-41f2-9aee-fce3d37270be admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:23.373969 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488d633-29bb-4f1d-a9e4-9bffb95b17d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:23.374620 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488d633-29bb-4f1d-a9e4-9bffb95b17d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:23.374907 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488d633-29bb-4f1d-a9e4-9bffb95b17d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:23.375185 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488d633-29bb-4f1d-a9e4-9bffb95b17d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:23.385223 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488d633-29bb-4f1d-a9e4-9bffb95b17d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:23.386685 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488d633-29bb-4f1d-a9e4-9bffb95b17d0 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:23.398147 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1336/2672] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:28:24.181832 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584b99e-e43d-4264-8cfe-508d3b7f367c None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:24.183797 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-6584b99e-e43d-4264-8cfe-508d3b7f367c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:24.205391 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584b99e-e43d-4264-8cfe-508d3b7f367c None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:24.217338 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5764e-c588-428f-a8a9-69e30d0a0518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:24.219145 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5764e-c588-428f-a8a9-69e30d0a0518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:24.219697 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5764e-c588-428f-a8a9-69e30d0a0518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:24.220356 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5764e-c588-428f-a8a9-69e30d0a0518 admin admin] PATH_INFO: `/v3/projects/e0af22acc97947778139ce7bebbbb08f` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:24.222157 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5764e-c588-428f-a8a9-69e30d0a0518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0af22acc97947778139ce7bebbbb08f)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:24.224740 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5764e-c588-428f-a8a9-69e30d0a0518 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:24.394899 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-2ce5764e-c588-428f-a8a9-69e30d0a0518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0af22acc97947778139ce7bebbbb08f', 'request_id': 'req-2ce5764e-c588-428f-a8a9-69e30d0a0518'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:24.402864 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-2ce5764e-c588-428f-a8a9-69e30d0a0518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0af22acc97947778139ce7bebbbb08f', 'request_id': 'req-2ce5764e-c588-428f-a8a9-69e30d0a0518'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:24.409079 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-2ce5764e-c588-428f-a8a9-69e30d0a0518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0af22acc97947778139ce7bebbbb08f', 'request_id': 'req-2ce5764e-c588-428f-a8a9-69e30d0a0518'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:24.535357 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-2ce5764e-c588-428f-a8a9-69e30d0a0518 admin admin] The token cache is being invalidate because project e0af22acc97947778139ce7bebbbb08f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:28:24.535664 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-2ce5764e-c588-428f-a8a9-69e30d0a0518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:24.537058 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-2ce5764e-c588-428f-a8a9-69e30d0a0518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:24.538853 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1337/2673] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:28:24 2022] DELETE /identity/v3/projects/e0af22acc97947778139ce7bebbbb08f => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:28:24.543816 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c42f42-c7ee-4478-a4f0-2434ba228173 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:24.544344 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c42f42-c7ee-4478-a4f0-2434ba228173 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:24.544446 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c42f42-c7ee-4478-a4f0-2434ba228173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:24.563411 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-60c42f42-c7ee-4478-a4f0-2434ba228173 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:24.565381 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-60c42f42-c7ee-4478-a4f0-2434ba228173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:24.647797 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1337/2674] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:28:24.655529 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd45d6f-2a15-487a-9d58-74cf239265cb None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:24.655919 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd45d6f-2a15-487a-9d58-74cf239265cb None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:24.656452 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd45d6f-2a15-487a-9d58-74cf239265cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:24.678674 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-7fd45d6f-2a15-487a-9d58-74cf239265cb None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:24.679932 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-7fd45d6f-2a15-487a-9d58-74cf239265cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:24.688230 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1338/2675] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:28:24.693248 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c42f42-c7ee-4478-a4f0-2434ba228173 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:24.703923 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c42f42-c7ee-4478-a4f0-2434ba228173 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:24.709446 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b62fd-d21d-4361-b99b-c27df24f8fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:24.710092 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b62fd-d21d-4361-b99b-c27df24f8fee admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:24.710382 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b62fd-d21d-4361-b99b-c27df24f8fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:24.710667 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b62fd-d21d-4361-b99b-c27df24f8fee admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:24.711404 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b62fd-d21d-4361-b99b-c27df24f8fee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:28:24.711709 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b62fd-d21d-4361-b99b-c27df24f8fee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:24.713322 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b62fd-d21d-4361-b99b-c27df24f8fee admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:24.726570 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1338/2676] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:28:24.731221 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd45d6f-2a15-487a-9d58-74cf239265cb None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:24.741650 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd45d6f-2a15-487a-9d58-74cf239265cb None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:24.747349 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc69a4-f5bf-45ee-ae22-c17ee1e40d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:24.748018 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc69a4-f5bf-45ee-ae22-c17ee1e40d77 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:24.748309 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc69a4-f5bf-45ee-ae22-c17ee1e40d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:24.748584 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc69a4-f5bf-45ee-ae22-c17ee1e40d77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:24.749310 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc69a4-f5bf-45ee-ae22-c17ee1e40d77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:24.751221 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc69a4-f5bf-45ee-ae22-c17ee1e40d77 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:24.841091 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1339/2677] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:28:24 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:28:24.843941 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b62fd-d21d-4361-b99b-c27df24f8fee admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:24.869878 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b62fd-d21d-4361-b99b-c27df24f8fee admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:24.961502 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f471ef-d97c-4e99-9c15-28709e071df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:24.961502 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f471ef-d97c-4e99-9c15-28709e071df8 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:24.961502 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f471ef-d97c-4e99-9c15-28709e071df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:24.962235 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f471ef-d97c-4e99-9c15-28709e071df8 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:24.963102 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f471ef-d97c-4e99-9c15-28709e071df8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:24.965223 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f471ef-d97c-4e99-9c15-28709e071df8 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:25.065189 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1339/2678] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:28:24 2022] POST /identity/v3/users => generated 287 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:28:25.069768 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc69a4-f5bf-45ee-ae22-c17ee1e40d77 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:25.084791 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc69a4-f5bf-45ee-ae22-c17ee1e40d77 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:25.090189 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8fa0e-8f48-4297-b207-6320a6c09531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:25.091070 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8fa0e-8f48-4297-b207-6320a6c09531 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:25.091342 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8fa0e-8f48-4297-b207-6320a6c09531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:25.091820 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8fa0e-8f48-4297-b207-6320a6c09531 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:25.092879 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8fa0e-8f48-4297-b207-6320a6c09531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:25.094568 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8fa0e-8f48-4297-b207-6320a6c09531 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:25.105380 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1340/2679] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:28:25.113480 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f471ef-d97c-4e99-9c15-28709e071df8 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:25.124878 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f471ef-d97c-4e99-9c15-28709e071df8 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:25.131961 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29492470-1de8-4286-88ea-44dfb23b7a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:25.132655 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29492470-1de8-4286-88ea-44dfb23b7a52 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:25.132997 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29492470-1de8-4286-88ea-44dfb23b7a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:25.133305 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29492470-1de8-4286-88ea-44dfb23b7a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:25.137997 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29492470-1de8-4286-88ea-44dfb23b7a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:25.137997 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29492470-1de8-4286-88ea-44dfb23b7a52 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:25.149350 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1340/2680] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:28:25.152565 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8fa0e-8f48-4297-b207-6320a6c09531 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:25.164083 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8fa0e-8f48-4297-b207-6320a6c09531 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:25.168673 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d9023-6e23-49bb-9b63-6bed04eb1e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:25.169609 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d9023-6e23-49bb-9b63-6bed04eb1e4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:25.169891 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d9023-6e23-49bb-9b63-6bed04eb1e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:25.170192 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d9023-6e23-49bb-9b63-6bed04eb1e4a admin admin] PATH_INFO: `/v3/projects/4b61304248e24d83868a43e02612542b/users/6bc146c635b34886b829e8e3f2bfe64f/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:25.186633 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d9023-6e23-49bb-9b63-6bed04eb1e4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b61304248e24d83868a43e02612542b, user_id=6bc146c635b34886b829e8e3f2bfe64f, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:25.189279 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d9023-6e23-49bb-9b63-6bed04eb1e4a admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:25.321816 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1341/2681] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:28:25 2022] PUT /identity/v3/projects/4b61304248e24d83868a43e02612542b/users/6bc146c635b34886b829e8e3f2bfe64f/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:28:25.333979 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7030f09-c8df-4b27-98c2-99ef8c4c5320 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:25.334872 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7030f09-c8df-4b27-98c2-99ef8c4c5320 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:25.335198 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7030f09-c8df-4b27-98c2-99ef8c4c5320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:25.366812 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-e7030f09-c8df-4b27-98c2-99ef8c4c5320 None None] MFA Rules not processed for user `6bc146c635b34886b829e8e3f2bfe64f`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:25.368208 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-e7030f09-c8df-4b27-98c2-99ef8c4c5320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:25.434784 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1341/2682] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:28:25.446501 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d9023-6e23-49bb-9b63-6bed04eb1e4a admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:25.448199 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-bd0d9023-6e23-49bb-9b63-6bed04eb1e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:25.513055 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d9023-6e23-49bb-9b63-6bed04eb1e4a admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:25.517162 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920c048-710c-42cc-b2af-be298311ec22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:25.517975 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920c048-710c-42cc-b2af-be298311ec22 service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:25.518362 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920c048-710c-42cc-b2af-be298311ec22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:25.518738 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920c048-710c-42cc-b2af-be298311ec22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:25.529515 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920c048-710c-42cc-b2af-be298311ec22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:25.531105 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920c048-710c-42cc-b2af-be298311ec22 service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:25.541839 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1342/2683] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:28:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:28:25.564929 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7030f09-c8df-4b27-98c2-99ef8c4c5320 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:25.632512 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7030f09-c8df-4b27-98c2-99ef8c4c5320 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:25.637616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39d322-8fdd-4ebd-9cae-42d5b4f99f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:25.638567 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39d322-8fdd-4ebd-9cae-42d5b4f99f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:25.638958 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39d322-8fdd-4ebd-9cae-42d5b4f99f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:25.639281 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39d322-8fdd-4ebd-9cae-42d5b4f99f85 admin admin] PATH_INFO: `/v3/users/6bc146c635b34886b829e8e3f2bfe64f` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:25.640539 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39d322-8fdd-4ebd-9cae-42d5b4f99f85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bc146c635b34886b829e8e3f2bfe64f)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:25.642591 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39d322-8fdd-4ebd-9cae-42d5b4f99f85 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:25.817232 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-df39d322-8fdd-4ebd-9cae-42d5b4f99f85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bc146c635b34886b829e8e3f2bfe64f'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:25.877817 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-df39d322-8fdd-4ebd-9cae-42d5b4f99f85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bc146c635b34886b829e8e3f2bfe64f'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:25.878708 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-df39d322-8fdd-4ebd-9cae-42d5b4f99f85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bc146c635b34886b829e8e3f2bfe64f'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:25.891702 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-df39d322-8fdd-4ebd-9cae-42d5b4f99f85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bc146c635b34886b829e8e3f2bfe64f'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:25.900912 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-df39d322-8fdd-4ebd-9cae-42d5b4f99f85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bc146c635b34886b829e8e3f2bfe64f'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:25.912589 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1342/2684] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:28:25 2022] DELETE /identity/v3/users/6bc146c635b34886b829e8e3f2bfe64f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:28:25.915381 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b753e-7978-4262-bfd9-d22b62c1bf21 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:25.915381 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b753e-7978-4262-bfd9-d22b62c1bf21 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:25.915381 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b753e-7978-4262-bfd9-d22b62c1bf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:25.934745 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-653b753e-7978-4262-bfd9-d22b62c1bf21 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:25.935963 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-653b753e-7978-4262-bfd9-d22b62c1bf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:26.005749 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1343/2685] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:28:26.016477 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39d322-8fdd-4ebd-9cae-42d5b4f99f85 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:26.019721 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-df39d322-8fdd-4ebd-9cae-42d5b4f99f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:26.087014 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39d322-8fdd-4ebd-9cae-42d5b4f99f85 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:26.091131 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f002b1-fdee-4911-8dc4-fc03e22a9a45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:26.091601 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f002b1-fdee-4911-8dc4-fc03e22a9a45 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:26.091896 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f002b1-fdee-4911-8dc4-fc03e22a9a45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:26.092178 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f002b1-fdee-4911-8dc4-fc03e22a9a45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:26.103314 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f002b1-fdee-4911-8dc4-fc03e22a9a45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:26.106215 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f002b1-fdee-4911-8dc4-fc03e22a9a45 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:26.123152 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1343/2686] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:28:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:28:26.862152 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b753e-7978-4262-bfd9-d22b62c1bf21 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:26.862675 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-653b753e-7978-4262-bfd9-d22b62c1bf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:26.876980 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b753e-7978-4262-bfd9-d22b62c1bf21 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:26.882332 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f2c97-b142-49c1-8893-40ce36cb7a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:26.883483 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f2c97-b142-49c1-8893-40ce36cb7a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:26.886815 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f2c97-b142-49c1-8893-40ce36cb7a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:26.886815 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f2c97-b142-49c1-8893-40ce36cb7a5f admin admin] PATH_INFO: `/v3/projects/4b61304248e24d83868a43e02612542b` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:26.886815 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f2c97-b142-49c1-8893-40ce36cb7a5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b61304248e24d83868a43e02612542b)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:26.887143 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f2c97-b142-49c1-8893-40ce36cb7a5f admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:27.038404 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d60f2c97-b142-49c1-8893-40ce36cb7a5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b61304248e24d83868a43e02612542b', 'request_id': 'req-d60f2c97-b142-49c1-8893-40ce36cb7a5f'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:27.044856 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d60f2c97-b142-49c1-8893-40ce36cb7a5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b61304248e24d83868a43e02612542b', 'request_id': 'req-d60f2c97-b142-49c1-8893-40ce36cb7a5f'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:27.052813 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d60f2c97-b142-49c1-8893-40ce36cb7a5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b61304248e24d83868a43e02612542b', 'request_id': 'req-d60f2c97-b142-49c1-8893-40ce36cb7a5f'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:27.147361 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d60f2c97-b142-49c1-8893-40ce36cb7a5f admin admin] The token cache is being invalidate because project 4b61304248e24d83868a43e02612542b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:28:27.147774 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d60f2c97-b142-49c1-8893-40ce36cb7a5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:27.148366 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d60f2c97-b142-49c1-8893-40ce36cb7a5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:27.150186 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1344/2687] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:28:26 2022] DELETE /identity/v3/projects/4b61304248e24d83868a43e02612542b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:28:27.155527 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df92d1-cf7f-4573-9c03-a1c2e66855ce None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:27.156133 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df92d1-cf7f-4573-9c03-a1c2e66855ce None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:27.156133 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df92d1-cf7f-4573-9c03-a1c2e66855ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:27.177617 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-58df92d1-cf7f-4573-9c03-a1c2e66855ce None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:27.177617 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-58df92d1-cf7f-4573-9c03-a1c2e66855ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:27.244699 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1344/2688] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:28:27.261084 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ccf3d-67e6-46ad-bd78-4fc73fd7dc67 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:27.261545 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ccf3d-67e6-46ad-bd78-4fc73fd7dc67 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:27.262187 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ccf3d-67e6-46ad-bd78-4fc73fd7dc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:27.293142 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-5c3ccf3d-67e6-46ad-bd78-4fc73fd7dc67 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:27.294534 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-5c3ccf3d-67e6-46ad-bd78-4fc73fd7dc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:27.303989 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1345/2689] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:28:27.308379 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df92d1-cf7f-4573-9c03-a1c2e66855ce None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:27.319196 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df92d1-cf7f-4573-9c03-a1c2e66855ce None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:27.323988 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3cb282-3c3e-4986-b457-147e40ecf119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:27.324656 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cb282-3c3e-4986-b457-147e40ecf119 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:27.324946 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cb282-3c3e-4986-b457-147e40ecf119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:27.325227 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cb282-3c3e-4986-b457-147e40ecf119 admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:27.326003 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3cb282-3c3e-4986-b457-147e40ecf119 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:28:27.326319 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3cb282-3c3e-4986-b457-147e40ecf119 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:27.327968 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3cb282-3c3e-4986-b457-147e40ecf119 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:27.340872 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1345/2690] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:28:27.345538 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ccf3d-67e6-46ad-bd78-4fc73fd7dc67 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:27.356585 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ccf3d-67e6-46ad-bd78-4fc73fd7dc67 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:27.364485 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1209696-f4c8-4fd6-8682-563f3475768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:27.364485 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1209696-f4c8-4fd6-8682-563f3475768b admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:27.364485 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1209696-f4c8-4fd6-8682-563f3475768b admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:27.364485 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1209696-f4c8-4fd6-8682-563f3475768b admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:27.364904 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1209696-f4c8-4fd6-8682-563f3475768b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:27.365393 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1209696-f4c8-4fd6-8682-563f3475768b admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:27.443429 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1346/2691] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:28:27 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:28:27.444729 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3cb282-3c3e-4986-b457-147e40ecf119 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:27.455307 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3cb282-3c3e-4986-b457-147e40ecf119 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:27.515961 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22324f-69d4-4aba-95fe-bc4268940985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:27.516635 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22324f-69d4-4aba-95fe-bc4268940985 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:27.516922 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22324f-69d4-4aba-95fe-bc4268940985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:27.517201 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22324f-69d4-4aba-95fe-bc4268940985 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:27.517925 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22324f-69d4-4aba-95fe-bc4268940985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:27.519822 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22324f-69d4-4aba-95fe-bc4268940985 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:27.608682 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1346/2692] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:28:27 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:28:27.610257 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1209696-f4c8-4fd6-8682-563f3475768b admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:27.620894 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1209696-f4c8-4fd6-8682-563f3475768b admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:27.625572 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8a3a9-a3de-4243-8a9f-da835aa1a437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:27.626237 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8a3a9-a3de-4243-8a9f-da835aa1a437 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:27.626527 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8a3a9-a3de-4243-8a9f-da835aa1a437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:27.626812 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8a3a9-a3de-4243-8a9f-da835aa1a437 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:27.627541 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8a3a9-a3de-4243-8a9f-da835aa1a437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:27.629131 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8a3a9-a3de-4243-8a9f-da835aa1a437 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:27.640020 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1347/2693] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:28:27.643966 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22324f-69d4-4aba-95fe-bc4268940985 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:27.654876 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22324f-69d4-4aba-95fe-bc4268940985 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:27.659503 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc9d5a-911c-4ee6-a32a-ac33a1d5a0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:27.660157 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc9d5a-911c-4ee6-a32a-ac33a1d5a0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:27.660488 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc9d5a-911c-4ee6-a32a-ac33a1d5a0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:27.661108 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc9d5a-911c-4ee6-a32a-ac33a1d5a0f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:27.661865 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc9d5a-911c-4ee6-a32a-ac33a1d5a0f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:27.663493 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc9d5a-911c-4ee6-a32a-ac33a1d5a0f4 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:27.673360 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1347/2694] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:28:27.677694 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8a3a9-a3de-4243-8a9f-da835aa1a437 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:27.687597 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8a3a9-a3de-4243-8a9f-da835aa1a437 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:27.694070 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02671421-0e23-41a1-9e50-8e23aa3da79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:27.694953 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02671421-0e23-41a1-9e50-8e23aa3da79f admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:27.695232 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02671421-0e23-41a1-9e50-8e23aa3da79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:27.699128 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02671421-0e23-41a1-9e50-8e23aa3da79f admin admin] PATH_INFO: `/v3/projects/483d21168a424982bf0b1596c84894e4/users/05bc4e38dab34540b555b3fd7536c7f1/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:27.712150 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02671421-0e23-41a1-9e50-8e23aa3da79f admin admin] RBAC: Authorizing `identity:create_grant(project_id=483d21168a424982bf0b1596c84894e4, user_id=05bc4e38dab34540b555b3fd7536c7f1, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:27.715054 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02671421-0e23-41a1-9e50-8e23aa3da79f admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:27.815619 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1348/2695] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:28:27 2022] PUT /identity/v3/projects/483d21168a424982bf0b1596c84894e4/users/05bc4e38dab34540b555b3fd7536c7f1/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:28:27.828436 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cc53c-47ae-4120-8904-cbf297e5cc39 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:27.828797 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cc53c-47ae-4120-8904-cbf297e5cc39 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:27.829045 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cc53c-47ae-4120-8904-cbf297e5cc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:27.857979 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-5f7cc53c-47ae-4120-8904-cbf297e5cc39 None None] MFA Rules not processed for user `05bc4e38dab34540b555b3fd7536c7f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:27.859409 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-5f7cc53c-47ae-4120-8904-cbf297e5cc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:27.933622 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1348/2696] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:28:27.945572 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02671421-0e23-41a1-9e50-8e23aa3da79f admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:27.947400 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-02671421-0e23-41a1-9e50-8e23aa3da79f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:28.006163 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02671421-0e23-41a1-9e50-8e23aa3da79f admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:28.012328 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca31214-3d51-4bde-8468-d6c81245a793 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:28.012439 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca31214-3d51-4bde-8468-d6c81245a793 service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:28.012807 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca31214-3d51-4bde-8468-d6c81245a793 service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:28.012922 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca31214-3d51-4bde-8468-d6c81245a793 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:28.022990 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca31214-3d51-4bde-8468-d6c81245a793 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:28.024448 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca31214-3d51-4bde-8468-d6c81245a793 service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:28.033563 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1349/2697] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:28:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:28:30.332188 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf024975-035c-4b37-8ee3-3f9afc8b3349 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:30.332662 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf024975-035c-4b37-8ee3-3f9afc8b3349 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:30.334385 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf024975-035c-4b37-8ee3-3f9afc8b3349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:30.353093 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-cf024975-035c-4b37-8ee3-3f9afc8b3349 None None] MFA Rules not processed for user `756b474793a84ca9af8702de02434af9`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:30.354341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-cf024975-035c-4b37-8ee3-3f9afc8b3349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:30.414557 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1349/2698] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:28:32.072595 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca31214-3d51-4bde-8468-d6c81245a793 service cinder] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:32.137605 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca31214-3d51-4bde-8468-d6c81245a793 service cinder] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:32.143669 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee14ec-fb3c-42b7-838f-bf7b5e84de32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:32.144563 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee14ec-fb3c-42b7-838f-bf7b5e84de32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:32.144839 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee14ec-fb3c-42b7-838f-bf7b5e84de32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:32.145315 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee14ec-fb3c-42b7-838f-bf7b5e84de32 admin admin] PATH_INFO: `/v3/users/05bc4e38dab34540b555b3fd7536c7f1` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:32.147161 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee14ec-fb3c-42b7-838f-bf7b5e84de32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05bc4e38dab34540b555b3fd7536c7f1)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:32.149855 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee14ec-fb3c-42b7-838f-bf7b5e84de32 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:32.438701 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9fee14ec-fb3c-42b7-838f-bf7b5e84de32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05bc4e38dab34540b555b3fd7536c7f1'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:32.534609 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9fee14ec-fb3c-42b7-838f-bf7b5e84de32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05bc4e38dab34540b555b3fd7536c7f1'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:32.535712 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9fee14ec-fb3c-42b7-838f-bf7b5e84de32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05bc4e38dab34540b555b3fd7536c7f1'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:32.537069 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9fee14ec-fb3c-42b7-838f-bf7b5e84de32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05bc4e38dab34540b555b3fd7536c7f1'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:32.549585 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9fee14ec-fb3c-42b7-838f-bf7b5e84de32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05bc4e38dab34540b555b3fd7536c7f1'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:32.580062 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1350/2699] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:28:32 2022] DELETE /identity/v3/users/05bc4e38dab34540b555b3fd7536c7f1 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:28:32.586800 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c360fee-d024-4ed5-9356-048636eae091 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:32.599391 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c360fee-d024-4ed5-9356-048636eae091 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:32.599391 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c360fee-d024-4ed5-9356-048636eae091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:32.616034 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-9c360fee-d024-4ed5-9356-048636eae091 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:32.618123 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9c360fee-d024-4ed5-9356-048636eae091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:32.680410 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee14ec-fb3c-42b7-838f-bf7b5e84de32 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:32.681911 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-9fee14ec-fb3c-42b7-838f-bf7b5e84de32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:32.709421 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1350/2700] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:28:32.716947 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c360fee-d024-4ed5-9356-048636eae091 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:32.976200 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9c360fee-d024-4ed5-9356-048636eae091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:32.976343 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee14ec-fb3c-42b7-838f-bf7b5e84de32 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:32.976343 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a22240-6e15-4e2a-9420-ceb3e9b5d921 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef0001e91524a13a9ca601a601de66b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:32.976343 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a22240-6e15-4e2a-9420-ceb3e9b5d921 service placement] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:32.976343 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a22240-6e15-4e2a-9420-ceb3e9b5d921 service placement] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:32.976779 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a22240-6e15-4e2a-9420-ceb3e9b5d921 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:32.976779 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-63a22240-6e15-4e2a-9420-ceb3e9b5d921 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:32.977000 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c360fee-d024-4ed5-9356-048636eae091 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:32.977096 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a22240-6e15-4e2a-9420-ceb3e9b5d921 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:32.977187 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c60333-61f4-41cb-b0b7-cc8df97eead6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:32.977329 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a22240-6e15-4e2a-9420-ceb3e9b5d921 service placement] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:32.977441 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c60333-61f4-41cb-b0b7-cc8df97eead6 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:32.977441 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c60333-61f4-41cb-b0b7-cc8df97eead6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:32.977441 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c60333-61f4-41cb-b0b7-cc8df97eead6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:32.977682 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1351/2701] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:28:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:28:32.977772 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c60333-61f4-41cb-b0b7-cc8df97eead6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:32.977772 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c60333-61f4-41cb-b0b7-cc8df97eead6 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:32.977772 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1351/2702] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:28:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:28:33.656127 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a22240-6e15-4e2a-9420-ceb3e9b5d921 service placement] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:33.657633 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-63a22240-6e15-4e2a-9420-ceb3e9b5d921 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:33.680633 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a22240-6e15-4e2a-9420-ceb3e9b5d921 service placement] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:33.685695 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5d8f7-f34b-44f0-bfb6-e27eb8dfd035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:33.686524 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5d8f7-f34b-44f0-bfb6-e27eb8dfd035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:33.686802 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5d8f7-f34b-44f0-bfb6-e27eb8dfd035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:33.687084 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5d8f7-f34b-44f0-bfb6-e27eb8dfd035 admin admin] PATH_INFO: `/v3/projects/483d21168a424982bf0b1596c84894e4` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:33.688298 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5d8f7-f34b-44f0-bfb6-e27eb8dfd035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=483d21168a424982bf0b1596c84894e4)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:33.690551 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5d8f7-f34b-44f0-bfb6-e27eb8dfd035 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:33.805531 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-10c5d8f7-f34b-44f0-bfb6-e27eb8dfd035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '483d21168a424982bf0b1596c84894e4', 'request_id': 'req-10c5d8f7-f34b-44f0-bfb6-e27eb8dfd035'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:33.811965 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-10c5d8f7-f34b-44f0-bfb6-e27eb8dfd035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '483d21168a424982bf0b1596c84894e4', 'request_id': 'req-10c5d8f7-f34b-44f0-bfb6-e27eb8dfd035'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:33.819897 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-10c5d8f7-f34b-44f0-bfb6-e27eb8dfd035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '483d21168a424982bf0b1596c84894e4', 'request_id': 'req-10c5d8f7-f34b-44f0-bfb6-e27eb8dfd035'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:33.954789 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-10c5d8f7-f34b-44f0-bfb6-e27eb8dfd035 admin admin] The token cache is being invalidate because project 483d21168a424982bf0b1596c84894e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:28:33.955251 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-10c5d8f7-f34b-44f0-bfb6-e27eb8dfd035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:33.956237 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-10c5d8f7-f34b-44f0-bfb6-e27eb8dfd035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:28:33.958836 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1352/2703] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:28:33 2022] DELETE /identity/v3/projects/483d21168a424982bf0b1596c84894e4 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:28:33.965863 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f9672-9e96-4e38-8968-c0224fe5b7be None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:33.966657 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f9672-9e96-4e38-8968-c0224fe5b7be None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:33.966657 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f9672-9e96-4e38-8968-c0224fe5b7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:33.993059 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-f87f9672-9e96-4e38-8968-c0224fe5b7be None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:33.995193 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-f87f9672-9e96-4e38-8968-c0224fe5b7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:34.084483 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1352/2704] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:28:34.093042 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bf33c-b091-4ac4-92f0-07de996fcc5c None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:34.093395 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bf33c-b091-4ac4-92f0-07de996fcc5c None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:34.093683 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bf33c-b091-4ac4-92f0-07de996fcc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:34.114221 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-e61bf33c-b091-4ac4-92f0-07de996fcc5c None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:34.115550 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e61bf33c-b091-4ac4-92f0-07de996fcc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:34.124056 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1353/2705] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:28:34.130049 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f9672-9e96-4e38-8968-c0224fe5b7be None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:34.142829 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f9672-9e96-4e38-8968-c0224fe5b7be None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:34.148336 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e216a9c-3bdb-4568-90b7-b26138ff8d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:34.149044 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e216a9c-3bdb-4568-90b7-b26138ff8d1c admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:34.149361 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e216a9c-3bdb-4568-90b7-b26138ff8d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:34.149645 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e216a9c-3bdb-4568-90b7-b26138ff8d1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:34.150375 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e216a9c-3bdb-4568-90b7-b26138ff8d1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:28:34.150684 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e216a9c-3bdb-4568-90b7-b26138ff8d1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:34.152306 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e216a9c-3bdb-4568-90b7-b26138ff8d1c admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:34.167053 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1353/2706] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:28:34.171372 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bf33c-b091-4ac4-92f0-07de996fcc5c None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:34.180832 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bf33c-b091-4ac4-92f0-07de996fcc5c None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:34.185918 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1461674-a1eb-48c0-8f63-2ae130a5d836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:34.186527 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1461674-a1eb-48c0-8f63-2ae130a5d836 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:34.186809 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1461674-a1eb-48c0-8f63-2ae130a5d836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:34.187079 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1461674-a1eb-48c0-8f63-2ae130a5d836 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:34.187808 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1461674-a1eb-48c0-8f63-2ae130a5d836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:34.189760 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1461674-a1eb-48c0-8f63-2ae130a5d836 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:34.554208 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1354/2707] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:28:34 2022] POST /identity/v3/projects => generated 373 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:28:34.568566 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e216a9c-3bdb-4568-90b7-b26138ff8d1c admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:34.570642 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e216a9c-3bdb-4568-90b7-b26138ff8d1c admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:34.636640 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f5428-a3e8-4fc4-9cb7-def0867ae502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:34.637352 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f5428-a3e8-4fc4-9cb7-def0867ae502 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:34.637654 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f5428-a3e8-4fc4-9cb7-def0867ae502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:34.637929 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f5428-a3e8-4fc4-9cb7-def0867ae502 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:34.638628 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f5428-a3e8-4fc4-9cb7-def0867ae502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:34.640602 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f5428-a3e8-4fc4-9cb7-def0867ae502 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:34.812287 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1354/2708] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:28:34 2022] POST /identity/v3/users => generated 287 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:28:34.821180 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1461674-a1eb-48c0-8f63-2ae130a5d836 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:34.837930 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1461674-a1eb-48c0-8f63-2ae130a5d836 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:34.844849 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672821b0-f9ec-486c-af22-fb9b55d9e2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:34.845841 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672821b0-f9ec-486c-af22-fb9b55d9e2ea admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:34.846207 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672821b0-f9ec-486c-af22-fb9b55d9e2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:34.846621 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672821b0-f9ec-486c-af22-fb9b55d9e2ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:34.847304 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672821b0-f9ec-486c-af22-fb9b55d9e2ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:34.848937 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672821b0-f9ec-486c-af22-fb9b55d9e2ea admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:34.860727 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1355/2709] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:28:34.865597 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f5428-a3e8-4fc4-9cb7-def0867ae502 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:34.877699 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f5428-a3e8-4fc4-9cb7-def0867ae502 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:34.884599 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef0075-588c-4e9d-916d-8baa86466da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:34.885322 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef0075-588c-4e9d-916d-8baa86466da4 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:34.885630 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef0075-588c-4e9d-916d-8baa86466da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:34.885916 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef0075-588c-4e9d-916d-8baa86466da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:34.886665 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef0075-588c-4e9d-916d-8baa86466da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:34.888291 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef0075-588c-4e9d-916d-8baa86466da4 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:34.900886 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1355/2710] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:28:34.904945 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672821b0-f9ec-486c-af22-fb9b55d9e2ea admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:34.916981 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672821b0-f9ec-486c-af22-fb9b55d9e2ea admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:34.922087 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23377e0b-808a-48a2-95a2-93e62570b982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:34.927919 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23377e0b-808a-48a2-95a2-93e62570b982 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:34.927919 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23377e0b-808a-48a2-95a2-93e62570b982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:34.927919 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23377e0b-808a-48a2-95a2-93e62570b982 admin admin] PATH_INFO: `/v3/projects/125a4588eae64753b68d99d00abf90db/users/2f810099eab945f882c9cfa30b98d27b/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:34.952950 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23377e0b-808a-48a2-95a2-93e62570b982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=125a4588eae64753b68d99d00abf90db, user_id=2f810099eab945f882c9cfa30b98d27b, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:34.958563 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23377e0b-808a-48a2-95a2-93e62570b982 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:35.136403 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1356/2711] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:28:34 2022] PUT /identity/v3/projects/125a4588eae64753b68d99d00abf90db/users/2f810099eab945f882c9cfa30b98d27b/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:28:35.142318 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe58b8-da1b-4064-9ba7-e4a90a261425 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:35.142918 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe58b8-da1b-4064-9ba7-e4a90a261425 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:35.142918 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe58b8-da1b-4064-9ba7-e4a90a261425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:35.165273 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-9fbe58b8-da1b-4064-9ba7-e4a90a261425 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:35.166582 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9fbe58b8-da1b-4064-9ba7-e4a90a261425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:35.238400 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1356/2712] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:28:35.249171 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23377e0b-808a-48a2-95a2-93e62570b982 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:35.251409 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-23377e0b-808a-48a2-95a2-93e62570b982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:35.339135 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23377e0b-808a-48a2-95a2-93e62570b982 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:35.345027 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b1c69-5545-44d6-8ec2-34fa3a6cf13d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:35.345853 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b1c69-5545-44d6-8ec2-34fa3a6cf13d service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:35.346365 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b1c69-5545-44d6-8ec2-34fa3a6cf13d service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:35.346729 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b1c69-5545-44d6-8ec2-34fa3a6cf13d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:35.366259 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b1c69-5545-44d6-8ec2-34fa3a6cf13d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:35.370253 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b1c69-5545-44d6-8ec2-34fa3a6cf13d service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:35.391428 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1357/2713] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:28:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:28:37.448668 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f8a0c-9ae1-446f-b780-7601874e4ed8 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:37.449259 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f8a0c-9ae1-446f-b780-7601874e4ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:37.449259 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f8a0c-9ae1-446f-b780-7601874e4ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:37.484486 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-3f8f8a0c-9ae1-446f-b780-7601874e4ed8 None None] MFA Rules not processed for user `2f810099eab945f882c9cfa30b98d27b`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:37.486230 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-3f8f8a0c-9ae1-446f-b780-7601874e4ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:37.581568 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1357/2714] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:28:37.595609 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b1c69-5545-44d6-8ec2-34fa3a6cf13d service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:28:37.598296 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-1d3b1c69-5545-44d6-8ec2-34fa3a6cf13d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:37.666825 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b1c69-5545-44d6-8ec2-34fa3a6cf13d service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:28:37.676720 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45723684-55bb-4503-a7ad-ed9c2755a337 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:28:37.676720 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45723684-55bb-4503-a7ad-ed9c2755a337 service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:37.676720 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45723684-55bb-4503-a7ad-ed9c2755a337 service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:37.676720 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45723684-55bb-4503-a7ad-ed9c2755a337 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:37.683052 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45723684-55bb-4503-a7ad-ed9c2755a337 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:28:37.684530 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45723684-55bb-4503-a7ad-ed9c2755a337 service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:28:37.696276 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1358/2715] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:28:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:28:39.531465 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60779fc-0971-4c56-a006-7145e7021b36 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:39.532217 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60779fc-0971-4c56-a006-7145e7021b36 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:39.532217 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60779fc-0971-4c56-a006-7145e7021b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:39.552945 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-c60779fc-0971-4c56-a006-7145e7021b36 None None] MFA Rules not processed for user `2f810099eab945f882c9cfa30b98d27b`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:39.554451 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-c60779fc-0971-4c56-a006-7145e7021b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:39.562839 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1358/2716] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:28:58.552073 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a71403-f793-4efe-a9ea-93b7fa0c7553 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:28:58.552964 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a71403-f793-4efe-a9ea-93b7fa0c7553 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:28:58.552964 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a71403-f793-4efe-a9ea-93b7fa0c7553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:28:58.574061 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-c5a71403-f793-4efe-a9ea-93b7fa0c7553 None None] MFA Rules not processed for user `2f810099eab945f882c9cfa30b98d27b`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:28:58.575359 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-c5a71403-f793-4efe-a9ea-93b7fa0c7553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:28:58.582683 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1359/2717] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:28:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:29:20.030552 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a82a45-379c-46b1-949f-c2392e92b539 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:20.033743 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a82a45-379c-46b1-949f-c2392e92b539 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:20.033743 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a82a45-379c-46b1-949f-c2392e92b539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:20.051112 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-18a82a45-379c-46b1-949f-c2392e92b539 None None] MFA Rules not processed for user `a706b6d0163549bc80285c4158331b94`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:29:20.052329 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-18a82a45-379c-46b1-949f-c2392e92b539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:29:20.115589 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1359/2718] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Mar 29 20:29:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:29:20.266217 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a71403-f793-4efe-a9ea-93b7fa0c7553 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:29:20.268119 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-c5a71403-f793-4efe-a9ea-93b7fa0c7553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:29:20.367854 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a71403-f793-4efe-a9ea-93b7fa0c7553 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:29:20.373305 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc54ed-d0e9-4c90-82c6-38a3c763261c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d6d8e7788494f2c92ad5c183c8fa283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:29:20.373985 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc54ed-d0e9-4c90-82c6-38a3c763261c service swift] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:20.374277 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc54ed-d0e9-4c90-82c6-38a3c763261c service swift] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:20.374562 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc54ed-d0e9-4c90-82c6-38a3c763261c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:20.383541 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc54ed-d0e9-4c90-82c6-38a3c763261c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:29:20.385795 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc54ed-d0e9-4c90-82c6-38a3c763261c service swift] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:29:20.395477 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1360/2719] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Mar 29 20:29:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 20:29:37.867887 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba3c96-9e00-4e00-88e0-f95afd4b517e None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:37.868409 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba3c96-9e00-4e00-88e0-f95afd4b517e None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:37.868684 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba3c96-9e00-4e00-88e0-f95afd4b517e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:37.888436 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-d3ba3c96-9e00-4e00-88e0-f95afd4b517e None None] MFA Rules not processed for user `a706b6d0163549bc80285c4158331b94`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:29:37.889786 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-d3ba3c96-9e00-4e00-88e0-f95afd4b517e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:29:37.897693 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1360/2720] 10.222.0.43 () {58 vars in 967 bytes} [Tue Mar 29 20:29:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:29:37.910098 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc54ed-d0e9-4c90-82c6-38a3c763261c service swift] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:29:37.922142 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc54ed-d0e9-4c90-82c6-38a3c763261c service swift] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:29:37.927755 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397aa73-a0aa-422b-bb26-21c9fcf0412d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d6d8e7788494f2c92ad5c183c8fa283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:29:37.928596 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397aa73-a0aa-422b-bb26-21c9fcf0412d service swift] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:37.929103 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397aa73-a0aa-422b-bb26-21c9fcf0412d service swift] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:37.929504 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397aa73-a0aa-422b-bb26-21c9fcf0412d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:37.939833 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397aa73-a0aa-422b-bb26-21c9fcf0412d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:29:37.944784 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397aa73-a0aa-422b-bb26-21c9fcf0412d service swift] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:29:37.951419 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1361/2721] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Mar 29 20:29:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 29 20:29:41.313751 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba3c96-9e00-4e00-88e0-f95afd4b517e None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:29:41.332149 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba3c96-9e00-4e00-88e0-f95afd4b517e None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:29:41.337183 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43001fb6-ffde-478c-b64f-1a4060cea8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:29:41.338341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43001fb6-ffde-478c-b64f-1a4060cea8e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:41.338779 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43001fb6-ffde-478c-b64f-1a4060cea8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:41.339063 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43001fb6-ffde-478c-b64f-1a4060cea8e0 admin admin] PATH_INFO: `/v3/users/2f810099eab945f882c9cfa30b98d27b` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:41.340480 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43001fb6-ffde-478c-b64f-1a4060cea8e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f810099eab945f882c9cfa30b98d27b)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:29:41.342726 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43001fb6-ffde-478c-b64f-1a4060cea8e0 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:29:41.560256 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-43001fb6-ffde-478c-b64f-1a4060cea8e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f810099eab945f882c9cfa30b98d27b'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:29:41.648202 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-43001fb6-ffde-478c-b64f-1a4060cea8e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f810099eab945f882c9cfa30b98d27b'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:29:41.648928 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-43001fb6-ffde-478c-b64f-1a4060cea8e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f810099eab945f882c9cfa30b98d27b'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:29:41.657333 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-43001fb6-ffde-478c-b64f-1a4060cea8e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f810099eab945f882c9cfa30b98d27b'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:29:41.669929 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-43001fb6-ffde-478c-b64f-1a4060cea8e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f810099eab945f882c9cfa30b98d27b'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:29:41.675913 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1361/2722] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:29:41 2022] DELETE /identity/v3/users/2f810099eab945f882c9cfa30b98d27b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:29:41.947251 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397aa73-a0aa-422b-bb26-21c9fcf0412d service swift] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:29:41.961544 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397aa73-a0aa-422b-bb26-21c9fcf0412d service swift] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:29:42.028885 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35dd1e6-4bab-4e7a-9245-6de7897f9893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:29:42.029888 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dd1e6-4bab-4e7a-9245-6de7897f9893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:42.030180 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dd1e6-4bab-4e7a-9245-6de7897f9893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:42.030464 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dd1e6-4bab-4e7a-9245-6de7897f9893 admin admin] PATH_INFO: `/v3/projects/125a4588eae64753b68d99d00abf90db` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:42.031668 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35dd1e6-4bab-4e7a-9245-6de7897f9893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=125a4588eae64753b68d99d00abf90db)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:29:42.033737 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35dd1e6-4bab-4e7a-9245-6de7897f9893 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:29:42.164249 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d35dd1e6-4bab-4e7a-9245-6de7897f9893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '125a4588eae64753b68d99d00abf90db', 'request_id': 'req-d35dd1e6-4bab-4e7a-9245-6de7897f9893'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:29:42.170723 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d35dd1e6-4bab-4e7a-9245-6de7897f9893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '125a4588eae64753b68d99d00abf90db', 'request_id': 'req-d35dd1e6-4bab-4e7a-9245-6de7897f9893'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:29:42.177012 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d35dd1e6-4bab-4e7a-9245-6de7897f9893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '125a4588eae64753b68d99d00abf90db', 'request_id': 'req-d35dd1e6-4bab-4e7a-9245-6de7897f9893'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:29:42.260707 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d35dd1e6-4bab-4e7a-9245-6de7897f9893 admin admin] The token cache is being invalidate because project 125a4588eae64753b68d99d00abf90db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:29:42.261818 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d35dd1e6-4bab-4e7a-9245-6de7897f9893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:29:42.262488 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d35dd1e6-4bab-4e7a-9245-6de7897f9893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:29:42.264028 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1362/2723] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:29:41 2022] DELETE /identity/v3/projects/125a4588eae64753b68d99d00abf90db => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:29:42.268978 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee56427-d4b9-4465-9b87-e6f6c54726eb None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:42.269342 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee56427-d4b9-4465-9b87-e6f6c54726eb None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:42.269572 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee56427-d4b9-4465-9b87-e6f6c54726eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:42.289163 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-2ee56427-d4b9-4465-9b87-e6f6c54726eb None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:29:42.295377 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-2ee56427-d4b9-4465-9b87-e6f6c54726eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:29:42.357347 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1362/2724] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:29:42.365041 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74416e08-8fe3-4a80-9b63-d3f3a43c713f None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:42.365492 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74416e08-8fe3-4a80-9b63-d3f3a43c713f None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:42.365777 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74416e08-8fe3-4a80-9b63-d3f3a43c713f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:42.385919 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-74416e08-8fe3-4a80-9b63-d3f3a43c713f None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:29:42.387123 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-74416e08-8fe3-4a80-9b63-d3f3a43c713f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:29:42.395447 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1363/2725] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:29:42.399894 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee56427-d4b9-4465-9b87-e6f6c54726eb None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:29:42.410483 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee56427-d4b9-4465-9b87-e6f6c54726eb None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:29:42.415170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea1f22-a7c1-436d-abe1-be09815429f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:29:42.415823 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea1f22-a7c1-436d-abe1-be09815429f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:42.416110 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea1f22-a7c1-436d-abe1-be09815429f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:42.416389 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea1f22-a7c1-436d-abe1-be09815429f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:42.417316 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea1f22-a7c1-436d-abe1-be09815429f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:29:42.417632 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea1f22-a7c1-436d-abe1-be09815429f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:29:42.419231 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea1f22-a7c1-436d-abe1-be09815429f6 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:29:42.431038 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1363/2726] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:29:42.435668 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74416e08-8fe3-4a80-9b63-d3f3a43c713f None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:29:42.445634 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74416e08-8fe3-4a80-9b63-d3f3a43c713f None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:29:42.451800 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7f275-5ec6-490d-b8ef-22536e3ddcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:29:42.452476 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7f275-5ec6-490d-b8ef-22536e3ddcac admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:42.452768 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7f275-5ec6-490d-b8ef-22536e3ddcac admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:42.453051 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7f275-5ec6-490d-b8ef-22536e3ddcac admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:42.453816 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7f275-5ec6-490d-b8ef-22536e3ddcac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:29:42.455731 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7f275-5ec6-490d-b8ef-22536e3ddcac admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:29:42.633148 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1364/2727] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:29:42 2022] POST /identity/v3/projects => generated 375 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:29:42.640765 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea1f22-a7c1-436d-abe1-be09815429f6 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:29:42.650686 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea1f22-a7c1-436d-abe1-be09815429f6 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:29:42.707567 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12904cd-8c01-4c32-b1eb-105d5d989d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:29:42.708295 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12904cd-8c01-4c32-b1eb-105d5d989d15 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:42.708584 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12904cd-8c01-4c32-b1eb-105d5d989d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:42.708865 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12904cd-8c01-4c32-b1eb-105d5d989d15 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:42.709613 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12904cd-8c01-4c32-b1eb-105d5d989d15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:29:42.711532 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12904cd-8c01-4c32-b1eb-105d5d989d15 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:29:42.814714 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1364/2728] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:29:42 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:29:42.819086 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7f275-5ec6-490d-b8ef-22536e3ddcac admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:29:42.831946 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7f275-5ec6-490d-b8ef-22536e3ddcac admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:29:42.835328 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab425bb-15b4-41ec-8af4-146a21ecaad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:29:42.836013 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab425bb-15b4-41ec-8af4-146a21ecaad9 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:42.836303 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab425bb-15b4-41ec-8af4-146a21ecaad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:42.836586 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab425bb-15b4-41ec-8af4-146a21ecaad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:42.837374 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab425bb-15b4-41ec-8af4-146a21ecaad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:29:42.839173 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab425bb-15b4-41ec-8af4-146a21ecaad9 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:29:42.850360 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1365/2729] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:29:42.854573 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12904cd-8c01-4c32-b1eb-105d5d989d15 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:29:42.866362 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12904cd-8c01-4c32-b1eb-105d5d989d15 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:29:42.871027 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd257861-dea7-4727-b40c-4998733552a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:29:42.872780 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd257861-dea7-4727-b40c-4998733552a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:42.872780 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd257861-dea7-4727-b40c-4998733552a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:42.873006 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd257861-dea7-4727-b40c-4998733552a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:42.873708 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd257861-dea7-4727-b40c-4998733552a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:29:42.875405 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd257861-dea7-4727-b40c-4998733552a7 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:29:42.886410 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1365/2730] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:29:42.891015 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab425bb-15b4-41ec-8af4-146a21ecaad9 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:29:42.901120 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab425bb-15b4-41ec-8af4-146a21ecaad9 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:29:42.906536 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d92095-af93-4596-8e79-f89c484c6ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:29:42.907445 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d92095-af93-4596-8e79-f89c484c6ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:42.907738 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d92095-af93-4596-8e79-f89c484c6ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:42.908079 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d92095-af93-4596-8e79-f89c484c6ae8 admin admin] PATH_INFO: `/v3/projects/ee659ea4ed3148fb940abc70fe6b0200/users/4a34db3d18f841b0a8bc27df6a4daa79/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:42.923630 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d92095-af93-4596-8e79-f89c484c6ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee659ea4ed3148fb940abc70fe6b0200, user_id=4a34db3d18f841b0a8bc27df6a4daa79, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:29:42.926319 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d92095-af93-4596-8e79-f89c484c6ae8 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:29:43.037425 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1366/2731] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:29:42 2022] PUT /identity/v3/projects/ee659ea4ed3148fb940abc70fe6b0200/users/4a34db3d18f841b0a8bc27df6a4daa79/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:29:43.048339 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f0dbe-b55c-41ea-ab0e-a597c2ef0a3f None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:43.048638 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f0dbe-b55c-41ea-ab0e-a597c2ef0a3f None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:43.048948 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f0dbe-b55c-41ea-ab0e-a597c2ef0a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:43.079472 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-7b9f0dbe-b55c-41ea-ab0e-a597c2ef0a3f None None] MFA Rules not processed for user `4a34db3d18f841b0a8bc27df6a4daa79`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:29:43.080827 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-7b9f0dbe-b55c-41ea-ab0e-a597c2ef0a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:29:43.146748 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1366/2732] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:29:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:29:43.157606 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d92095-af93-4596-8e79-f89c484c6ae8 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:29:43.159327 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e8d92095-af93-4596-8e79-f89c484c6ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:29:43.216407 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d92095-af93-4596-8e79-f89c484c6ae8 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:29:43.220299 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2e234-4ee3-4342-90b4-e65651f8f831 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:29:43.220959 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2e234-4ee3-4342-90b4-e65651f8f831 service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:43.221247 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2e234-4ee3-4342-90b4-e65651f8f831 service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:43.221570 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2e234-4ee3-4342-90b4-e65651f8f831 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:43.231910 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2e234-4ee3-4342-90b4-e65651f8f831 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:29:43.233141 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2e234-4ee3-4342-90b4-e65651f8f831 service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:29:43.243106 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1367/2733] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:29:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:29:44.616189 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddb252-15ea-4234-a72e-31212be55564 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:44.616890 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddb252-15ea-4234-a72e-31212be55564 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:44.617603 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddb252-15ea-4234-a72e-31212be55564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:44.635606 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-d2ddb252-15ea-4234-a72e-31212be55564 None None] MFA Rules not processed for user `756b474793a84ca9af8702de02434af9`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:29:44.637031 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-d2ddb252-15ea-4234-a72e-31212be55564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:29:44.693427 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1367/2734] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:29:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:29:55.167408 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2e234-4ee3-4342-90b4-e65651f8f831 service cinder] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:29:55.229689 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2e234-4ee3-4342-90b4-e65651f8f831 service cinder] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:29:55.235136 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a586541-148a-420f-b778-f33acd8e7939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:29:55.236011 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a586541-148a-420f-b778-f33acd8e7939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:55.236299 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a586541-148a-420f-b778-f33acd8e7939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:55.236582 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a586541-148a-420f-b778-f33acd8e7939 admin admin] PATH_INFO: `/v3/users/4a34db3d18f841b0a8bc27df6a4daa79` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:55.237790 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a586541-148a-420f-b778-f33acd8e7939 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a34db3d18f841b0a8bc27df6a4daa79)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:29:55.239747 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a586541-148a-420f-b778-f33acd8e7939 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:29:55.428346 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9a586541-148a-420f-b778-f33acd8e7939 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a34db3d18f841b0a8bc27df6a4daa79'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:29:55.516692 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9a586541-148a-420f-b778-f33acd8e7939 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a34db3d18f841b0a8bc27df6a4daa79'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:29:55.517344 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9a586541-148a-420f-b778-f33acd8e7939 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a34db3d18f841b0a8bc27df6a4daa79'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:29:55.517962 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9a586541-148a-420f-b778-f33acd8e7939 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a34db3d18f841b0a8bc27df6a4daa79'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:29:55.525410 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-9a586541-148a-420f-b778-f33acd8e7939 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a34db3d18f841b0a8bc27df6a4daa79'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:29:55.545116 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1368/2735] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:29:55 2022] DELETE /identity/v3/users/4a34db3d18f841b0a8bc27df6a4daa79 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:29:55.551337 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b95af3-e8a9-4f5c-baac-fd51dcab57f5 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:55.552089 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b95af3-e8a9-4f5c-baac-fd51dcab57f5 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:55.555027 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b95af3-e8a9-4f5c-baac-fd51dcab57f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:55.576983 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-24b95af3-e8a9-4f5c-baac-fd51dcab57f5 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:29:55.578249 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-24b95af3-e8a9-4f5c-baac-fd51dcab57f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:29:55.639121 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1368/2736] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:29:55.649025 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a586541-148a-420f-b778-f33acd8e7939 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:29:55.658293 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-9a586541-148a-420f-b778-f33acd8e7939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:29:55.711209 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a586541-148a-420f-b778-f33acd8e7939 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:29:55.714792 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9a7f0-b395-48a5-8dd3-4355b38bba85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:29:55.715523 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9a7f0-b395-48a5-8dd3-4355b38bba85 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:55.715807 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9a7f0-b395-48a5-8dd3-4355b38bba85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:55.716084 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9a7f0-b395-48a5-8dd3-4355b38bba85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:55.725876 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb9a7f0-b395-48a5-8dd3-4355b38bba85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:29:55.727348 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb9a7f0-b395-48a5-8dd3-4355b38bba85 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:29:55.738875 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1369/2737] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:29:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:29:56.222167 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b95af3-e8a9-4f5c-baac-fd51dcab57f5 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:29:56.223634 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-24b95af3-e8a9-4f5c-baac-fd51dcab57f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:29:56.238298 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b95af3-e8a9-4f5c-baac-fd51dcab57f5 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:29:56.248701 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd401c-c78a-4f02-8953-b66a01aa25ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:29:56.250178 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd401c-c78a-4f02-8953-b66a01aa25ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:56.250487 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd401c-c78a-4f02-8953-b66a01aa25ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:56.250642 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd401c-c78a-4f02-8953-b66a01aa25ac admin admin] PATH_INFO: `/v3/projects/ee659ea4ed3148fb940abc70fe6b0200` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:56.252229 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd401c-c78a-4f02-8953-b66a01aa25ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee659ea4ed3148fb940abc70fe6b0200)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:29:56.254242 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd401c-c78a-4f02-8953-b66a01aa25ac admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:29:56.426793 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-23dd401c-c78a-4f02-8953-b66a01aa25ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee659ea4ed3148fb940abc70fe6b0200', 'request_id': 'req-23dd401c-c78a-4f02-8953-b66a01aa25ac'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:29:56.527798 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-23dd401c-c78a-4f02-8953-b66a01aa25ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee659ea4ed3148fb940abc70fe6b0200', 'request_id': 'req-23dd401c-c78a-4f02-8953-b66a01aa25ac'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:29:56.534476 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-23dd401c-c78a-4f02-8953-b66a01aa25ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee659ea4ed3148fb940abc70fe6b0200', 'request_id': 'req-23dd401c-c78a-4f02-8953-b66a01aa25ac'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:29:56.547033 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-23dd401c-c78a-4f02-8953-b66a01aa25ac admin admin] The token cache is being invalidate because project ee659ea4ed3148fb940abc70fe6b0200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:29:56.547329 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-23dd401c-c78a-4f02-8953-b66a01aa25ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:29:56.548073 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-23dd401c-c78a-4f02-8953-b66a01aa25ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:29:56.549663 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1369/2738] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:29:56 2022] DELETE /identity/v3/projects/ee659ea4ed3148fb940abc70fe6b0200 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:29:56.556912 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d9bf9-abcd-48e1-b01b-7c81ae52110c None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:56.556912 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d9bf9-abcd-48e1-b01b-7c81ae52110c None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:56.557672 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d9bf9-abcd-48e1-b01b-7c81ae52110c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:56.576924 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-9b7d9bf9-abcd-48e1-b01b-7c81ae52110c None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:29:56.578175 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-9b7d9bf9-abcd-48e1-b01b-7c81ae52110c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:29:56.638499 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1370/2739] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:29:56.646323 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87f027-ad24-497d-8055-9fbee42d800e None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:56.648482 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87f027-ad24-497d-8055-9fbee42d800e None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:56.648482 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87f027-ad24-497d-8055-9fbee42d800e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:56.665651 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-4e87f027-ad24-497d-8055-9fbee42d800e None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:29:56.666867 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-4e87f027-ad24-497d-8055-9fbee42d800e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:29:56.675335 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1370/2740] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:29:56.679644 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d9bf9-abcd-48e1-b01b-7c81ae52110c None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:29:56.690153 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d9bf9-abcd-48e1-b01b-7c81ae52110c None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:29:56.695288 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed0065-e4bc-4c16-9942-1558897faee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:29:56.695954 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed0065-e4bc-4c16-9942-1558897faee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:56.696248 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed0065-e4bc-4c16-9942-1558897faee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:56.696530 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed0065-e4bc-4c16-9942-1558897faee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:56.697897 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed0065-e4bc-4c16-9942-1558897faee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:29:56.698217 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed0065-e4bc-4c16-9942-1558897faee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:29:56.700381 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed0065-e4bc-4c16-9942-1558897faee5 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:29:56.712750 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1371/2741] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:29:56.717404 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87f027-ad24-497d-8055-9fbee42d800e None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:29:56.727344 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87f027-ad24-497d-8055-9fbee42d800e None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:29:56.733305 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8a18a-d809-4cc5-85de-a539d3668a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:29:56.734011 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8a18a-d809-4cc5-85de-a539d3668a51 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:56.734297 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8a18a-d809-4cc5-85de-a539d3668a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:56.734577 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8a18a-d809-4cc5-85de-a539d3668a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:56.735280 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8a18a-d809-4cc5-85de-a539d3668a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:29:56.737192 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8a18a-d809-4cc5-85de-a539d3668a51 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:29:56.873258 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1371/2742] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:29:56 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:29:56.877660 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed0065-e4bc-4c16-9942-1558897faee5 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:29:56.887866 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed0065-e4bc-4c16-9942-1558897faee5 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:29:56.943158 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff518848-4719-4682-bf98-402a33f2d131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:29:56.943843 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff518848-4719-4682-bf98-402a33f2d131 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:56.944127 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff518848-4719-4682-bf98-402a33f2d131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:56.944402 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff518848-4719-4682-bf98-402a33f2d131 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:56.945101 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff518848-4719-4682-bf98-402a33f2d131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:29:56.947074 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff518848-4719-4682-bf98-402a33f2d131 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:29:57.037161 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1372/2743] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:29:56 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:29:57.041722 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8a18a-d809-4cc5-85de-a539d3668a51 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:29:57.052624 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8a18a-d809-4cc5-85de-a539d3668a51 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:29:57.057445 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d18806-0284-40a9-990a-15f9fa569d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:29:57.058113 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d18806-0284-40a9-990a-15f9fa569d63 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:57.058402 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d18806-0284-40a9-990a-15f9fa569d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:57.058685 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d18806-0284-40a9-990a-15f9fa569d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:57.059541 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d18806-0284-40a9-990a-15f9fa569d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:29:57.061210 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d18806-0284-40a9-990a-15f9fa569d63 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:29:57.072543 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1372/2744] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:29:57.077577 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff518848-4719-4682-bf98-402a33f2d131 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:29:57.087962 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff518848-4719-4682-bf98-402a33f2d131 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:29:57.093844 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce011dc5-76db-4891-87f4-fc5d43dc2a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:29:57.094453 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce011dc5-76db-4891-87f4-fc5d43dc2a13 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:57.094783 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce011dc5-76db-4891-87f4-fc5d43dc2a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:57.095060 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce011dc5-76db-4891-87f4-fc5d43dc2a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:57.095795 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce011dc5-76db-4891-87f4-fc5d43dc2a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:29:57.097565 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce011dc5-76db-4891-87f4-fc5d43dc2a13 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:29:57.108916 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1373/2745] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:29:57.113078 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d18806-0284-40a9-990a-15f9fa569d63 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:29:57.125750 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d18806-0284-40a9-990a-15f9fa569d63 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:29:57.131323 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf831243-660d-44b5-a9ea-eba5038efb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:29:57.132218 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf831243-660d-44b5-a9ea-eba5038efb54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:57.132504 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf831243-660d-44b5-a9ea-eba5038efb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:57.132784 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf831243-660d-44b5-a9ea-eba5038efb54 admin admin] PATH_INFO: `/v3/projects/c2dcb93c78b744409bc8b0d8c5aa967d/users/3c7ebab7c96141118f263e658b9059d8/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:57.148926 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf831243-660d-44b5-a9ea-eba5038efb54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2dcb93c78b744409bc8b0d8c5aa967d, user_id=3c7ebab7c96141118f263e658b9059d8, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:29:57.151621 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf831243-660d-44b5-a9ea-eba5038efb54 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:29:57.243217 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1373/2746] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:29:57 2022] PUT /identity/v3/projects/c2dcb93c78b744409bc8b0d8c5aa967d/users/3c7ebab7c96141118f263e658b9059d8/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:29:57.250142 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e44fc-6dd3-4245-b057-e09cb368ed12 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:57.250142 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e44fc-6dd3-4245-b057-e09cb368ed12 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:57.250142 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e44fc-6dd3-4245-b057-e09cb368ed12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:57.271235 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-5d1e44fc-6dd3-4245-b057-e09cb368ed12 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:29:57.272460 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-5d1e44fc-6dd3-4245-b057-e09cb368ed12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:29:57.342814 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1374/2747] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:29:57.353497 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf831243-660d-44b5-a9ea-eba5038efb54 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:29:57.355564 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-bf831243-660d-44b5-a9ea-eba5038efb54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:29:57.419096 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf831243-660d-44b5-a9ea-eba5038efb54 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:29:57.423235 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19b09f-4270-4f08-b3fd-7c9ef7871a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:29:57.423901 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19b09f-4270-4f08-b3fd-7c9ef7871a7a service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:57.424194 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19b09f-4270-4f08-b3fd-7c9ef7871a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:57.424477 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19b09f-4270-4f08-b3fd-7c9ef7871a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:57.434397 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19b09f-4270-4f08-b3fd-7c9ef7871a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:29:57.436389 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19b09f-4270-4f08-b3fd-7c9ef7871a7a service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:29:57.447726 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1374/2748] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:29:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:29:59.180277 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe6464-d7a3-4bd5-a70c-848512ffa3d6 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:59.180835 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe6464-d7a3-4bd5-a70c-848512ffa3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:59.180835 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe6464-d7a3-4bd5-a70c-848512ffa3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:59.219126 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-ddfe6464-d7a3-4bd5-a70c-848512ffa3d6 None None] MFA Rules not processed for user `3c7ebab7c96141118f263e658b9059d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:29:59.220350 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-ddfe6464-d7a3-4bd5-a70c-848512ffa3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:29:59.295718 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1375/2749] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:29:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:29:59.307321 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19b09f-4270-4f08-b3fd-7c9ef7871a7a service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:29:59.308730 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9f19b09f-4270-4f08-b3fd-7c9ef7871a7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:29:59.387088 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19b09f-4270-4f08-b3fd-7c9ef7871a7a service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:29:59.394188 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a5c14-6686-464e-9738-f468d41217ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:29:59.395340 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a5c14-6686-464e-9738-f468d41217ba service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:29:59.395818 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a5c14-6686-464e-9738-f468d41217ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:29:59.396279 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a5c14-6686-464e-9738-f468d41217ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:29:59.408732 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a5c14-6686-464e-9738-f468d41217ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:29:59.410235 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a5c14-6686-464e-9738-f468d41217ba service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:29:59.421022 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1375/2750] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:29:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:30:01.290397 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098ef3e-94c6-43bd-bed4-5e4c759bb000 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:30:01.290922 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098ef3e-94c6-43bd-bed4-5e4c759bb000 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:30:01.291021 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098ef3e-94c6-43bd-bed4-5e4c759bb000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:30:01.308737 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-b098ef3e-94c6-43bd-bed4-5e4c759bb000 None None] MFA Rules not processed for user `3c7ebab7c96141118f263e658b9059d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:30:01.310056 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b098ef3e-94c6-43bd-bed4-5e4c759bb000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:30:01.316972 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1376/2751] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:30:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:30:17.556370 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a5c14-6686-464e-9738-f468d41217ba service cinder] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:30:17.565007 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a5c14-6686-464e-9738-f468d41217ba service cinder] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:30:17.568910 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e345c9-df02-4859-90d3-f9008cff3949 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:30:17.569800 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e345c9-df02-4859-90d3-f9008cff3949 service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:30:17.570232 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e345c9-df02-4859-90d3-f9008cff3949 service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:30:17.570397 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e345c9-df02-4859-90d3-f9008cff3949 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:30:17.572150 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-c6e345c9-df02-4859-90d3-f9008cff3949 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:30:17.637242 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e345c9-df02-4859-90d3-f9008cff3949 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:30:17.639108 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e345c9-df02-4859-90d3-f9008cff3949 service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:30:17.650121 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1376/2752] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:30:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:30:27.201269 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686c681-4fd4-494a-8af6-432def261463 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:30:27.201878 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686c681-4fd4-494a-8af6-432def261463 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:30:27.201878 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686c681-4fd4-494a-8af6-432def261463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:30:27.220545 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-d686c681-4fd4-494a-8af6-432def261463 None None] MFA Rules not processed for user `a0ce08fda1014dff843c40970cf3af11`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:30:27.221610 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-d686c681-4fd4-494a-8af6-432def261463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:30:27.229996 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1377/2753] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:30:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:30:28.431415 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e345c9-df02-4859-90d3-f9008cff3949 service cinder] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:30:28.432812 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-c6e345c9-df02-4859-90d3-f9008cff3949 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:30:28.449649 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e345c9-df02-4859-90d3-f9008cff3949 service cinder] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:30:28.455095 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968edde-958e-4425-8bd4-0613960e6e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:30:28.456191 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968edde-958e-4425-8bd4-0613960e6e36 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:30:28.456640 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968edde-958e-4425-8bd4-0613960e6e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:30:28.457089 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968edde-958e-4425-8bd4-0613960e6e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:30:28.459214 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-5968edde-958e-4425-8bd4-0613960e6e36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:30:28.543473 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968edde-958e-4425-8bd4-0613960e6e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:30:28.544912 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968edde-958e-4425-8bd4-0613960e6e36 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:30:28.557182 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1377/2754] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:30:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:30:29.665850 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686c681-4fd4-494a-8af6-432def261463 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:30:29.676185 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686c681-4fd4-494a-8af6-432def261463 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:30:29.701163 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9cfeea-f27c-4ff8-b5a3-4878fcf39684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:30:29.701163 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cfeea-f27c-4ff8-b5a3-4878fcf39684 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:30:29.701163 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cfeea-f27c-4ff8-b5a3-4878fcf39684 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:30:29.701163 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cfeea-f27c-4ff8-b5a3-4878fcf39684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:30:29.701648 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-be9cfeea-f27c-4ff8-b5a3-4878fcf39684 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:30:29.701648 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9cfeea-f27c-4ff8-b5a3-4878fcf39684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:30:29.701648 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9cfeea-f27c-4ff8-b5a3-4878fcf39684 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:30:29.712230 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1378/2755] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:30:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:30:53.919698 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968edde-958e-4425-8bd4-0613960e6e36 service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:30:53.928885 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968edde-958e-4425-8bd4-0613960e6e36 service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:30:53.935589 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24727b95-c9dd-4552-82e0-f8828a72e238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:30:53.936786 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24727b95-c9dd-4552-82e0-f8828a72e238 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:30:53.937075 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24727b95-c9dd-4552-82e0-f8828a72e238 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:30:53.937449 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24727b95-c9dd-4552-82e0-f8828a72e238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:30:53.939341 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-24727b95-c9dd-4552-82e0-f8828a72e238 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:30:53.958181 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24727b95-c9dd-4552-82e0-f8828a72e238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:30:53.962435 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24727b95-c9dd-4552-82e0-f8828a72e238 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:30:53.981664 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1378/2756] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:30:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:31:03.612577 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9cfeea-f27c-4ff8-b5a3-4878fcf39684 service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:03.614896 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-be9cfeea-f27c-4ff8-b5a3-4878fcf39684 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:03.639936 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9cfeea-f27c-4ff8-b5a3-4878fcf39684 service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:03.646839 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec779f58-277b-4c5e-9bc4-787d7c923e53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:03.648060 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec779f58-277b-4c5e-9bc4-787d7c923e53 service nova] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:03.648582 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec779f58-277b-4c5e-9bc4-787d7c923e53 service nova] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:03.648942 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec779f58-277b-4c5e-9bc4-787d7c923e53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:03.652336 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-ec779f58-277b-4c5e-9bc4-787d7c923e53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:03.682910 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec779f58-277b-4c5e-9bc4-787d7c923e53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:03.686821 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec779f58-277b-4c5e-9bc4-787d7c923e53 service nova] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:03.709632 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1379/2757] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:31:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:31:07.712968 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24727b95-c9dd-4552-82e0-f8828a72e238 service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:07.715762 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-24727b95-c9dd-4552-82e0-f8828a72e238 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:07.728624 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24727b95-c9dd-4552-82e0-f8828a72e238 service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:07.733917 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529841e-c4d0-4040-984f-458d40e9ccdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:07.734638 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529841e-c4d0-4040-984f-458d40e9ccdc service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:07.735131 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529841e-c4d0-4040-984f-458d40e9ccdc service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:07.735535 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529841e-c4d0-4040-984f-458d40e9ccdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:07.737827 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-6529841e-c4d0-4040-984f-458d40e9ccdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:07.804879 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529841e-c4d0-4040-984f-458d40e9ccdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:07.806337 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529841e-c4d0-4040-984f-458d40e9ccdc service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:07.819961 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1379/2758] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:31:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:31:12.862652 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec779f58-277b-4c5e-9bc4-787d7c923e53 service nova] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:12.872146 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec779f58-277b-4c5e-9bc4-787d7c923e53 service nova] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:12.876064 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0668cc-90f9-4e51-aa7a-a5321b4bdfc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:12.876711 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0668cc-90f9-4e51-aa7a-a5321b4bdfc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:12.876997 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0668cc-90f9-4e51-aa7a-a5321b4bdfc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:12.877277 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0668cc-90f9-4e51-aa7a-a5321b4bdfc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:12.879146 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-4a0668cc-90f9-4e51-aa7a-a5321b4bdfc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:12.892453 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0668cc-90f9-4e51-aa7a-a5321b4bdfc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:12.893938 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0668cc-90f9-4e51-aa7a-a5321b4bdfc9 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:12.908827 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1380/2759] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:31:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:31:16.330207 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6dc5e4-09d9-48f5-9a51-707c6f80994f None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:16.330207 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6dc5e4-09d9-48f5-9a51-707c6f80994f None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:16.330865 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6dc5e4-09d9-48f5-9a51-707c6f80994f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:16.349353 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-cd6dc5e4-09d9-48f5-9a51-707c6f80994f None None] MFA Rules not processed for user `3c7ebab7c96141118f263e658b9059d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:31:16.350582 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-cd6dc5e4-09d9-48f5-9a51-707c6f80994f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:16.362554 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1380/2760] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:31:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:31:16.726990 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0668cc-90f9-4e51-aa7a-a5321b4bdfc9 service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:16.738378 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0668cc-90f9-4e51-aa7a-a5321b4bdfc9 service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:16.745153 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0d6df-90ab-4166-8902-f0c23ea63901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:16.745153 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0d6df-90ab-4166-8902-f0c23ea63901 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:16.745153 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0d6df-90ab-4166-8902-f0c23ea63901 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:16.745153 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0d6df-90ab-4166-8902-f0c23ea63901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:16.746673 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-fdd0d6df-90ab-4166-8902-f0c23ea63901 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:16.757119 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0d6df-90ab-4166-8902-f0c23ea63901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:16.758611 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0d6df-90ab-4166-8902-f0c23ea63901 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:16.768166 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1381/2761] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:31:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:31:16.843309 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6dc5e4-09d9-48f5-9a51-707c6f80994f None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:16.844849 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-cd6dc5e4-09d9-48f5-9a51-707c6f80994f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:16.864312 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6dc5e4-09d9-48f5-9a51-707c6f80994f None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:16.869007 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e43bd-cd08-4093-8a52-5a10bd3d2577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:16.873484 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e43bd-cd08-4093-8a52-5a10bd3d2577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:16.873484 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e43bd-cd08-4093-8a52-5a10bd3d2577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:16.873484 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e43bd-cd08-4093-8a52-5a10bd3d2577 admin admin] PATH_INFO: `/v3/users/756b474793a84ca9af8702de02434af9` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:16.873484 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e43bd-cd08-4093-8a52-5a10bd3d2577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=756b474793a84ca9af8702de02434af9)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:16.885885 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e43bd-cd08-4093-8a52-5a10bd3d2577 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:17.073648 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-e20e43bd-cd08-4093-8a52-5a10bd3d2577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '756b474793a84ca9af8702de02434af9'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:17.172634 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-e20e43bd-cd08-4093-8a52-5a10bd3d2577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '756b474793a84ca9af8702de02434af9'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:17.173346 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-e20e43bd-cd08-4093-8a52-5a10bd3d2577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '756b474793a84ca9af8702de02434af9'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:17.182971 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-e20e43bd-cd08-4093-8a52-5a10bd3d2577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '756b474793a84ca9af8702de02434af9'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:17.195600 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-e20e43bd-cd08-4093-8a52-5a10bd3d2577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '756b474793a84ca9af8702de02434af9'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:17.202374 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1381/2762] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:31:16 2022] DELETE /identity/v3/users/756b474793a84ca9af8702de02434af9 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:31:17.283708 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0d6df-90ab-4166-8902-f0c23ea63901 service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:17.285500 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-fdd0d6df-90ab-4166-8902-f0c23ea63901 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:17.366195 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0d6df-90ab-4166-8902-f0c23ea63901 service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:17.431768 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec236e03-e4b4-43c4-9d0a-9c60e0f1633e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef0001e91524a13a9ca601a601de66b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:17.432416 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec236e03-e4b4-43c4-9d0a-9c60e0f1633e service placement] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:17.432724 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec236e03-e4b4-43c4-9d0a-9c60e0f1633e service placement] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:17.433094 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec236e03-e4b4-43c4-9d0a-9c60e0f1633e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:17.434918 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-ec236e03-e4b4-43c4-9d0a-9c60e0f1633e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:17.446993 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec236e03-e4b4-43c4-9d0a-9c60e0f1633e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:17.448620 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec236e03-e4b4-43c4-9d0a-9c60e0f1633e service placement] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:17.459615 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1382/2763] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:31:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:31:17.530537 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e43bd-cd08-4093-8a52-5a10bd3d2577 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:17.530537 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-e20e43bd-cd08-4093-8a52-5a10bd3d2577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:17.651662 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e43bd-cd08-4093-8a52-5a10bd3d2577 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:17.657792 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec04b9-001e-4c4c-978d-96668372fd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:17.658709 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec04b9-001e-4c4c-978d-96668372fd2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:17.659029 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec04b9-001e-4c4c-978d-96668372fd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:17.659310 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec04b9-001e-4c4c-978d-96668372fd2d admin admin] PATH_INFO: `/v3/projects/10e0da9e3b824cd2bfb89fac347f7dc6` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:17.660545 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec04b9-001e-4c4c-978d-96668372fd2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=10e0da9e3b824cd2bfb89fac347f7dc6)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:17.662561 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec04b9-001e-4c4c-978d-96668372fd2d admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:17.795160 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-bfec04b9-001e-4c4c-978d-96668372fd2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10e0da9e3b824cd2bfb89fac347f7dc6', 'request_id': 'req-bfec04b9-001e-4c4c-978d-96668372fd2d'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:17.870005 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-bfec04b9-001e-4c4c-978d-96668372fd2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10e0da9e3b824cd2bfb89fac347f7dc6', 'request_id': 'req-bfec04b9-001e-4c4c-978d-96668372fd2d'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:17.882310 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-bfec04b9-001e-4c4c-978d-96668372fd2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10e0da9e3b824cd2bfb89fac347f7dc6', 'request_id': 'req-bfec04b9-001e-4c4c-978d-96668372fd2d'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:17.901827 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-bfec04b9-001e-4c4c-978d-96668372fd2d admin admin] The token cache is being invalidate because project 10e0da9e3b824cd2bfb89fac347f7dc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:31:17.902993 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-bfec04b9-001e-4c4c-978d-96668372fd2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:17.904112 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-bfec04b9-001e-4c4c-978d-96668372fd2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:17.906933 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1382/2764] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:31:17 2022] DELETE /identity/v3/projects/10e0da9e3b824cd2bfb89fac347f7dc6 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:31:17.914035 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb75a9e-09ba-4fab-b118-f36542654513 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:17.914734 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb75a9e-09ba-4fab-b118-f36542654513 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:17.914734 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb75a9e-09ba-4fab-b118-f36542654513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:17.933924 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-edb75a9e-09ba-4fab-b118-f36542654513 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:31:17.935659 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-edb75a9e-09ba-4fab-b118-f36542654513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:18.017218 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1383/2765] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:31:18.026615 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa82b18-37ef-4ecb-b55f-edf8784ad8f9 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:18.026971 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa82b18-37ef-4ecb-b55f-edf8784ad8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:18.027340 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa82b18-37ef-4ecb-b55f-edf8784ad8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:18.047660 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-dfa82b18-37ef-4ecb-b55f-edf8784ad8f9 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:31:18.048875 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-dfa82b18-37ef-4ecb-b55f-edf8784ad8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:18.057325 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1383/2766] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:31:18.063188 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb75a9e-09ba-4fab-b118-f36542654513 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:18.073522 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb75a9e-09ba-4fab-b118-f36542654513 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:18.078520 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed85fd-eb5d-40dc-b516-f1d1a06c10dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:18.079195 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed85fd-eb5d-40dc-b516-f1d1a06c10dc admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:18.079482 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed85fd-eb5d-40dc-b516-f1d1a06c10dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:18.079764 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed85fd-eb5d-40dc-b516-f1d1a06c10dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:18.080499 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed85fd-eb5d-40dc-b516-f1d1a06c10dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:31:18.080810 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed85fd-eb5d-40dc-b516-f1d1a06c10dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:18.082451 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed85fd-eb5d-40dc-b516-f1d1a06c10dc admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:18.095282 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1384/2767] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 20:31:18.100047 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa82b18-37ef-4ecb-b55f-edf8784ad8f9 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:18.113136 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa82b18-37ef-4ecb-b55f-edf8784ad8f9 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:18.120856 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed628eb1-95e7-4bf0-9f0e-3d25b65f5d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:18.121604 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed628eb1-95e7-4bf0-9f0e-3d25b65f5d4e admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:18.121914 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed628eb1-95e7-4bf0-9f0e-3d25b65f5d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:18.123102 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed628eb1-95e7-4bf0-9f0e-3d25b65f5d4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:18.124399 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed628eb1-95e7-4bf0-9f0e-3d25b65f5d4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:18.126557 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed628eb1-95e7-4bf0-9f0e-3d25b65f5d4e admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:18.236674 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1384/2768] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:31:18 2022] POST /identity/v3/projects => generated 367 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:31:18.241110 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed85fd-eb5d-40dc-b516-f1d1a06c10dc admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:18.264242 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed85fd-eb5d-40dc-b516-f1d1a06c10dc admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:18.331120 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a759965-a1e7-48af-9f6f-2685079f4413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:18.332121 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a759965-a1e7-48af-9f6f-2685079f4413 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:18.332552 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a759965-a1e7-48af-9f6f-2685079f4413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:18.332974 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a759965-a1e7-48af-9f6f-2685079f4413 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:18.334090 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a759965-a1e7-48af-9f6f-2685079f4413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:18.336676 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a759965-a1e7-48af-9f6f-2685079f4413 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:18.487918 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1385/2769] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:31:18 2022] POST /identity/v3/users => generated 284 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:31:18.492316 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed628eb1-95e7-4bf0-9f0e-3d25b65f5d4e admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:18.503525 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed628eb1-95e7-4bf0-9f0e-3d25b65f5d4e admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:18.508350 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff234b4-74ad-4de9-a2aa-7d10a55e550c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:18.509035 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff234b4-74ad-4de9-a2aa-7d10a55e550c admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:18.509334 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff234b4-74ad-4de9-a2aa-7d10a55e550c admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:18.509616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff234b4-74ad-4de9-a2aa-7d10a55e550c admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:18.510350 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff234b4-74ad-4de9-a2aa-7d10a55e550c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:18.512321 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff234b4-74ad-4de9-a2aa-7d10a55e550c admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:18.533322 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1385/2770] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:31:18.539024 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a759965-a1e7-48af-9f6f-2685079f4413 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:18.551316 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a759965-a1e7-48af-9f6f-2685079f4413 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:18.556298 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f8731-cd2f-479b-8a4d-be1a7e27dd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:18.563108 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f8731-cd2f-479b-8a4d-be1a7e27dd97 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:18.563108 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f8731-cd2f-479b-8a4d-be1a7e27dd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:18.563108 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f8731-cd2f-479b-8a4d-be1a7e27dd97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:18.563108 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f8731-cd2f-479b-8a4d-be1a7e27dd97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:18.563108 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f8731-cd2f-479b-8a4d-be1a7e27dd97 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:18.571837 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1386/2771] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:31:18.576198 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff234b4-74ad-4de9-a2aa-7d10a55e550c admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:18.587535 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff234b4-74ad-4de9-a2aa-7d10a55e550c admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:18.592925 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c14ee-765c-4ae6-94a3-6f997876964e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:18.593857 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c14ee-765c-4ae6-94a3-6f997876964e admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:18.594147 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c14ee-765c-4ae6-94a3-6f997876964e admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:18.594437 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c14ee-765c-4ae6-94a3-6f997876964e admin admin] PATH_INFO: `/v3/projects/7ecf99b1167d4157b2d7a0ce2295ac75/users/6bacfc8d91a84f9ea3425a1698c3dd08/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:18.611647 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c14ee-765c-4ae6-94a3-6f997876964e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ecf99b1167d4157b2d7a0ce2295ac75, user_id=6bacfc8d91a84f9ea3425a1698c3dd08, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:18.614409 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c14ee-765c-4ae6-94a3-6f997876964e admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:18.722456 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1386/2772] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:31:18 2022] PUT /identity/v3/projects/7ecf99b1167d4157b2d7a0ce2295ac75/users/6bacfc8d91a84f9ea3425a1698c3dd08/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:31:18.734255 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5f5ee-443e-443c-8df0-15aff1eb6871 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:18.734567 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5f5ee-443e-443c-8df0-15aff1eb6871 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:18.734805 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5f5ee-443e-443c-8df0-15aff1eb6871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:18.771745 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-79c5f5ee-443e-443c-8df0-15aff1eb6871 None None] MFA Rules not processed for user `6bacfc8d91a84f9ea3425a1698c3dd08`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:31:18.772884 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-79c5f5ee-443e-443c-8df0-15aff1eb6871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:18.844494 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1387/2773] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:31:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:31:18.849033 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c14ee-765c-4ae6-94a3-6f997876964e admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:18.911594 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c14ee-765c-4ae6-94a3-6f997876964e admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:18.921170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67406371-c8a9-4db1-9c67-ca1e43a5d19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:18.921917 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67406371-c8a9-4db1-9c67-ca1e43a5d19d admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:18.922210 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67406371-c8a9-4db1-9c67-ca1e43a5d19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:18.922493 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67406371-c8a9-4db1-9c67-ca1e43a5d19d admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:18.923337 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67406371-c8a9-4db1-9c67-ca1e43a5d19d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:18.925333 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67406371-c8a9-4db1-9c67-ca1e43a5d19d admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:19.074686 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1387/2774] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:31:18 2022] POST /identity/v3/projects => generated 367 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:31:19.077251 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5f5ee-443e-443c-8df0-15aff1eb6871 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:19.095855 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5f5ee-443e-443c-8df0-15aff1eb6871 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:19.155281 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12beac1b-1fe8-467c-ab6e-fce8f4ce92c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:19.156536 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12beac1b-1fe8-467c-ab6e-fce8f4ce92c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:19.156856 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12beac1b-1fe8-467c-ab6e-fce8f4ce92c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:19.157187 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12beac1b-1fe8-467c-ab6e-fce8f4ce92c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:19.157913 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12beac1b-1fe8-467c-ab6e-fce8f4ce92c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:19.160152 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12beac1b-1fe8-467c-ab6e-fce8f4ce92c6 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:19.278215 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1388/2775] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:31:19 2022] POST /identity/v3/users => generated 290 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:31:19.282559 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67406371-c8a9-4db1-9c67-ca1e43a5d19d admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:19.293133 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67406371-c8a9-4db1-9c67-ca1e43a5d19d admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:19.298372 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049197e-c73b-4460-acf0-823d1db07ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:19.302144 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049197e-c73b-4460-acf0-823d1db07ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:19.302144 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049197e-c73b-4460-acf0-823d1db07ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:19.302144 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049197e-c73b-4460-acf0-823d1db07ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:19.302144 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049197e-c73b-4460-acf0-823d1db07ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:19.302833 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049197e-c73b-4460-acf0-823d1db07ba5 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:19.315247 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1388/2776] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:31:19.319986 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12beac1b-1fe8-467c-ab6e-fce8f4ce92c6 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:19.331622 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12beac1b-1fe8-467c-ab6e-fce8f4ce92c6 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:19.336387 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7734ca-e554-4c6a-9d95-b9b1d35bb329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:19.337359 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7734ca-e554-4c6a-9d95-b9b1d35bb329 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:19.342439 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7734ca-e554-4c6a-9d95-b9b1d35bb329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:19.342439 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7734ca-e554-4c6a-9d95-b9b1d35bb329 admin admin] PATH_INFO: `/v3/projects/ff837a4715714a9a9b252bea1e1d9d5e/users/335bd2dfa36e4893b97859e9b60b8ef3/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:19.354045 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7734ca-e554-4c6a-9d95-b9b1d35bb329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff837a4715714a9a9b252bea1e1d9d5e, user_id=335bd2dfa36e4893b97859e9b60b8ef3, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:19.356903 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7734ca-e554-4c6a-9d95-b9b1d35bb329 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:19.442194 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1389/2777] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:31:19 2022] PUT /identity/v3/projects/ff837a4715714a9a9b252bea1e1d9d5e/users/335bd2dfa36e4893b97859e9b60b8ef3/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:31:19.447765 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049197e-c73b-4460-acf0-823d1db07ba5 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:19.459071 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049197e-c73b-4460-acf0-823d1db07ba5 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:19.519158 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4e6b2-c579-4528-b604-20b202866021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:19.519847 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4e6b2-c579-4528-b604-20b202866021 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:19.520130 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4e6b2-c579-4528-b604-20b202866021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:19.520405 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4e6b2-c579-4528-b604-20b202866021 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:19.521145 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4e6b2-c579-4528-b604-20b202866021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:19.522763 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4e6b2-c579-4528-b604-20b202866021 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:19.534127 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1389/2778] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:31:19.538454 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7734ca-e554-4c6a-9d95-b9b1d35bb329 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:19.551099 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7734ca-e554-4c6a-9d95-b9b1d35bb329 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:19.556833 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcca99-37ea-4936-8d46-0e979b6240eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:19.557816 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcca99-37ea-4936-8d46-0e979b6240eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:19.558148 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcca99-37ea-4936-8d46-0e979b6240eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:19.558430 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcca99-37ea-4936-8d46-0e979b6240eb admin admin] PATH_INFO: `/v3/projects/ff837a4715714a9a9b252bea1e1d9d5e/users/335bd2dfa36e4893b97859e9b60b8ef3/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:19.561453 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcca99-37ea-4936-8d46-0e979b6240eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff837a4715714a9a9b252bea1e1d9d5e, user_id=335bd2dfa36e4893b97859e9b60b8ef3, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:19.568302 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcca99-37ea-4936-8d46-0e979b6240eb admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:19.577348 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1390/2779] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:31:19 2022] PUT /identity/v3/projects/ff837a4715714a9a9b252bea1e1d9d5e/users/335bd2dfa36e4893b97859e9b60b8ef3/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:31:19.588159 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613e8e2-e6a2-4134-afc2-d506677edc52 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:19.588385 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613e8e2-e6a2-4134-afc2-d506677edc52 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:19.588674 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613e8e2-e6a2-4134-afc2-d506677edc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:19.625117 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-4613e8e2-e6a2-4134-afc2-d506677edc52 None None] MFA Rules not processed for user `335bd2dfa36e4893b97859e9b60b8ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:31:19.626437 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-4613e8e2-e6a2-4134-afc2-d506677edc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:19.697858 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1390/2780] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:31:19 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:31:19.709596 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcca99-37ea-4936-8d46-0e979b6240eb admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:19.711294 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-08fcca99-37ea-4936-8d46-0e979b6240eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:19.772886 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcca99-37ea-4936-8d46-0e979b6240eb admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:19.777277 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057685c-0083-4226-a98a-d6aaa90ce612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:19.777961 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057685c-0083-4226-a98a-d6aaa90ce612 service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:19.778348 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057685c-0083-4226-a98a-d6aaa90ce612 service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:19.778631 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057685c-0083-4226-a98a-d6aaa90ce612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:19.788417 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057685c-0083-4226-a98a-d6aaa90ce612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:19.790271 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057685c-0083-4226-a98a-d6aaa90ce612 service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:19.802592 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1391/2781] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:31:19 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:31:21.766707 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613e8e2-e6a2-4134-afc2-d506677edc52 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:21.770307 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-4613e8e2-e6a2-4134-afc2-d506677edc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:21.871305 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613e8e2-e6a2-4134-afc2-d506677edc52 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:21.881271 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb115499-5160-45d6-a967-c3a48f58be0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:21.881271 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb115499-5160-45d6-a967-c3a48f58be0d service nova] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:21.881271 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb115499-5160-45d6-a967-c3a48f58be0d service nova] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:21.881271 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb115499-5160-45d6-a967-c3a48f58be0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:21.884418 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-fb115499-5160-45d6-a967-c3a48f58be0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:21.901187 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb115499-5160-45d6-a967-c3a48f58be0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:21.903176 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb115499-5160-45d6-a967-c3a48f58be0d service nova] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:21.915445 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1391/2782] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:31:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:31:23.767375 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057685c-0083-4226-a98a-d6aaa90ce612 service cinder] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:23.830640 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057685c-0083-4226-a98a-d6aaa90ce612 service cinder] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:23.835524 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0572a-0ba7-4663-9ec9-1846b5634d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:23.836426 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0572a-0ba7-4663-9ec9-1846b5634d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:23.836733 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0572a-0ba7-4663-9ec9-1846b5634d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:23.837007 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0572a-0ba7-4663-9ec9-1846b5634d44 admin admin] PATH_INFO: `/v3/users/6bacfc8d91a84f9ea3425a1698c3dd08` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:23.838210 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0572a-0ba7-4663-9ec9-1846b5634d44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bacfc8d91a84f9ea3425a1698c3dd08)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:23.840193 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0572a-0ba7-4663-9ec9-1846b5634d44 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:24.110704 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f6e0572a-0ba7-4663-9ec9-1846b5634d44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bacfc8d91a84f9ea3425a1698c3dd08'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:24.216222 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f6e0572a-0ba7-4663-9ec9-1846b5634d44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bacfc8d91a84f9ea3425a1698c3dd08'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:24.216995 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f6e0572a-0ba7-4663-9ec9-1846b5634d44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bacfc8d91a84f9ea3425a1698c3dd08'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:24.218185 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f6e0572a-0ba7-4663-9ec9-1846b5634d44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bacfc8d91a84f9ea3425a1698c3dd08'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:24.225958 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f6e0572a-0ba7-4663-9ec9-1846b5634d44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bacfc8d91a84f9ea3425a1698c3dd08'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:24.243404 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1392/2783] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:31:23 2022] DELETE /identity/v3/users/6bacfc8d91a84f9ea3425a1698c3dd08 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:31:24.248014 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bb311-d4a7-4f36-8ec5-ec4a3159c2a8 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:24.248537 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bb311-d4a7-4f36-8ec5-ec4a3159c2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:24.248858 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bb311-d4a7-4f36-8ec5-ec4a3159c2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:24.267209 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-999bb311-d4a7-4f36-8ec5-ec4a3159c2a8 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:31:24.268482 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-999bb311-d4a7-4f36-8ec5-ec4a3159c2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:24.331467 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1392/2784] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:31:24.341407 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0572a-0ba7-4663-9ec9-1846b5634d44 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:24.343701 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-f6e0572a-0ba7-4663-9ec9-1846b5634d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:24.412630 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0572a-0ba7-4663-9ec9-1846b5634d44 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:24.416432 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336dd10-fd71-4611-a61b-e31f0f7a2f77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:24.423511 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336dd10-fd71-4611-a61b-e31f0f7a2f77 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:24.423511 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336dd10-fd71-4611-a61b-e31f0f7a2f77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:24.423511 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336dd10-fd71-4611-a61b-e31f0f7a2f77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:24.428776 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336dd10-fd71-4611-a61b-e31f0f7a2f77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:24.430381 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336dd10-fd71-4611-a61b-e31f0f7a2f77 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:24.442175 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1393/2785] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:31:24.968862 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bb311-d4a7-4f36-8ec5-ec4a3159c2a8 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:24.970528 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-999bb311-d4a7-4f36-8ec5-ec4a3159c2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:24.986994 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bb311-d4a7-4f36-8ec5-ec4a3159c2a8 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:24.991562 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad946eb-7682-47ce-9df3-8a2d9786b73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:24.992438 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad946eb-7682-47ce-9df3-8a2d9786b73f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:24.992724 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad946eb-7682-47ce-9df3-8a2d9786b73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:24.992993 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad946eb-7682-47ce-9df3-8a2d9786b73f admin admin] PATH_INFO: `/v3/projects/7ecf99b1167d4157b2d7a0ce2295ac75` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:24.994229 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad946eb-7682-47ce-9df3-8a2d9786b73f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ecf99b1167d4157b2d7a0ce2295ac75)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:24.996514 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad946eb-7682-47ce-9df3-8a2d9786b73f admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:25.158808 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-3ad946eb-7682-47ce-9df3-8a2d9786b73f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ecf99b1167d4157b2d7a0ce2295ac75', 'request_id': 'req-3ad946eb-7682-47ce-9df3-8a2d9786b73f'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:25.281084 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-3ad946eb-7682-47ce-9df3-8a2d9786b73f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ecf99b1167d4157b2d7a0ce2295ac75', 'request_id': 'req-3ad946eb-7682-47ce-9df3-8a2d9786b73f'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:25.288205 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-3ad946eb-7682-47ce-9df3-8a2d9786b73f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ecf99b1167d4157b2d7a0ce2295ac75', 'request_id': 'req-3ad946eb-7682-47ce-9df3-8a2d9786b73f'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:25.303533 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-3ad946eb-7682-47ce-9df3-8a2d9786b73f admin admin] The token cache is being invalidate because project 7ecf99b1167d4157b2d7a0ce2295ac75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:31:25.303827 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-3ad946eb-7682-47ce-9df3-8a2d9786b73f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:25.304508 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-3ad946eb-7682-47ce-9df3-8a2d9786b73f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:25.306131 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1393/2786] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:31:24 2022] DELETE /identity/v3/projects/7ecf99b1167d4157b2d7a0ce2295ac75 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:31:25.310188 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336dd10-fd71-4611-a61b-e31f0f7a2f77 service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:25.323683 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336dd10-fd71-4611-a61b-e31f0f7a2f77 service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:25.383704 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc783c-6d9b-4c4c-a35c-6185f75fb5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:25.384704 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc783c-6d9b-4c4c-a35c-6185f75fb5ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:25.384987 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc783c-6d9b-4c4c-a35c-6185f75fb5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:25.385281 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc783c-6d9b-4c4c-a35c-6185f75fb5ac admin admin] PATH_INFO: `/v3/users/335bd2dfa36e4893b97859e9b60b8ef3` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:25.386599 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc783c-6d9b-4c4c-a35c-6185f75fb5ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=335bd2dfa36e4893b97859e9b60b8ef3)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:25.389254 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc783c-6d9b-4c4c-a35c-6185f75fb5ac admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:25.635017 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f7fc783c-6d9b-4c4c-a35c-6185f75fb5ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '335bd2dfa36e4893b97859e9b60b8ef3'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:25.726334 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f7fc783c-6d9b-4c4c-a35c-6185f75fb5ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '335bd2dfa36e4893b97859e9b60b8ef3'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:25.727108 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f7fc783c-6d9b-4c4c-a35c-6185f75fb5ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '335bd2dfa36e4893b97859e9b60b8ef3'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:25.727788 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f7fc783c-6d9b-4c4c-a35c-6185f75fb5ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '335bd2dfa36e4893b97859e9b60b8ef3'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:25.735763 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-f7fc783c-6d9b-4c4c-a35c-6185f75fb5ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '335bd2dfa36e4893b97859e9b60b8ef3'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:25.755079 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1394/2787] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:31:25 2022] DELETE /identity/v3/users/335bd2dfa36e4893b97859e9b60b8ef3 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:31:26.213830 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad946eb-7682-47ce-9df3-8a2d9786b73f admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:26.215395 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-3ad946eb-7682-47ce-9df3-8a2d9786b73f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:26.229531 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad946eb-7682-47ce-9df3-8a2d9786b73f admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:26.293062 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e34372-793b-4047-b87c-a1aa82b5558a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:26.294003 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e34372-793b-4047-b87c-a1aa82b5558a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:26.298375 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e34372-793b-4047-b87c-a1aa82b5558a admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:26.298375 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e34372-793b-4047-b87c-a1aa82b5558a admin admin] PATH_INFO: `/v3/projects/ff837a4715714a9a9b252bea1e1d9d5e` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:26.298375 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e34372-793b-4047-b87c-a1aa82b5558a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff837a4715714a9a9b252bea1e1d9d5e)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:26.298902 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e34372-793b-4047-b87c-a1aa82b5558a admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:26.399281 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b4e34372-793b-4047-b87c-a1aa82b5558a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff837a4715714a9a9b252bea1e1d9d5e', 'request_id': 'req-b4e34372-793b-4047-b87c-a1aa82b5558a'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:26.468039 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b4e34372-793b-4047-b87c-a1aa82b5558a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff837a4715714a9a9b252bea1e1d9d5e', 'request_id': 'req-b4e34372-793b-4047-b87c-a1aa82b5558a'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:26.474342 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b4e34372-793b-4047-b87c-a1aa82b5558a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff837a4715714a9a9b252bea1e1d9d5e', 'request_id': 'req-b4e34372-793b-4047-b87c-a1aa82b5558a'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:26.486446 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b4e34372-793b-4047-b87c-a1aa82b5558a admin admin] The token cache is being invalidate because project ff837a4715714a9a9b252bea1e1d9d5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:31:26.486739 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b4e34372-793b-4047-b87c-a1aa82b5558a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:26.487399 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-b4e34372-793b-4047-b87c-a1aa82b5558a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:26.488953 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1394/2788] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:31:26 2022] DELETE /identity/v3/projects/ff837a4715714a9a9b252bea1e1d9d5e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:31:26.494024 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276795ce-c713-4f32-8e0f-6fd996847be9 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:26.494554 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276795ce-c713-4f32-8e0f-6fd996847be9 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:26.494664 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276795ce-c713-4f32-8e0f-6fd996847be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:26.515606 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-276795ce-c713-4f32-8e0f-6fd996847be9 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:31:26.516840 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-276795ce-c713-4f32-8e0f-6fd996847be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:26.600664 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1395/2789] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:31:26.610772 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d5579-baa5-4bf7-aa36-f82db682f503 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:26.611056 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d5579-baa5-4bf7-aa36-f82db682f503 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:26.611335 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d5579-baa5-4bf7-aa36-f82db682f503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:26.632876 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-d60d5579-baa5-4bf7-aa36-f82db682f503 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:31:26.634263 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-d60d5579-baa5-4bf7-aa36-f82db682f503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:26.642966 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1395/2790] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:31:26.647358 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276795ce-c713-4f32-8e0f-6fd996847be9 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:26.658499 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276795ce-c713-4f32-8e0f-6fd996847be9 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:26.663190 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb4c6a-ef7c-4561-92ba-8ac9b04e5d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:26.663875 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb4c6a-ef7c-4561-92ba-8ac9b04e5d65 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:26.664156 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb4c6a-ef7c-4561-92ba-8ac9b04e5d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:26.664434 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb4c6a-ef7c-4561-92ba-8ac9b04e5d65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:26.665155 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb4c6a-ef7c-4561-92ba-8ac9b04e5d65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:31:26.665499 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb4c6a-ef7c-4561-92ba-8ac9b04e5d65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:26.667095 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb4c6a-ef7c-4561-92ba-8ac9b04e5d65 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:26.680176 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1396/2791] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:31:26.684582 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d5579-baa5-4bf7-aa36-f82db682f503 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:26.694807 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d5579-baa5-4bf7-aa36-f82db682f503 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:26.699520 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebaef02-bf1c-4d48-8399-56a46601a164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:26.700178 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaef02-bf1c-4d48-8399-56a46601a164 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:26.700457 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaef02-bf1c-4d48-8399-56a46601a164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:26.700732 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaef02-bf1c-4d48-8399-56a46601a164 admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:26.702006 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebaef02-bf1c-4d48-8399-56a46601a164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:26.703898 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebaef02-bf1c-4d48-8399-56a46601a164 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:26.825497 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1396/2792] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:31:26 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:31:26.829734 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb4c6a-ef7c-4561-92ba-8ac9b04e5d65 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:26.837516 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb4c6a-ef7c-4561-92ba-8ac9b04e5d65 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:26.907256 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dd7a1-b077-4bce-ad30-d053e60fed7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:26.907931 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dd7a1-b077-4bce-ad30-d053e60fed7e admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:26.908218 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dd7a1-b077-4bce-ad30-d053e60fed7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:26.908499 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dd7a1-b077-4bce-ad30-d053e60fed7e admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:26.909371 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37dd7a1-b077-4bce-ad30-d053e60fed7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:26.911289 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37dd7a1-b077-4bce-ad30-d053e60fed7e admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:27.024722 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1397/2793] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:31:26 2022] POST /identity/v3/users => generated 294 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:31:27.029717 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebaef02-bf1c-4d48-8399-56a46601a164 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:27.040481 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebaef02-bf1c-4d48-8399-56a46601a164 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:27.045460 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e848045-1e6b-46cd-996f-1f0cf2f02db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:27.046170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e848045-1e6b-46cd-996f-1f0cf2f02db8 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:27.046459 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e848045-1e6b-46cd-996f-1f0cf2f02db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:27.046739 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e848045-1e6b-46cd-996f-1f0cf2f02db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:27.047471 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e848045-1e6b-46cd-996f-1f0cf2f02db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:27.049172 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e848045-1e6b-46cd-996f-1f0cf2f02db8 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:27.061556 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1397/2794] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:31:27.072037 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dd7a1-b077-4bce-ad30-d053e60fed7e admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:27.086143 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dd7a1-b077-4bce-ad30-d053e60fed7e admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:27.091116 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee21e47-da70-4479-abe1-5b1442a379e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:27.096751 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee21e47-da70-4479-abe1-5b1442a379e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:27.096751 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee21e47-da70-4479-abe1-5b1442a379e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:27.096751 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee21e47-da70-4479-abe1-5b1442a379e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:27.096751 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee21e47-da70-4479-abe1-5b1442a379e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:27.096751 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee21e47-da70-4479-abe1-5b1442a379e9 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:27.107764 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1398/2795] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:31:27.114258 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e848045-1e6b-46cd-996f-1f0cf2f02db8 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:27.125469 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e848045-1e6b-46cd-996f-1f0cf2f02db8 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:27.130442 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9b55a-960d-4002-86c2-5c9e2704f7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:27.131391 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9b55a-960d-4002-86c2-5c9e2704f7b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:27.131687 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9b55a-960d-4002-86c2-5c9e2704f7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:27.131976 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9b55a-960d-4002-86c2-5c9e2704f7b7 admin admin] PATH_INFO: `/v3/projects/ba6c09ffb5e240ffb59b714eb919c0ee/users/e02f66f906ad4406bd4207d4b094a8f5/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:27.147832 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9b55a-960d-4002-86c2-5c9e2704f7b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6c09ffb5e240ffb59b714eb919c0ee, user_id=e02f66f906ad4406bd4207d4b094a8f5, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:27.150519 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9b55a-960d-4002-86c2-5c9e2704f7b7 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:27.189973 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee21e47-da70-4479-abe1-5b1442a379e9 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:27.191971 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-bee21e47-da70-4479-abe1-5b1442a379e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:27.266875 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee21e47-da70-4479-abe1-5b1442a379e9 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:27.272810 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d72990-ee43-4ca7-8acf-ac81d2c40be5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b797e15939694c9abf1f2b8e9aee4d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:27.273705 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d72990-ee43-4ca7-8acf-ac81d2c40be5 service nova] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:27.273989 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d72990-ee43-4ca7-8acf-ac81d2c40be5 service nova] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:27.274268 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d72990-ee43-4ca7-8acf-ac81d2c40be5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:27.276092 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-b9d72990-ee43-4ca7-8acf-ac81d2c40be5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:27.292513 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1398/2796] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:31:27 2022] PUT /identity/v3/projects/ba6c09ffb5e240ffb59b714eb919c0ee/users/e02f66f906ad4406bd4207d4b094a8f5/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:31:27.300616 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d72990-ee43-4ca7-8acf-ac81d2c40be5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:27.300616 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d72990-ee43-4ca7-8acf-ac81d2c40be5 service nova] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:27.303403 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fb6e7-0b54-4f67-8cc7-f947eb2c446f None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:27.303908 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fb6e7-0b54-4f67-8cc7-f947eb2c446f None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:27.304031 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fb6e7-0b54-4f67-8cc7-f947eb2c446f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:27.308101 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1399/2797] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:31:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:31:27.338075 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-426fb6e7-0b54-4f67-8cc7-f947eb2c446f None None] MFA Rules not processed for user `e02f66f906ad4406bd4207d4b094a8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:31:27.339824 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-426fb6e7-0b54-4f67-8cc7-f947eb2c446f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:27.420078 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1399/2798] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:31:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:31:27.424833 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d72990-ee43-4ca7-8acf-ac81d2c40be5 service nova] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:27.436670 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d72990-ee43-4ca7-8acf-ac81d2c40be5 service nova] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:27.505130 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c3896-55c4-488f-ab5e-4f7d9df77d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:27.505902 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c3896-55c4-488f-ab5e-4f7d9df77d25 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:27.506127 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c3896-55c4-488f-ab5e-4f7d9df77d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:27.506404 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c3896-55c4-488f-ab5e-4f7d9df77d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:27.507115 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c3896-55c4-488f-ab5e-4f7d9df77d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:27.509051 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c3896-55c4-488f-ab5e-4f7d9df77d25 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:27.653938 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1400/2799] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:31:27 2022] POST /identity/v3/projects => generated 387 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:31:27.658164 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fb6e7-0b54-4f67-8cc7-f947eb2c446f None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:27.669056 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fb6e7-0b54-4f67-8cc7-f947eb2c446f None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:27.737272 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3102988-c1cf-401c-89ed-dfa3ca164231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:27.737985 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3102988-c1cf-401c-89ed-dfa3ca164231 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:27.738270 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3102988-c1cf-401c-89ed-dfa3ca164231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:27.738548 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3102988-c1cf-401c-89ed-dfa3ca164231 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:27.739254 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3102988-c1cf-401c-89ed-dfa3ca164231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:27.741255 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3102988-c1cf-401c-89ed-dfa3ca164231 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:27.889008 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1400/2800] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:31:27 2022] POST /identity/v3/users => generated 300 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:31:27.892928 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c3896-55c4-488f-ab5e-4f7d9df77d25 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:27.904761 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c3896-55c4-488f-ab5e-4f7d9df77d25 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:27.909978 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7b5d4-a5df-4ac9-9a92-133827cb4d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:27.910646 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7b5d4-a5df-4ac9-9a92-133827cb4d3c admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:27.910933 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7b5d4-a5df-4ac9-9a92-133827cb4d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:27.911210 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7b5d4-a5df-4ac9-9a92-133827cb4d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:27.911934 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7b5d4-a5df-4ac9-9a92-133827cb4d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:27.913541 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7b5d4-a5df-4ac9-9a92-133827cb4d3c admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:27.925189 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1401/2801] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:31:27.934614 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3102988-c1cf-401c-89ed-dfa3ca164231 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:27.948001 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3102988-c1cf-401c-89ed-dfa3ca164231 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:27.954795 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b55686-7cb7-4491-a1b6-27efe61e3842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:27.955853 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b55686-7cb7-4491-a1b6-27efe61e3842 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:27.956070 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b55686-7cb7-4491-a1b6-27efe61e3842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:27.956348 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b55686-7cb7-4491-a1b6-27efe61e3842 admin admin] PATH_INFO: `/v3/projects/4d8db24aea7f4587a3ddffe668e19bc9/users/4c99932c620240d4b47375dbbd6e082f/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:27.973265 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b55686-7cb7-4491-a1b6-27efe61e3842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8db24aea7f4587a3ddffe668e19bc9, user_id=4c99932c620240d4b47375dbbd6e082f, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:27.976036 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b55686-7cb7-4491-a1b6-27efe61e3842 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:28.106821 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1401/2802] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:31:27 2022] PUT /identity/v3/projects/4d8db24aea7f4587a3ddffe668e19bc9/users/4c99932c620240d4b47375dbbd6e082f/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:31:28.111610 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7b5d4-a5df-4ac9-9a92-133827cb4d3c admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:28.127074 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7b5d4-a5df-4ac9-9a92-133827cb4d3c admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:28.189341 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce24545-9eba-4584-b524-9930e360cb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:28.189976 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce24545-9eba-4584-b524-9930e360cb3f admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:28.190271 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce24545-9eba-4584-b524-9930e360cb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:28.190549 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce24545-9eba-4584-b524-9930e360cb3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:28.191286 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce24545-9eba-4584-b524-9930e360cb3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:28.193186 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce24545-9eba-4584-b524-9930e360cb3f admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:28.204547 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1402/2803] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:31:28.209183 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b55686-7cb7-4491-a1b6-27efe61e3842 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:28.220504 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b55686-7cb7-4491-a1b6-27efe61e3842 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:28.225491 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5c252-72fa-4e2c-9f8c-b01f0b441e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:28.226457 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5c252-72fa-4e2c-9f8c-b01f0b441e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:28.226746 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5c252-72fa-4e2c-9f8c-b01f0b441e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:28.227027 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5c252-72fa-4e2c-9f8c-b01f0b441e42 admin admin] PATH_INFO: `/v3/projects/4d8db24aea7f4587a3ddffe668e19bc9/users/4c99932c620240d4b47375dbbd6e082f/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:28.229513 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5c252-72fa-4e2c-9f8c-b01f0b441e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8db24aea7f4587a3ddffe668e19bc9, user_id=4c99932c620240d4b47375dbbd6e082f, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:28.232548 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5c252-72fa-4e2c-9f8c-b01f0b441e42 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:28.243793 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1402/2804] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:31:28 2022] PUT /identity/v3/projects/4d8db24aea7f4587a3ddffe668e19bc9/users/4c99932c620240d4b47375dbbd6e082f/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:31:28.255794 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198452fd-2820-47aa-9bd9-7916d4b70361 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:28.256079 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198452fd-2820-47aa-9bd9-7916d4b70361 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:28.256362 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198452fd-2820-47aa-9bd9-7916d4b70361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:28.287107 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-198452fd-2820-47aa-9bd9-7916d4b70361 None None] MFA Rules not processed for user `4c99932c620240d4b47375dbbd6e082f`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:31:28.288361 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-198452fd-2820-47aa-9bd9-7916d4b70361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:28.363875 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1403/2805] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:31:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:31:28.376895 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5c252-72fa-4e2c-9f8c-b01f0b441e42 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:28.378705 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-43a5c252-72fa-4e2c-9f8c-b01f0b441e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:28.437688 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5c252-72fa-4e2c-9f8c-b01f0b441e42 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:28.441577 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ce226-9ab3-4cbe-80a3-32e0f294d963 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:28.442169 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ce226-9ab3-4cbe-80a3-32e0f294d963 service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:28.442456 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ce226-9ab3-4cbe-80a3-32e0f294d963 service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:28.442744 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ce226-9ab3-4cbe-80a3-32e0f294d963 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:28.453394 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ce226-9ab3-4cbe-80a3-32e0f294d963 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:28.455595 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ce226-9ab3-4cbe-80a3-32e0f294d963 service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:28.465467 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1403/2806] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:31:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:31:28.530379 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198452fd-2820-47aa-9bd9-7916d4b70361 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:28.595886 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198452fd-2820-47aa-9bd9-7916d4b70361 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:28.601945 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76faa70b-eef9-4f14-92cd-4e1922f74778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:28.602859 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76faa70b-eef9-4f14-92cd-4e1922f74778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:28.603151 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76faa70b-eef9-4f14-92cd-4e1922f74778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:28.603432 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76faa70b-eef9-4f14-92cd-4e1922f74778 admin admin] PATH_INFO: `/v3/users/e02f66f906ad4406bd4207d4b094a8f5` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:28.604677 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76faa70b-eef9-4f14-92cd-4e1922f74778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e02f66f906ad4406bd4207d4b094a8f5)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:28.606654 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76faa70b-eef9-4f14-92cd-4e1922f74778 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:28.820690 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-76faa70b-eef9-4f14-92cd-4e1922f74778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e02f66f906ad4406bd4207d4b094a8f5'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:28.915207 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-76faa70b-eef9-4f14-92cd-4e1922f74778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e02f66f906ad4406bd4207d4b094a8f5'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:28.915921 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-76faa70b-eef9-4f14-92cd-4e1922f74778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e02f66f906ad4406bd4207d4b094a8f5'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:28.916522 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-76faa70b-eef9-4f14-92cd-4e1922f74778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e02f66f906ad4406bd4207d4b094a8f5'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:28.925263 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-76faa70b-eef9-4f14-92cd-4e1922f74778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e02f66f906ad4406bd4207d4b094a8f5'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:28.944881 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1404/2807] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:31:28 2022] DELETE /identity/v3/users/e02f66f906ad4406bd4207d4b094a8f5 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:31:28.951983 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff10fb3-7d16-4b59-a021-9def6338cc07 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:28.951983 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff10fb3-7d16-4b59-a021-9def6338cc07 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:28.952437 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff10fb3-7d16-4b59-a021-9def6338cc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:28.973271 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-3ff10fb3-7d16-4b59-a021-9def6338cc07 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:31:28.974545 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-3ff10fb3-7d16-4b59-a021-9def6338cc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:29.039836 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1404/2808] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:31:29.050592 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76faa70b-eef9-4f14-92cd-4e1922f74778 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:29.052118 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-76faa70b-eef9-4f14-92cd-4e1922f74778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:29.122541 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76faa70b-eef9-4f14-92cd-4e1922f74778 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:29.126779 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf29344-d0c1-4b6e-b246-e6e967db6105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:29.127437 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf29344-d0c1-4b6e-b246-e6e967db6105 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:29.127715 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf29344-d0c1-4b6e-b246-e6e967db6105 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:29.127991 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf29344-d0c1-4b6e-b246-e6e967db6105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:29.139073 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf29344-d0c1-4b6e-b246-e6e967db6105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:29.151024 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf29344-d0c1-4b6e-b246-e6e967db6105 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:29.151741 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1405/2809] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:31:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:31:29.668240 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff10fb3-7d16-4b59-a021-9def6338cc07 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:29.669678 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-3ff10fb3-7d16-4b59-a021-9def6338cc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:29.682176 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff10fb3-7d16-4b59-a021-9def6338cc07 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:29.688562 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb0205-85dc-4634-a824-a9961de2606a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:29.689467 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb0205-85dc-4634-a824-a9961de2606a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:29.689756 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb0205-85dc-4634-a824-a9961de2606a admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:29.690031 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb0205-85dc-4634-a824-a9961de2606a admin admin] PATH_INFO: `/v3/projects/ba6c09ffb5e240ffb59b714eb919c0ee` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:29.691335 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb0205-85dc-4634-a824-a9961de2606a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba6c09ffb5e240ffb59b714eb919c0ee)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:29.693485 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb0205-85dc-4634-a824-a9961de2606a admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:29.843616 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-46eb0205-85dc-4634-a824-a9961de2606a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba6c09ffb5e240ffb59b714eb919c0ee', 'request_id': 'req-46eb0205-85dc-4634-a824-a9961de2606a'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:29.943984 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-46eb0205-85dc-4634-a824-a9961de2606a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba6c09ffb5e240ffb59b714eb919c0ee', 'request_id': 'req-46eb0205-85dc-4634-a824-a9961de2606a'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:29.950479 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-46eb0205-85dc-4634-a824-a9961de2606a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba6c09ffb5e240ffb59b714eb919c0ee', 'request_id': 'req-46eb0205-85dc-4634-a824-a9961de2606a'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:29.964643 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-46eb0205-85dc-4634-a824-a9961de2606a admin admin] The token cache is being invalidate because project ba6c09ffb5e240ffb59b714eb919c0ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:31:29.964935 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-46eb0205-85dc-4634-a824-a9961de2606a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:29.965742 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-46eb0205-85dc-4634-a824-a9961de2606a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:29.968083 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1405/2810] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:31:29 2022] DELETE /identity/v3/projects/ba6c09ffb5e240ffb59b714eb919c0ee => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:31:29.972645 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf29344-d0c1-4b6e-b246-e6e967db6105 service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:29.983077 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf29344-d0c1-4b6e-b246-e6e967db6105 service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:30.047861 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96193a-0f16-42f6-8266-d7628ac8765e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:30.048756 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96193a-0f16-42f6-8266-d7628ac8765e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:30.049069 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96193a-0f16-42f6-8266-d7628ac8765e admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:30.049502 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96193a-0f16-42f6-8266-d7628ac8765e admin admin] PATH_INFO: `/v3/users/4c99932c620240d4b47375dbbd6e082f` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:30.050723 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96193a-0f16-42f6-8266-d7628ac8765e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c99932c620240d4b47375dbbd6e082f)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:30.052669 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96193a-0f16-42f6-8266-d7628ac8765e admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:30.264286 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ed96193a-0f16-42f6-8266-d7628ac8765e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c99932c620240d4b47375dbbd6e082f'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:30.388079 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ed96193a-0f16-42f6-8266-d7628ac8765e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c99932c620240d4b47375dbbd6e082f'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:30.389894 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ed96193a-0f16-42f6-8266-d7628ac8765e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c99932c620240d4b47375dbbd6e082f'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:30.390593 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ed96193a-0f16-42f6-8266-d7628ac8765e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c99932c620240d4b47375dbbd6e082f'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:30.400560 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ed96193a-0f16-42f6-8266-d7628ac8765e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c99932c620240d4b47375dbbd6e082f'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:30.425399 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1406/2811] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:31:29 2022] DELETE /identity/v3/users/4c99932c620240d4b47375dbbd6e082f => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:31:30.913995 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb0205-85dc-4634-a824-a9961de2606a admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:30.917503 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-46eb0205-85dc-4634-a824-a9961de2606a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:30.939306 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb0205-85dc-4634-a824-a9961de2606a admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:31.019952 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0741b-fa60-4607-8018-e3b14f78b0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:31.020841 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0741b-fa60-4607-8018-e3b14f78b0ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:31.021178 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0741b-fa60-4607-8018-e3b14f78b0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:31.021504 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0741b-fa60-4607-8018-e3b14f78b0ca admin admin] PATH_INFO: `/v3/projects/4d8db24aea7f4587a3ddffe668e19bc9` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:31.022831 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0741b-fa60-4607-8018-e3b14f78b0ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d8db24aea7f4587a3ddffe668e19bc9)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:31.024811 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0741b-fa60-4607-8018-e3b14f78b0ca admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:31.254960 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f6b0741b-fa60-4607-8018-e3b14f78b0ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d8db24aea7f4587a3ddffe668e19bc9', 'request_id': 'req-f6b0741b-fa60-4607-8018-e3b14f78b0ca'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:31.342325 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f6b0741b-fa60-4607-8018-e3b14f78b0ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d8db24aea7f4587a3ddffe668e19bc9', 'request_id': 'req-f6b0741b-fa60-4607-8018-e3b14f78b0ca'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:31.348741 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f6b0741b-fa60-4607-8018-e3b14f78b0ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d8db24aea7f4587a3ddffe668e19bc9', 'request_id': 'req-f6b0741b-fa60-4607-8018-e3b14f78b0ca'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:31.362299 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f6b0741b-fa60-4607-8018-e3b14f78b0ca admin admin] The token cache is being invalidate because project 4d8db24aea7f4587a3ddffe668e19bc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:31:31.362574 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f6b0741b-fa60-4607-8018-e3b14f78b0ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:31.363244 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-f6b0741b-fa60-4607-8018-e3b14f78b0ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:31.364823 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1406/2812] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:31:30 2022] DELETE /identity/v3/projects/4d8db24aea7f4587a3ddffe668e19bc9 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:31:31.369896 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6aa65-f16d-4d09-a188-fb0e1bed71ba None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:31.371844 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6aa65-f16d-4d09-a188-fb0e1bed71ba None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:31.371844 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6aa65-f16d-4d09-a188-fb0e1bed71ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:31.389165 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-8ad6aa65-f16d-4d09-a188-fb0e1bed71ba None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:31:31.390444 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-8ad6aa65-f16d-4d09-a188-fb0e1bed71ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:31.465911 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1407/2813] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:31:31.475444 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369476a-e45f-4ebc-a7f5-55ccb9c21621 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:31.475883 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369476a-e45f-4ebc-a7f5-55ccb9c21621 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:31.476326 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369476a-e45f-4ebc-a7f5-55ccb9c21621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:31.501814 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-f369476a-e45f-4ebc-a7f5-55ccb9c21621 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:31:31.503041 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-f369476a-e45f-4ebc-a7f5-55ccb9c21621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:31.511785 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1407/2814] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:31:31.517254 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6aa65-f16d-4d09-a188-fb0e1bed71ba None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:31.527462 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6aa65-f16d-4d09-a188-fb0e1bed71ba None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:31.533028 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201aca0c-d29f-4c6a-a6fb-54b5a9808789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:31.533743 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201aca0c-d29f-4c6a-a6fb-54b5a9808789 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:31.534036 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201aca0c-d29f-4c6a-a6fb-54b5a9808789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:31.534319 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201aca0c-d29f-4c6a-a6fb-54b5a9808789 admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:31.535094 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201aca0c-d29f-4c6a-a6fb-54b5a9808789 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:31:31.535472 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201aca0c-d29f-4c6a-a6fb-54b5a9808789 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:31.537094 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201aca0c-d29f-4c6a-a6fb-54b5a9808789 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:31.550961 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1408/2815] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:31:31.556547 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369476a-e45f-4ebc-a7f5-55ccb9c21621 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:31.567459 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369476a-e45f-4ebc-a7f5-55ccb9c21621 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:31.572586 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55659d-2059-40e8-b989-eace06dda3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:31.573256 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55659d-2059-40e8-b989-eace06dda3a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:31.573571 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55659d-2059-40e8-b989-eace06dda3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:31.573845 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55659d-2059-40e8-b989-eace06dda3a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:31.574551 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55659d-2059-40e8-b989-eace06dda3a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:31.577490 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55659d-2059-40e8-b989-eace06dda3a0 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:31.708037 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1408/2816] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:31:31 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:31:31.711452 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201aca0c-d29f-4c6a-a6fb-54b5a9808789 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:31.728513 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201aca0c-d29f-4c6a-a6fb-54b5a9808789 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:31.790310 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdc9c9-2917-48f1-8846-908273fbafe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:31.791002 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdc9c9-2917-48f1-8846-908273fbafe2 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:31.791284 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdc9c9-2917-48f1-8846-908273fbafe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:31.791590 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdc9c9-2917-48f1-8846-908273fbafe2 admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:31.792426 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdc9c9-2917-48f1-8846-908273fbafe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:31.794532 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdc9c9-2917-48f1-8846-908273fbafe2 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:31.891704 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1409/2817] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:31:31 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:31:31.895980 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55659d-2059-40e8-b989-eace06dda3a0 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:31.909186 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55659d-2059-40e8-b989-eace06dda3a0 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:31.916793 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0886-8631-4c23-9b9e-3137acaa6a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:31.921261 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0886-8631-4c23-9b9e-3137acaa6a17 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:31.921261 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0886-8631-4c23-9b9e-3137acaa6a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:31.921261 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0886-8631-4c23-9b9e-3137acaa6a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:31.921261 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b0886-8631-4c23-9b9e-3137acaa6a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:31.923630 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b0886-8631-4c23-9b9e-3137acaa6a17 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:31.945641 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1409/2818] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:31:31.949805 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdc9c9-2917-48f1-8846-908273fbafe2 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:31.961596 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdc9c9-2917-48f1-8846-908273fbafe2 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:31.967832 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b3d66-68b6-4dd2-a6c3-e81275be67c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:31.968647 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b3d66-68b6-4dd2-a6c3-e81275be67c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:31.969008 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b3d66-68b6-4dd2-a6c3-e81275be67c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:31.969398 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b3d66-68b6-4dd2-a6c3-e81275be67c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:31.970151 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b3d66-68b6-4dd2-a6c3-e81275be67c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:31.971943 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b3d66-68b6-4dd2-a6c3-e81275be67c8 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:31.986540 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1410/2819] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:31:31.991839 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0886-8631-4c23-9b9e-3137acaa6a17 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:32.007776 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0886-8631-4c23-9b9e-3137acaa6a17 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:32.012798 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f431885-17a2-4c85-bfc4-895d5f31900e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:32.014270 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f431885-17a2-4c85-bfc4-895d5f31900e admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:32.014547 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f431885-17a2-4c85-bfc4-895d5f31900e admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:32.015018 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f431885-17a2-4c85-bfc4-895d5f31900e admin admin] PATH_INFO: `/v3/projects/dd01bbfe1c8a449bbaa56bd62e71085a/users/3c429e29443d42a78083cca71087219e/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:32.033527 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f431885-17a2-4c85-bfc4-895d5f31900e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd01bbfe1c8a449bbaa56bd62e71085a, user_id=3c429e29443d42a78083cca71087219e, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:32.036238 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f431885-17a2-4c85-bfc4-895d5f31900e admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:32.160822 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1410/2820] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:31:31 2022] PUT /identity/v3/projects/dd01bbfe1c8a449bbaa56bd62e71085a/users/3c429e29443d42a78083cca71087219e/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:31:32.175847 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e2073-0004-4e8e-8199-609b108c727f None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:32.176138 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e2073-0004-4e8e-8199-609b108c727f None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:32.176446 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e2073-0004-4e8e-8199-609b108c727f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:32.207546 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-ae7e2073-0004-4e8e-8199-609b108c727f None None] MFA Rules not processed for user `3c429e29443d42a78083cca71087219e`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:31:32.208778 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-ae7e2073-0004-4e8e-8199-609b108c727f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:32.279384 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1411/2821] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:31:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:31:32.295289 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f431885-17a2-4c85-bfc4-895d5f31900e admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:32.297170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-0f431885-17a2-4c85-bfc4-895d5f31900e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:32.364461 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f431885-17a2-4c85-bfc4-895d5f31900e admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:32.368266 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f733aee-e1e0-429a-8b50-d50a58acb10e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:32.368944 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f733aee-e1e0-429a-8b50-d50a58acb10e service cinder] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:32.369231 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f733aee-e1e0-429a-8b50-d50a58acb10e service cinder] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:32.369547 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f733aee-e1e0-429a-8b50-d50a58acb10e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:32.382606 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f733aee-e1e0-429a-8b50-d50a58acb10e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:32.384138 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f733aee-e1e0-429a-8b50-d50a58acb10e service cinder] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:32.398676 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1411/2822] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:31:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:31:32.420744 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e2073-0004-4e8e-8199-609b108c727f None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:32.510003 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e2073-0004-4e8e-8199-609b108c727f None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:32.522703 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b3729-6fbc-4dd8-8902-d033323ac1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:32.523605 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b3729-6fbc-4dd8-8902-d033323ac1fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:32.523896 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b3729-6fbc-4dd8-8902-d033323ac1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:32.524177 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b3729-6fbc-4dd8-8902-d033323ac1fb admin admin] PATH_INFO: `/v3/users/3c429e29443d42a78083cca71087219e` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:32.525486 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b3729-6fbc-4dd8-8902-d033323ac1fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c429e29443d42a78083cca71087219e)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:32.527486 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b3729-6fbc-4dd8-8902-d033323ac1fb admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:32.790739 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ac7b3729-6fbc-4dd8-8902-d033323ac1fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c429e29443d42a78083cca71087219e'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:32.886784 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ac7b3729-6fbc-4dd8-8902-d033323ac1fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c429e29443d42a78083cca71087219e'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:32.887486 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ac7b3729-6fbc-4dd8-8902-d033323ac1fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c429e29443d42a78083cca71087219e'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:32.888276 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ac7b3729-6fbc-4dd8-8902-d033323ac1fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c429e29443d42a78083cca71087219e'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:32.896992 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-ac7b3729-6fbc-4dd8-8902-d033323ac1fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c429e29443d42a78083cca71087219e'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:32.916735 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1412/2823] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:31:32 2022] DELETE /identity/v3/users/3c429e29443d42a78083cca71087219e => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:31:32.922239 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd1081-2598-4f57-b398-94e7e842aba7 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:32.922767 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd1081-2598-4f57-b398-94e7e842aba7 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:32.922863 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd1081-2598-4f57-b398-94e7e842aba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:32.940864 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-21bd1081-2598-4f57-b398-94e7e842aba7 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:31:32.942118 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-21bd1081-2598-4f57-b398-94e7e842aba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:33.017114 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1412/2824] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:31:33.029739 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b3729-6fbc-4dd8-8902-d033323ac1fb admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:33.031603 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-ac7b3729-6fbc-4dd8-8902-d033323ac1fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:33.098432 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b3729-6fbc-4dd8-8902-d033323ac1fb admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:33.102060 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389aeb2-6acf-4501-8e4f-c1931f7fc892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:33.102710 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389aeb2-6acf-4501-8e4f-c1931f7fc892 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:33.102992 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389aeb2-6acf-4501-8e4f-c1931f7fc892 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:33.103276 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389aeb2-6acf-4501-8e4f-c1931f7fc892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:33.118752 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389aeb2-6acf-4501-8e4f-c1931f7fc892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:33.120197 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389aeb2-6acf-4501-8e4f-c1931f7fc892 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:33.129808 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1413/2825] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:31:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:31:33.539389 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd1081-2598-4f57-b398-94e7e842aba7 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:33.545367 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-21bd1081-2598-4f57-b398-94e7e842aba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:33.553970 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd1081-2598-4f57-b398-94e7e842aba7 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:33.558677 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02907901-d86f-49b9-b8f0-b3ea942cf971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:33.559537 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02907901-d86f-49b9-b8f0-b3ea942cf971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:33.559827 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02907901-d86f-49b9-b8f0-b3ea942cf971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:33.560586 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02907901-d86f-49b9-b8f0-b3ea942cf971 admin admin] PATH_INFO: `/v3/projects/dd01bbfe1c8a449bbaa56bd62e71085a` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:33.562796 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02907901-d86f-49b9-b8f0-b3ea942cf971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd01bbfe1c8a449bbaa56bd62e71085a)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:33.566467 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02907901-d86f-49b9-b8f0-b3ea942cf971 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:33.734093 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-02907901-d86f-49b9-b8f0-b3ea942cf971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd01bbfe1c8a449bbaa56bd62e71085a', 'request_id': 'req-02907901-d86f-49b9-b8f0-b3ea942cf971'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:33.817731 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-02907901-d86f-49b9-b8f0-b3ea942cf971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd01bbfe1c8a449bbaa56bd62e71085a', 'request_id': 'req-02907901-d86f-49b9-b8f0-b3ea942cf971'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:33.825979 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-02907901-d86f-49b9-b8f0-b3ea942cf971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd01bbfe1c8a449bbaa56bd62e71085a', 'request_id': 'req-02907901-d86f-49b9-b8f0-b3ea942cf971'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:33.838572 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-02907901-d86f-49b9-b8f0-b3ea942cf971 admin admin] The token cache is being invalidate because project dd01bbfe1c8a449bbaa56bd62e71085a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:31:33.838899 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-02907901-d86f-49b9-b8f0-b3ea942cf971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:33.839557 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-02907901-d86f-49b9-b8f0-b3ea942cf971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:33.841189 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1413/2826] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:31:33 2022] DELETE /identity/v3/projects/dd01bbfe1c8a449bbaa56bd62e71085a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:31:33.846738 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86fa08-e65f-41f3-8d2f-032bfde4221c None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:33.847377 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86fa08-e65f-41f3-8d2f-032bfde4221c None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:33.847377 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86fa08-e65f-41f3-8d2f-032bfde4221c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:33.868041 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-ee86fa08-e65f-41f3-8d2f-032bfde4221c None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:31:33.869601 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-ee86fa08-e65f-41f3-8d2f-032bfde4221c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:33.949436 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1414/2827] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:31:33.959934 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537b645-d85c-4498-b0e9-37a0a273f861 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:33.960763 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537b645-d85c-4498-b0e9-37a0a273f861 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:33.960763 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537b645-d85c-4498-b0e9-37a0a273f861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:33.980632 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-e537b645-d85c-4498-b0e9-37a0a273f861 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:31:33.983473 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-e537b645-d85c-4498-b0e9-37a0a273f861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:33.991915 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1414/2828] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:31:33.996342 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86fa08-e65f-41f3-8d2f-032bfde4221c None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:34.010499 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86fa08-e65f-41f3-8d2f-032bfde4221c None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:34.016035 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883deca-d66d-4580-893c-74057c167820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:34.016739 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883deca-d66d-4580-893c-74057c167820 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:34.017039 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883deca-d66d-4580-893c-74057c167820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:34.017380 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883deca-d66d-4580-893c-74057c167820 admin admin] PATH_INFO: `/v3/domains` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:34.018233 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883deca-d66d-4580-893c-74057c167820 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:31:34.018545 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883deca-d66d-4580-893c-74057c167820 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:34.020618 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883deca-d66d-4580-893c-74057c167820 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:34.035708 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1415/2829] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:31:34.040234 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537b645-d85c-4498-b0e9-37a0a273f861 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:34.050161 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537b645-d85c-4498-b0e9-37a0a273f861 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:34.054882 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5eb8c6-c38e-4def-80de-7a1f234a65aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:34.055504 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5eb8c6-c38e-4def-80de-7a1f234a65aa admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:34.055790 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5eb8c6-c38e-4def-80de-7a1f234a65aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:34.056071 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5eb8c6-c38e-4def-80de-7a1f234a65aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:34.056777 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5eb8c6-c38e-4def-80de-7a1f234a65aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:34.058686 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5eb8c6-c38e-4def-80de-7a1f234a65aa admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:34.161305 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1415/2830] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:31:34 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:31:34.165985 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883deca-d66d-4580-893c-74057c167820 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:34.177863 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883deca-d66d-4580-893c-74057c167820 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:34.246294 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d46210-507f-422b-93a3-3ec77cf1665f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:34.247352 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d46210-507f-422b-93a3-3ec77cf1665f admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:34.248760 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d46210-507f-422b-93a3-3ec77cf1665f admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:34.249260 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d46210-507f-422b-93a3-3ec77cf1665f admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:34.250599 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d46210-507f-422b-93a3-3ec77cf1665f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:34.254322 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d46210-507f-422b-93a3-3ec77cf1665f admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:34.384113 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1416/2831] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:31:34 2022] POST /identity/v3/users => generated 288 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:31:34.388767 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5eb8c6-c38e-4def-80de-7a1f234a65aa admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:34.399376 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5eb8c6-c38e-4def-80de-7a1f234a65aa admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:34.404778 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956df00-4083-40b2-98c4-22400cff1b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:34.405660 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956df00-4083-40b2-98c4-22400cff1b2d admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:34.405949 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956df00-4083-40b2-98c4-22400cff1b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:34.406232 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956df00-4083-40b2-98c4-22400cff1b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:34.406957 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956df00-4083-40b2-98c4-22400cff1b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:34.408535 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956df00-4083-40b2-98c4-22400cff1b2d admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:34.419979 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1416/2832] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:31:34.424723 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d46210-507f-422b-93a3-3ec77cf1665f admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:34.435621 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d46210-507f-422b-93a3-3ec77cf1665f admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:34.444358 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db78f8-7473-473d-98c1-5072d6bfc359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:34.445094 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db78f8-7473-473d-98c1-5072d6bfc359 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:34.445413 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db78f8-7473-473d-98c1-5072d6bfc359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:34.445698 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db78f8-7473-473d-98c1-5072d6bfc359 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:34.446436 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db78f8-7473-473d-98c1-5072d6bfc359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:34.448080 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db78f8-7473-473d-98c1-5072d6bfc359 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:34.458911 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1417/2833] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:31:34.464071 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956df00-4083-40b2-98c4-22400cff1b2d admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:34.485275 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956df00-4083-40b2-98c4-22400cff1b2d admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:34.492687 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e38bc6-b284-4f28-93be-fd2fe9695665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:34.494306 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e38bc6-b284-4f28-93be-fd2fe9695665 admin admin] REQUEST_METHOD: `PUT` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:34.494724 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e38bc6-b284-4f28-93be-fd2fe9695665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:34.495038 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e38bc6-b284-4f28-93be-fd2fe9695665 admin admin] PATH_INFO: `/v3/projects/fdc41d902c4c49a08e7ad48eee08a035/users/bbd78db2f050466e9c62d44d2f27613f/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:34.519249 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e38bc6-b284-4f28-93be-fd2fe9695665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc41d902c4c49a08e7ad48eee08a035, user_id=bbd78db2f050466e9c62d44d2f27613f, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:34.519249 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e38bc6-b284-4f28-93be-fd2fe9695665 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:34.618724 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1417/2834] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:31:34 2022] PUT /identity/v3/projects/fdc41d902c4c49a08e7ad48eee08a035/users/bbd78db2f050466e9c62d44d2f27613f/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:31:34.629575 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312bfa2-5ae7-4888-be19-bc41c57e8988 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:34.629871 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312bfa2-5ae7-4888-be19-bc41c57e8988 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:34.630159 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312bfa2-5ae7-4888-be19-bc41c57e8988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:34.661398 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-f312bfa2-5ae7-4888-be19-bc41c57e8988 None None] MFA Rules not processed for user `bbd78db2f050466e9c62d44d2f27613f`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:31:34.662617 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-f312bfa2-5ae7-4888-be19-bc41c57e8988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:34.727363 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1418/2835] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:31:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:31:34.733204 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e38bc6-b284-4f28-93be-fd2fe9695665 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:34.815914 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e38bc6-b284-4f28-93be-fd2fe9695665 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:34.823695 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05d249-617c-47a0-bedc-15e88ff93b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:34.824677 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05d249-617c-47a0-bedc-15e88ff93b1f admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:34.825114 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05d249-617c-47a0-bedc-15e88ff93b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:34.826187 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05d249-617c-47a0-bedc-15e88ff93b1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:34.827663 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05d249-617c-47a0-bedc-15e88ff93b1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:34.830934 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05d249-617c-47a0-bedc-15e88ff93b1f admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:34.929239 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1418/2836] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:31:34 2022] POST /identity/v3/projects => generated 375 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:31:34.933700 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312bfa2-5ae7-4888-be19-bc41c57e8988 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:34.946328 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312bfa2-5ae7-4888-be19-bc41c57e8988 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:35.010058 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a17877-26e6-4dde-849a-1e313ac7614e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:35.010795 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a17877-26e6-4dde-849a-1e313ac7614e admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:35.011125 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a17877-26e6-4dde-849a-1e313ac7614e admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:35.011514 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a17877-26e6-4dde-849a-1e313ac7614e admin admin] PATH_INFO: `/v3/users` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:35.012330 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a17877-26e6-4dde-849a-1e313ac7614e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:35.015276 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a17877-26e6-4dde-849a-1e313ac7614e admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:35.120104 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1419/2837] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:31:34 2022] POST /identity/v3/users => generated 294 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:31:35.125454 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05d249-617c-47a0-bedc-15e88ff93b1f admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:35.135639 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05d249-617c-47a0-bedc-15e88ff93b1f admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:35.141971 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadbca5-c57a-4bde-bf03-58f8bfb11715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:35.142646 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadbca5-c57a-4bde-bf03-58f8bfb11715 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:35.142933 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadbca5-c57a-4bde-bf03-58f8bfb11715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:35.143241 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadbca5-c57a-4bde-bf03-58f8bfb11715 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:35.144002 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eadbca5-c57a-4bde-bf03-58f8bfb11715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:35.145711 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eadbca5-c57a-4bde-bf03-58f8bfb11715 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:35.157357 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1419/2838] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:31:35.161567 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a17877-26e6-4dde-849a-1e313ac7614e admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:35.176708 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a17877-26e6-4dde-849a-1e313ac7614e admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:35.181624 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22504ec4-87c2-449d-bbd2-0aeafa1eb9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:35.182534 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22504ec4-87c2-449d-bbd2-0aeafa1eb9e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:35.182815 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22504ec4-87c2-449d-bbd2-0aeafa1eb9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:35.183095 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22504ec4-87c2-449d-bbd2-0aeafa1eb9e0 admin admin] PATH_INFO: `/v3/projects/b696ed49bd6b46dcb38602627ff03659/users/d1d09b12161147afba98029bbc22acbe/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:35.200339 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22504ec4-87c2-449d-bbd2-0aeafa1eb9e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b696ed49bd6b46dcb38602627ff03659, user_id=d1d09b12161147afba98029bbc22acbe, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:35.204002 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22504ec4-87c2-449d-bbd2-0aeafa1eb9e0 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:35.290872 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1420/2839] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:31:35 2022] PUT /identity/v3/projects/b696ed49bd6b46dcb38602627ff03659/users/d1d09b12161147afba98029bbc22acbe/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:31:35.296011 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadbca5-c57a-4bde-bf03-58f8bfb11715 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:35.306567 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadbca5-c57a-4bde-bf03-58f8bfb11715 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:35.381511 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86a4e0-bc02-4488-8c2c-9c6d05917ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:35.382110 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86a4e0-bc02-4488-8c2c-9c6d05917ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:35.382544 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86a4e0-bc02-4488-8c2c-9c6d05917ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:35.382762 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86a4e0-bc02-4488-8c2c-9c6d05917ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:35.383391 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86a4e0-bc02-4488-8c2c-9c6d05917ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:35.384989 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86a4e0-bc02-4488-8c2c-9c6d05917ad4 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:35.395952 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1420/2840] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:31:35.400143 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22504ec4-87c2-449d-bbd2-0aeafa1eb9e0 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:35.410885 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22504ec4-87c2-449d-bbd2-0aeafa1eb9e0 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:35.415563 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272d5de-1641-46b4-a481-8edd09d22cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:35.416521 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272d5de-1641-46b4-a481-8edd09d22cff admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:35.416807 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272d5de-1641-46b4-a481-8edd09d22cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:35.417111 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272d5de-1641-46b4-a481-8edd09d22cff admin admin] PATH_INFO: `/v3/projects/b696ed49bd6b46dcb38602627ff03659/users/d1d09b12161147afba98029bbc22acbe/roles/8cfa924df1a1400986d9ecc9686a7f52` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:35.423751 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272d5de-1641-46b4-a481-8edd09d22cff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b696ed49bd6b46dcb38602627ff03659, user_id=d1d09b12161147afba98029bbc22acbe, role_id=8cfa924df1a1400986d9ecc9686a7f52)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:35.423751 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272d5de-1641-46b4-a481-8edd09d22cff admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:35.434333 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1421/2841] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:31:35 2022] PUT /identity/v3/projects/b696ed49bd6b46dcb38602627ff03659/users/d1d09b12161147afba98029bbc22acbe/roles/8cfa924df1a1400986d9ecc9686a7f52 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:31:35.445890 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81489616-3bf9-4d03-88c2-d520bef74210 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:35.446089 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81489616-3bf9-4d03-88c2-d520bef74210 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:35.446295 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81489616-3bf9-4d03-88c2-d520bef74210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:35.475426 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-81489616-3bf9-4d03-88c2-d520bef74210 None None] MFA Rules not processed for user `d1d09b12161147afba98029bbc22acbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:31:35.476718 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-81489616-3bf9-4d03-88c2-d520bef74210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:35.557470 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1421/2842] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:31:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:31:35.569548 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272d5de-1641-46b4-a481-8edd09d22cff admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:35.571263 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-1272d5de-1641-46b4-a481-8edd09d22cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:35.642067 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272d5de-1641-46b4-a481-8edd09d22cff admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:35.647555 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca54142-105d-4c51-9d31-40ea4c5a7c65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:35.648240 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca54142-105d-4c51-9d31-40ea4c5a7c65 service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:35.648526 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca54142-105d-4c51-9d31-40ea4c5a7c65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:35.648805 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca54142-105d-4c51-9d31-40ea4c5a7c65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:35.712291 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca54142-105d-4c51-9d31-40ea4c5a7c65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:35.713871 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca54142-105d-4c51-9d31-40ea4c5a7c65 service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:35.723781 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1422/2843] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:31:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:31:38.888239 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81489616-3bf9-4d03-88c2-d520bef74210 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:38.955229 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81489616-3bf9-4d03-88c2-d520bef74210 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:38.959969 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b664338-83d0-4ff0-ba19-d0b3c469340c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:38.960839 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b664338-83d0-4ff0-ba19-d0b3c469340c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:38.961121 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b664338-83d0-4ff0-ba19-d0b3c469340c admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:38.961430 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b664338-83d0-4ff0-ba19-d0b3c469340c admin admin] PATH_INFO: `/v3/users/bbd78db2f050466e9c62d44d2f27613f` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:38.962623 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b664338-83d0-4ff0-ba19-d0b3c469340c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd78db2f050466e9c62d44d2f27613f)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:38.964541 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b664338-83d0-4ff0-ba19-d0b3c469340c admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:39.237143 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-1b664338-83d0-4ff0-ba19-d0b3c469340c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd78db2f050466e9c62d44d2f27613f'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:39.337745 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-1b664338-83d0-4ff0-ba19-d0b3c469340c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd78db2f050466e9c62d44d2f27613f'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:39.338423 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-1b664338-83d0-4ff0-ba19-d0b3c469340c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd78db2f050466e9c62d44d2f27613f'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:39.347609 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-1b664338-83d0-4ff0-ba19-d0b3c469340c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd78db2f050466e9c62d44d2f27613f'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:39.366515 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-1b664338-83d0-4ff0-ba19-d0b3c469340c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd78db2f050466e9c62d44d2f27613f'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:39.378467 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1422/2844] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:31:38 2022] DELETE /identity/v3/users/bbd78db2f050466e9c62d44d2f27613f => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:31:39.384784 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7a603-915b-47e8-8610-087f3125a8fa None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:39.385532 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7a603-915b-47e8-8610-087f3125a8fa None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:39.385532 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7a603-915b-47e8-8610-087f3125a8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:39.404474 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-4bb7a603-915b-47e8-8610-087f3125a8fa None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:31:39.405886 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-4bb7a603-915b-47e8-8610-087f3125a8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:39.474653 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1423/2845] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:31:39.484899 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b664338-83d0-4ff0-ba19-d0b3c469340c admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:39.486363 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-1b664338-83d0-4ff0-ba19-d0b3c469340c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:39.553990 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b664338-83d0-4ff0-ba19-d0b3c469340c admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:39.557639 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2802e1-eba2-4c55-9144-48cd772e47bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:39.558294 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2802e1-eba2-4c55-9144-48cd772e47bd service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:39.558577 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2802e1-eba2-4c55-9144-48cd772e47bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:39.558856 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2802e1-eba2-4c55-9144-48cd772e47bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:39.570079 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2802e1-eba2-4c55-9144-48cd772e47bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:39.571510 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2802e1-eba2-4c55-9144-48cd772e47bd service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:39.582598 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1423/2846] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:31:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:31:40.041985 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7a603-915b-47e8-8610-087f3125a8fa None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:40.050093 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-4bb7a603-915b-47e8-8610-087f3125a8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:40.057277 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7a603-915b-47e8-8610-087f3125a8fa None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:40.063217 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b7688-01ae-4a39-b637-0e8e91c17dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:40.064097 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b7688-01ae-4a39-b637-0e8e91c17dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:40.064381 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b7688-01ae-4a39-b637-0e8e91c17dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:40.064662 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b7688-01ae-4a39-b637-0e8e91c17dfc admin admin] PATH_INFO: `/v3/projects/fdc41d902c4c49a08e7ad48eee08a035` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:40.065897 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b7688-01ae-4a39-b637-0e8e91c17dfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc41d902c4c49a08e7ad48eee08a035)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:40.068097 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b7688-01ae-4a39-b637-0e8e91c17dfc admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:40.212331 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7c4b7688-01ae-4a39-b637-0e8e91c17dfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc41d902c4c49a08e7ad48eee08a035', 'request_id': 'req-7c4b7688-01ae-4a39-b637-0e8e91c17dfc'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:40.218677 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7c4b7688-01ae-4a39-b637-0e8e91c17dfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc41d902c4c49a08e7ad48eee08a035', 'request_id': 'req-7c4b7688-01ae-4a39-b637-0e8e91c17dfc'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:40.225024 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7c4b7688-01ae-4a39-b637-0e8e91c17dfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc41d902c4c49a08e7ad48eee08a035', 'request_id': 'req-7c4b7688-01ae-4a39-b637-0e8e91c17dfc'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:40.315207 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7c4b7688-01ae-4a39-b637-0e8e91c17dfc admin admin] The token cache is being invalidate because project fdc41d902c4c49a08e7ad48eee08a035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:31:40.315599 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7c4b7688-01ae-4a39-b637-0e8e91c17dfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:40.316342 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-7c4b7688-01ae-4a39-b637-0e8e91c17dfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:40.318441 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1424/2847] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:31:40 2022] DELETE /identity/v3/projects/fdc41d902c4c49a08e7ad48eee08a035 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:31:40.322860 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2802e1-eba2-4c55-9144-48cd772e47bd service neutron] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:40.332564 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2802e1-eba2-4c55-9144-48cd772e47bd service neutron] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:40.389881 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602891cb-4676-4a8d-9177-c58ed300852a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:40.390755 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602891cb-4676-4a8d-9177-c58ed300852a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:40.391036 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602891cb-4676-4a8d-9177-c58ed300852a admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:40.391312 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602891cb-4676-4a8d-9177-c58ed300852a admin admin] PATH_INFO: `/v3/users/d1d09b12161147afba98029bbc22acbe` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:40.392492 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602891cb-4676-4a8d-9177-c58ed300852a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1d09b12161147afba98029bbc22acbe)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:40.394423 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602891cb-4676-4a8d-9177-c58ed300852a admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:40.608483 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-602891cb-4676-4a8d-9177-c58ed300852a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1d09b12161147afba98029bbc22acbe'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:40.686465 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-602891cb-4676-4a8d-9177-c58ed300852a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1d09b12161147afba98029bbc22acbe'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:40.687102 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-602891cb-4676-4a8d-9177-c58ed300852a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1d09b12161147afba98029bbc22acbe'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:40.695024 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-602891cb-4676-4a8d-9177-c58ed300852a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1d09b12161147afba98029bbc22acbe'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:40.708349 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-602891cb-4676-4a8d-9177-c58ed300852a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1d09b12161147afba98029bbc22acbe'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:40.714778 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1424/2848] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:31:40 2022] DELETE /identity/v3/users/d1d09b12161147afba98029bbc22acbe => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:31:41.123792 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b7688-01ae-4a39-b637-0e8e91c17dfc admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:41.125338 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-7c4b7688-01ae-4a39-b637-0e8e91c17dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:41.142625 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b7688-01ae-4a39-b637-0e8e91c17dfc admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:41.210299 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2567a4-d664-4bc4-a057-525170f29cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:41.210988 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2567a4-d664-4bc4-a057-525170f29cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:41.211277 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2567a4-d664-4bc4-a057-525170f29cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:41.211562 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2567a4-d664-4bc4-a057-525170f29cee admin admin] PATH_INFO: `/v3/projects/b696ed49bd6b46dcb38602627ff03659` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:41.212786 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2567a4-d664-4bc4-a057-525170f29cee admin admin] RBAC: Authorizing `identity:delete_project(project_id=b696ed49bd6b46dcb38602627ff03659)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:41.214730 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2567a4-d664-4bc4-a057-525170f29cee admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:41.334694 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-8a2567a4-d664-4bc4-a057-525170f29cee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b696ed49bd6b46dcb38602627ff03659', 'request_id': 'req-8a2567a4-d664-4bc4-a057-525170f29cee'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:41.340515 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-8a2567a4-d664-4bc4-a057-525170f29cee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b696ed49bd6b46dcb38602627ff03659', 'request_id': 'req-8a2567a4-d664-4bc4-a057-525170f29cee'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:41.347312 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-8a2567a4-d664-4bc4-a057-525170f29cee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b696ed49bd6b46dcb38602627ff03659', 'request_id': 'req-8a2567a4-d664-4bc4-a057-525170f29cee'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:41.433587 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-8a2567a4-d664-4bc4-a057-525170f29cee admin admin] The token cache is being invalidate because project b696ed49bd6b46dcb38602627ff03659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:31:41.433959 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-8a2567a4-d664-4bc4-a057-525170f29cee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:41.435573 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-8a2567a4-d664-4bc4-a057-525170f29cee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:31:41.437728 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1425/2849] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:31:41 2022] DELETE /identity/v3/projects/b696ed49bd6b46dcb38602627ff03659 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:31:41.443447 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35c4cd-0f07-4171-89da-958ca4702972 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:41.443912 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35c4cd-0f07-4171-89da-958ca4702972 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:41.444026 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35c4cd-0f07-4171-89da-958ca4702972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:41.464230 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-2c35c4cd-0f07-4171-89da-958ca4702972 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:31:41.465615 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-2c35c4cd-0f07-4171-89da-958ca4702972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:41.527080 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1425/2850] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:31:41.536092 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f39eca-c582-4421-86e2-3e9658d2a767 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:41.536379 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f39eca-c582-4421-86e2-3e9658d2a767 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:41.536716 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f39eca-c582-4421-86e2-3e9658d2a767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:41.556238 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-02f39eca-c582-4421-86e2-3e9658d2a767 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:31:41.557564 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-02f39eca-c582-4421-86e2-3e9658d2a767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:41.566418 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1426/2851] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:31:41.621788 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35c4cd-0f07-4171-89da-958ca4702972 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:41.633009 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35c4cd-0f07-4171-89da-958ca4702972 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:41.637733 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb7ec4-310e-4edc-b582-0fa1da722ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:41.638573 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb7ec4-310e-4edc-b582-0fa1da722ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:41.638857 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb7ec4-310e-4edc-b582-0fa1da722ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:41.639138 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb7ec4-310e-4edc-b582-0fa1da722ca1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:41.639862 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb7ec4-310e-4edc-b582-0fa1da722ca1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:31:41.640175 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb7ec4-310e-4edc-b582-0fa1da722ca1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:41.641800 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb7ec4-310e-4edc-b582-0fa1da722ca1 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:41.655269 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1426/2852] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:31:41.659193 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f39eca-c582-4421-86e2-3e9658d2a767 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:41.668600 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f39eca-c582-4421-86e2-3e9658d2a767 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:41.674811 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd64589-8871-4c72-8535-176cca09554c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:41.675474 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd64589-8871-4c72-8535-176cca09554c admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:41.675791 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd64589-8871-4c72-8535-176cca09554c admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:41.676050 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd64589-8871-4c72-8535-176cca09554c admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:41.676779 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd64589-8871-4c72-8535-176cca09554c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:41.678744 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd64589-8871-4c72-8535-176cca09554c admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:41.795573 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1427/2853] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:31:41 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:31:41.799770 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb7ec4-310e-4edc-b582-0fa1da722ca1 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:41.810775 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb7ec4-310e-4edc-b582-0fa1da722ca1 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:41.869631 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba5cc9-9199-4f74-979d-bafe8c189f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:41.870295 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba5cc9-9199-4f74-979d-bafe8c189f88 admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:41.870612 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba5cc9-9199-4f74-979d-bafe8c189f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:41.870914 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba5cc9-9199-4f74-979d-bafe8c189f88 admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:41.871598 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba5cc9-9199-4f74-979d-bafe8c189f88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:41.874059 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba5cc9-9199-4f74-979d-bafe8c189f88 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:41.982863 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1427/2854] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:31:41 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:31:41.987073 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd64589-8871-4c72-8535-176cca09554c admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:41.998080 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd64589-8871-4c72-8535-176cca09554c admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:42.003002 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd104b30-3d5c-4209-9309-44695e3a36f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:42.003695 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd104b30-3d5c-4209-9309-44695e3a36f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:42.003983 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd104b30-3d5c-4209-9309-44695e3a36f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:42.004268 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd104b30-3d5c-4209-9309-44695e3a36f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:42.005004 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd104b30-3d5c-4209-9309-44695e3a36f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:42.006766 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd104b30-3d5c-4209-9309-44695e3a36f9 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:42.018539 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1428/2855] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:31:42.022697 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba5cc9-9199-4f74-979d-bafe8c189f88 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:42.033704 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba5cc9-9199-4f74-979d-bafe8c189f88 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:42.038448 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf6627-f463-4456-8418-e4f561ee8212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:42.039110 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf6627-f463-4456-8418-e4f561ee8212 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:42.039396 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf6627-f463-4456-8418-e4f561ee8212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:42.039677 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf6627-f463-4456-8418-e4f561ee8212 admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:42.040396 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf6627-f463-4456-8418-e4f561ee8212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:42.042029 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf6627-f463-4456-8418-e4f561ee8212 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:42.052369 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1428/2856] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 20:31:42.066057 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd104b30-3d5c-4209-9309-44695e3a36f9 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:42.077376 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd104b30-3d5c-4209-9309-44695e3a36f9 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:42.082171 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9a74d-7fc6-463f-84fb-939419479b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:42.083137 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9a74d-7fc6-463f-84fb-939419479b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:42.083424 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9a74d-7fc6-463f-84fb-939419479b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:42.083707 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9a74d-7fc6-463f-84fb-939419479b22 admin admin] PATH_INFO: `/v3/projects/17625194421a4f409614da6e89b524e0/users/bdefde837bfc4956bb341c029fa79a36/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:42.102174 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9a74d-7fc6-463f-84fb-939419479b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17625194421a4f409614da6e89b524e0, user_id=bdefde837bfc4956bb341c029fa79a36, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:42.104929 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9a74d-7fc6-463f-84fb-939419479b22 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:42.210618 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1429/2857] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:31:42 2022] PUT /identity/v3/projects/17625194421a4f409614da6e89b524e0/users/bdefde837bfc4956bb341c029fa79a36/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:31:42.221513 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bc11a-ae36-4823-97db-2abb48f33adf None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:42.221808 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bc11a-ae36-4823-97db-2abb48f33adf None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:42.222093 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bc11a-ae36-4823-97db-2abb48f33adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:42.250009 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-229bc11a-ae36-4823-97db-2abb48f33adf None None] MFA Rules not processed for user `bdefde837bfc4956bb341c029fa79a36`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:31:42.251255 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-229bc11a-ae36-4823-97db-2abb48f33adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:42.316394 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1429/2858] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:31:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:31:42.329026 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9a74d-7fc6-463f-84fb-939419479b22 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:31:42.330881 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-3ee9a74d-7fc6-463f-84fb-939419479b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:31:42.386472 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9a74d-7fc6-463f-84fb-939419479b22 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:31:42.390779 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfc280-ddf8-477b-95d0-614d46b14dcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:31:42.391424 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfc280-ddf8-477b-95d0-614d46b14dcd service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:31:42.391710 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfc280-ddf8-477b-95d0-614d46b14dcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:31:42.391988 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfc280-ddf8-477b-95d0-614d46b14dcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:31:42.400335 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfc280-ddf8-477b-95d0-614d46b14dcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:31:42.401807 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfc280-ddf8-477b-95d0-614d46b14dcd service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:31:42.411528 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1430/2859] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:31:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:32:12.257751 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229bc11a-ae36-4823-97db-2abb48f33adf None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:32:12.326939 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229bc11a-ae36-4823-97db-2abb48f33adf None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:32:12.332127 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfbcad-c5eb-4d8f-b3f4-39d85ea8ff60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:32:12.336552 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfbcad-c5eb-4d8f-b3f4-39d85ea8ff60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:12.336552 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfbcad-c5eb-4d8f-b3f4-39d85ea8ff60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:12.336552 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfbcad-c5eb-4d8f-b3f4-39d85ea8ff60 admin admin] PATH_INFO: `/v3/users/bdefde837bfc4956bb341c029fa79a36` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:12.336552 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfbcad-c5eb-4d8f-b3f4-39d85ea8ff60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdefde837bfc4956bb341c029fa79a36)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:32:12.336931 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfbcad-c5eb-4d8f-b3f4-39d85ea8ff60 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:32:12.613065 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a2cfbcad-c5eb-4d8f-b3f4-39d85ea8ff60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdefde837bfc4956bb341c029fa79a36'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:12.714243 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a2cfbcad-c5eb-4d8f-b3f4-39d85ea8ff60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdefde837bfc4956bb341c029fa79a36'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:12.714888 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a2cfbcad-c5eb-4d8f-b3f4-39d85ea8ff60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdefde837bfc4956bb341c029fa79a36'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:12.722607 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a2cfbcad-c5eb-4d8f-b3f4-39d85ea8ff60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdefde837bfc4956bb341c029fa79a36'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:12.735384 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a2cfbcad-c5eb-4d8f-b3f4-39d85ea8ff60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdefde837bfc4956bb341c029fa79a36'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:12.741779 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1430/2860] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:32:12 2022] DELETE /identity/v3/users/bdefde837bfc4956bb341c029fa79a36 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:32:12.747015 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de86a50-8dfa-4f97-852e-dd162e951df3 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:12.747546 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de86a50-8dfa-4f97-852e-dd162e951df3 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:12.747686 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de86a50-8dfa-4f97-852e-dd162e951df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:12.768274 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-9de86a50-8dfa-4f97-852e-dd162e951df3 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:32:12.768274 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-9de86a50-8dfa-4f97-852e-dd162e951df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:32:12.842109 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1431/2861] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:32:12.851469 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfbcad-c5eb-4d8f-b3f4-39d85ea8ff60 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:32:12.852949 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-a2cfbcad-c5eb-4d8f-b3f4-39d85ea8ff60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:32:12.917590 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfbcad-c5eb-4d8f-b3f4-39d85ea8ff60 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:32:12.922329 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49dc22-e8a2-4e3f-855d-ce00ca7bd552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:32:12.926557 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49dc22-e8a2-4e3f-855d-ce00ca7bd552 service neutron] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:12.926557 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49dc22-e8a2-4e3f-855d-ce00ca7bd552 service neutron] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:12.926557 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49dc22-e8a2-4e3f-855d-ce00ca7bd552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:12.940451 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49dc22-e8a2-4e3f-855d-ce00ca7bd552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:32:12.941965 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49dc22-e8a2-4e3f-855d-ce00ca7bd552 service neutron] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:32:12.953984 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1431/2862] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:32:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:32:13.447568 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de86a50-8dfa-4f97-852e-dd162e951df3 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:32:13.450245 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-9de86a50-8dfa-4f97-852e-dd162e951df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:32:13.461277 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de86a50-8dfa-4f97-852e-dd162e951df3 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:32:13.467741 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024862a-5400-4e1b-8415-b58901f5b8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:32:13.468618 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024862a-5400-4e1b-8415-b58901f5b8f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:13.468898 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024862a-5400-4e1b-8415-b58901f5b8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:13.469173 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024862a-5400-4e1b-8415-b58901f5b8f1 admin admin] PATH_INFO: `/v3/projects/17625194421a4f409614da6e89b524e0` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:13.470564 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024862a-5400-4e1b-8415-b58901f5b8f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17625194421a4f409614da6e89b524e0)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:32:13.472498 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024862a-5400-4e1b-8415-b58901f5b8f1 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:32:13.634065 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-8024862a-5400-4e1b-8415-b58901f5b8f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17625194421a4f409614da6e89b524e0', 'request_id': 'req-8024862a-5400-4e1b-8415-b58901f5b8f1'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:13.640556 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-8024862a-5400-4e1b-8415-b58901f5b8f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17625194421a4f409614da6e89b524e0', 'request_id': 'req-8024862a-5400-4e1b-8415-b58901f5b8f1'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:13.647167 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-8024862a-5400-4e1b-8415-b58901f5b8f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17625194421a4f409614da6e89b524e0', 'request_id': 'req-8024862a-5400-4e1b-8415-b58901f5b8f1'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:13.734875 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-8024862a-5400-4e1b-8415-b58901f5b8f1 admin admin] The token cache is being invalidate because project 17625194421a4f409614da6e89b524e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:32:13.735190 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-8024862a-5400-4e1b-8415-b58901f5b8f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:13.735800 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-8024862a-5400-4e1b-8415-b58901f5b8f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:13.737424 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1432/2863] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:32:13 2022] DELETE /identity/v3/projects/17625194421a4f409614da6e89b524e0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:32:13.742855 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530c46b-6de6-4a28-bd73-eb323a4e646b None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:13.743370 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530c46b-6de6-4a28-bd73-eb323a4e646b None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:13.743789 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530c46b-6de6-4a28-bd73-eb323a4e646b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:13.764625 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-e530c46b-6de6-4a28-bd73-eb323a4e646b None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:32:13.765893 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-e530c46b-6de6-4a28-bd73-eb323a4e646b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:32:13.841760 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1432/2864] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:32:13.849557 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901dbfa-6217-4f33-8f6c-09ac41fbe2e4 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:13.850191 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901dbfa-6217-4f33-8f6c-09ac41fbe2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:13.850316 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901dbfa-6217-4f33-8f6c-09ac41fbe2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:13.869206 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-1901dbfa-6217-4f33-8f6c-09ac41fbe2e4 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:32:13.870470 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-1901dbfa-6217-4f33-8f6c-09ac41fbe2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:32:13.879032 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1433/2865] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:32:13.884559 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530c46b-6de6-4a28-bd73-eb323a4e646b None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:32:13.895971 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530c46b-6de6-4a28-bd73-eb323a4e646b None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:32:13.900768 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee1a04-a801-476e-bea7-b5e194787180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:32:13.901449 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee1a04-a801-476e-bea7-b5e194787180 admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:13.901735 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee1a04-a801-476e-bea7-b5e194787180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:13.902015 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee1a04-a801-476e-bea7-b5e194787180 admin admin] PATH_INFO: `/v3/domains` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:13.903373 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee1a04-a801-476e-bea7-b5e194787180 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 20:32:13.903884 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee1a04-a801-476e-bea7-b5e194787180 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:32:13.905536 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee1a04-a801-476e-bea7-b5e194787180 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:32:13.917731 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1433/2866] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Mar 29 20:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 20:32:13.922535 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901dbfa-6217-4f33-8f6c-09ac41fbe2e4 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:32:13.933667 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901dbfa-6217-4f33-8f6c-09ac41fbe2e4 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:32:13.939531 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5819ec9-c4a7-46eb-952c-808c096f0d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:32:13.940239 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5819ec9-c4a7-46eb-952c-808c096f0d47 admin admin] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:13.940650 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5819ec9-c4a7-46eb-952c-808c096f0d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:13.941154 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5819ec9-c4a7-46eb-952c-808c096f0d47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:13.942052 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5819ec9-c4a7-46eb-952c-808c096f0d47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:32:13.944537 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5819ec9-c4a7-46eb-952c-808c096f0d47 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:32:14.038280 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1434/2867] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Mar 29 20:32:13 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 20:32:14.042696 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee1a04-a801-476e-bea7-b5e194787180 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:32:14.053814 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee1a04-a801-476e-bea7-b5e194787180 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:32:14.114210 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a124a55-c12e-4c60-9687-f851df4d6b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:32:14.114948 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a124a55-c12e-4c60-9687-f851df4d6b3b admin admin] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:14.115234 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a124a55-c12e-4c60-9687-f851df4d6b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:14.115517 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a124a55-c12e-4c60-9687-f851df4d6b3b admin admin] PATH_INFO: `/v3/users` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:14.116239 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a124a55-c12e-4c60-9687-f851df4d6b3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:32:14.118204 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a124a55-c12e-4c60-9687-f851df4d6b3b admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:32:14.240967 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1434/2868] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Mar 29 20:32:14 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 20:32:14.245961 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5819ec9-c4a7-46eb-952c-808c096f0d47 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:32:14.257840 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5819ec9-c4a7-46eb-952c-808c096f0d47 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:32:14.263656 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a2303-357b-4425-8431-dfa9c120e536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:32:14.264045 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a2303-357b-4425-8431-dfa9c120e536 admin admin] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:14.264329 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a2303-357b-4425-8431-dfa9c120e536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:14.264609 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a2303-357b-4425-8431-dfa9c120e536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:14.265448 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a2303-357b-4425-8431-dfa9c120e536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:32:14.267057 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a2303-357b-4425-8431-dfa9c120e536 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:32:14.278155 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1435/2869] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:32:14.282861 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a124a55-c12e-4c60-9687-f851df4d6b3b admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:32:14.294309 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a124a55-c12e-4c60-9687-f851df4d6b3b admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:32:14.299019 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0963bc-d91b-41cb-8516-ba3cfd1d10bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:32:14.299691 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0963bc-d91b-41cb-8516-ba3cfd1d10bc admin admin] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:14.299973 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0963bc-d91b-41cb-8516-ba3cfd1d10bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:14.300248 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0963bc-d91b-41cb-8516-ba3cfd1d10bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:14.300977 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0963bc-d91b-41cb-8516-ba3cfd1d10bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:32:14.302601 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0963bc-d91b-41cb-8516-ba3cfd1d10bc admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:32:14.313994 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1435/2870] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Mar 29 20:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 20:32:14.318745 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a2303-357b-4425-8431-dfa9c120e536 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:32:14.329660 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a2303-357b-4425-8431-dfa9c120e536 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:32:14.334210 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a734a19-3738-4633-9b94-81ba765ac795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:32:14.335092 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a734a19-3738-4633-9b94-81ba765ac795 admin admin] REQUEST_METHOD: `PUT` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:14.335371 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a734a19-3738-4633-9b94-81ba765ac795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:14.335642 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a734a19-3738-4633-9b94-81ba765ac795 admin admin] PATH_INFO: `/v3/projects/49220b2aae834a34a712db331db46a9c/users/b4d94d4485a94946af692e823249f411/roles/e49df2a8408b4f5fa7e284575007ce83` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:14.351298 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a734a19-3738-4633-9b94-81ba765ac795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49220b2aae834a34a712db331db46a9c, user_id=b4d94d4485a94946af692e823249f411, role_id=e49df2a8408b4f5fa7e284575007ce83)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:32:14.353976 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a734a19-3738-4633-9b94-81ba765ac795 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:32:14.417379 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1436/2871] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Mar 29 20:32:14 2022] PUT /identity/v3/projects/49220b2aae834a34a712db331db46a9c/users/b4d94d4485a94946af692e823249f411/roles/e49df2a8408b4f5fa7e284575007ce83 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:32:14.429553 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23626d13-1bc4-4646-afd8-12ba9258260c None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:14.429827 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23626d13-1bc4-4646-afd8-12ba9258260c None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:14.430109 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23626d13-1bc4-4646-afd8-12ba9258260c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:14.460634 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-23626d13-1bc4-4646-afd8-12ba9258260c None None] MFA Rules not processed for user `b4d94d4485a94946af692e823249f411`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:32:14.462170 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-23626d13-1bc4-4646-afd8-12ba9258260c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:32:14.553825 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1436/2872] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:32:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:32:14.565434 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a734a19-3738-4633-9b94-81ba765ac795 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:32:14.567195 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-8a734a19-3738-4633-9b94-81ba765ac795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:32:14.628235 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a734a19-3738-4633-9b94-81ba765ac795 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:32:14.632062 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b051c2-1129-49b5-80d1-1511d520f6e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8ea87a7fd34751896b2a0ffaedab2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:32:14.632728 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b051c2-1129-49b5-80d1-1511d520f6e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:14.633011 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b051c2-1129-49b5-80d1-1511d520f6e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:14.633312 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b051c2-1129-49b5-80d1-1511d520f6e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:14.642798 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b051c2-1129-49b5-80d1-1511d520f6e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:32:14.644510 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b051c2-1129-49b5-80d1-1511d520f6e8 service cinder] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:32:14.656856 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1437/2873] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:32:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:32:18.679692 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1056b-d6a0-46b5-b602-3799ccd988c4 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:18.684179 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1056b-d6a0-46b5-b602-3799ccd988c4 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:18.684179 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1056b-d6a0-46b5-b602-3799ccd988c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:18.700384 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-cfe1056b-d6a0-46b5-b602-3799ccd988c4 None None] MFA Rules not processed for user `b4d94d4485a94946af692e823249f411`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:32:18.701407 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-cfe1056b-d6a0-46b5-b602-3799ccd988c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:32:18.708624 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1437/2874] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:32:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:32:30.606684 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b051c2-1129-49b5-80d1-1511d520f6e8 service cinder] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:32:30.609078 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-e4b051c2-1129-49b5-80d1-1511d520f6e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:32:30.689421 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b051c2-1129-49b5-80d1-1511d520f6e8 service cinder] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:32:30.694729 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1d67d-6836-4ca0-8670-2120e245f30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:32:30.695637 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1d67d-6836-4ca0-8670-2120e245f30a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:30.695923 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1d67d-6836-4ca0-8670-2120e245f30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:30.696201 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1d67d-6836-4ca0-8670-2120e245f30a admin admin] PATH_INFO: `/v3/users/3c7ebab7c96141118f263e658b9059d8` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:30.697488 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1d67d-6836-4ca0-8670-2120e245f30a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c7ebab7c96141118f263e658b9059d8)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:32:30.700149 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1d67d-6836-4ca0-8670-2120e245f30a admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:32:30.889959 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d5e1d67d-6836-4ca0-8670-2120e245f30a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c7ebab7c96141118f263e658b9059d8'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:30.965673 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d5e1d67d-6836-4ca0-8670-2120e245f30a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c7ebab7c96141118f263e658b9059d8'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:30.966310 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d5e1d67d-6836-4ca0-8670-2120e245f30a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c7ebab7c96141118f263e658b9059d8'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:30.967911 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d5e1d67d-6836-4ca0-8670-2120e245f30a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c7ebab7c96141118f263e658b9059d8'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:30.976276 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-d5e1d67d-6836-4ca0-8670-2120e245f30a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c7ebab7c96141118f263e658b9059d8'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:31.000491 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1438/2875] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:32:30 2022] DELETE /identity/v3/users/3c7ebab7c96141118f263e658b9059d8 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 20:32:31.304095 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1056b-d6a0-46b5-b602-3799ccd988c4 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:32:31.316275 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1056b-d6a0-46b5-b602-3799ccd988c4 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:32:31.377875 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad227ae7-6fb4-46df-864c-def6fb1e946d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:32:31.378668 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad227ae7-6fb4-46df-864c-def6fb1e946d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:31.378957 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad227ae7-6fb4-46df-864c-def6fb1e946d admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:31.379242 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad227ae7-6fb4-46df-864c-def6fb1e946d admin admin] PATH_INFO: `/v3/projects/c2dcb93c78b744409bc8b0d8c5aa967d` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:31.380447 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad227ae7-6fb4-46df-864c-def6fb1e946d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2dcb93c78b744409bc8b0d8c5aa967d)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:32:31.382394 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad227ae7-6fb4-46df-864c-def6fb1e946d admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:32:31.483862 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-ad227ae7-6fb4-46df-864c-def6fb1e946d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2dcb93c78b744409bc8b0d8c5aa967d', 'request_id': 'req-ad227ae7-6fb4-46df-864c-def6fb1e946d'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:31.552226 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-ad227ae7-6fb4-46df-864c-def6fb1e946d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2dcb93c78b744409bc8b0d8c5aa967d', 'request_id': 'req-ad227ae7-6fb4-46df-864c-def6fb1e946d'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:31.559581 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-ad227ae7-6fb4-46df-864c-def6fb1e946d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2dcb93c78b744409bc8b0d8c5aa967d', 'request_id': 'req-ad227ae7-6fb4-46df-864c-def6fb1e946d'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:31.571907 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-ad227ae7-6fb4-46df-864c-def6fb1e946d admin admin] The token cache is being invalidate because project c2dcb93c78b744409bc8b0d8c5aa967d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:32:31.572196 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-ad227ae7-6fb4-46df-864c-def6fb1e946d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:31.572866 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-ad227ae7-6fb4-46df-864c-def6fb1e946d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:31.575162 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1438/2876] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:32:31 2022] DELETE /identity/v3/projects/c2dcb93c78b744409bc8b0d8c5aa967d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:32:36.474136 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573711a-9dd3-49f3-a6fd-1130843b88ac None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:36.474714 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573711a-9dd3-49f3-a6fd-1130843b88ac None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:36.474714 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573711a-9dd3-49f3-a6fd-1130843b88ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:36.493809 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-a573711a-9dd3-49f3-a6fd-1130843b88ac None None] MFA Rules not processed for user `a706b6d0163549bc80285c4158331b94`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:32:36.495158 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a573711a-9dd3-49f3-a6fd-1130843b88ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:32:36.560791 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1439/2877] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Mar 29 20:32:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:32:36.708327 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad227ae7-6fb4-46df-864c-def6fb1e946d admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:32:36.711299 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-ad227ae7-6fb4-46df-864c-def6fb1e946d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:32:36.802842 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad227ae7-6fb4-46df-864c-def6fb1e946d admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:32:36.811005 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502385ed-ae02-41ec-b174-0660bd6ebfb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d6d8e7788494f2c92ad5c183c8fa283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:32:36.812026 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502385ed-ae02-41ec-b174-0660bd6ebfb2 service swift] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:36.812483 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502385ed-ae02-41ec-b174-0660bd6ebfb2 service swift] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:36.812926 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502385ed-ae02-41ec-b174-0660bd6ebfb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:36.826582 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502385ed-ae02-41ec-b174-0660bd6ebfb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:32:36.829352 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502385ed-ae02-41ec-b174-0660bd6ebfb2 service swift] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:32:36.841205 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1439/2878] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Mar 29 20:32:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 20:32:37.730882 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce45e7-ce32-4278-8471-7b0472708d0c None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:37.731446 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce45e7-ce32-4278-8471-7b0472708d0c None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:37.731446 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce45e7-ce32-4278-8471-7b0472708d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:37.751012 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-6dce45e7-ce32-4278-8471-7b0472708d0c None None] MFA Rules not processed for user `a706b6d0163549bc80285c4158331b94`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:32:37.752230 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-6dce45e7-ce32-4278-8471-7b0472708d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:32:37.759633 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1440/2879] 10.222.0.43 () {58 vars in 967 bytes} [Tue Mar 29 20:32:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:32:37.772827 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502385ed-ae02-41ec-b174-0660bd6ebfb2 service swift] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:32:37.784509 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502385ed-ae02-41ec-b174-0660bd6ebfb2 service swift] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:32:37.789633 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd1e40-3eee-45b6-995b-c42baf11f62f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d6d8e7788494f2c92ad5c183c8fa283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:32:37.790286 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd1e40-3eee-45b6-995b-c42baf11f62f service swift] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:37.790582 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd1e40-3eee-45b6-995b-c42baf11f62f service swift] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:37.790857 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd1e40-3eee-45b6-995b-c42baf11f62f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:37.801033 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd1e40-3eee-45b6-995b-c42baf11f62f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:32:37.802868 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd1e40-3eee-45b6-995b-c42baf11f62f service swift] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:32:37.811763 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1440/2880] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Mar 29 20:32:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 20:32:38.426648 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1aeb4-471c-4a7f-bbd9-135c2a4a8895 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:38.426929 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1aeb4-471c-4a7f-bbd9-135c2a4a8895 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:38.427214 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1aeb4-471c-4a7f-bbd9-135c2a4a8895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:38.447758 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-1ac1aeb4-471c-4a7f-bbd9-135c2a4a8895 None None] MFA Rules not processed for user `a706b6d0163549bc80285c4158331b94`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:32:38.449984 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-1ac1aeb4-471c-4a7f-bbd9-135c2a4a8895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:32:38.456845 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1441/2881] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Mar 29 20:32:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 20:32:38.469820 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd1e40-3eee-45b6-995b-c42baf11f62f service swift] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:32:38.480388 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd1e40-3eee-45b6-995b-c42baf11f62f service swift] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:32:38.488693 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d7a7e-8976-40d0-a76e-69334d125e37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d6d8e7788494f2c92ad5c183c8fa283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:32:38.489383 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d7a7e-8976-40d0-a76e-69334d125e37 service swift] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:38.489671 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d7a7e-8976-40d0-a76e-69334d125e37 service swift] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:38.489990 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d7a7e-8976-40d0-a76e-69334d125e37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:38.500164 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d7a7e-8976-40d0-a76e-69334d125e37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:32:38.506844 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d7a7e-8976-40d0-a76e-69334d125e37 service swift] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:32:38.510598 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1441/2882] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Mar 29 20:32:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 20:32:39.190423 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ffa26-ffef-4a2c-901f-0f78a8b714c3 None None] REQUEST_METHOD: `POST` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:39.190965 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ffa26-ffef-4a2c-901f-0f78a8b714c3 None None] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:39.190965 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ffa26-ffef-4a2c-901f-0f78a8b714c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:39.213412 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.auth.core [None req-ee7ffa26-ffef-4a2c-901f-0f78a8b714c3 None None] MFA Rules not processed for user `a706b6d0163549bc80285c4158331b94`. Rule list: `[]` (Enabled: `True`). {{(pid=80092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:32:39.214210 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-ee7ffa26-ffef-4a2c-901f-0f78a8b714c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:32:39.221651 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1442/2883] 10.222.0.43 () {58 vars in 967 bytes} [Tue Mar 29 20:32:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:32:39.235375 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d7a7e-8976-40d0-a76e-69334d125e37 service swift] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:32:39.247033 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d7a7e-8976-40d0-a76e-69334d125e37 service swift] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:32:39.252065 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d37e0-409e-4778-b8b9-dfc9666b7837 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d6d8e7788494f2c92ad5c183c8fa283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:32:39.252872 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d37e0-409e-4778-b8b9-dfc9666b7837 service swift] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:39.253162 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d37e0-409e-4778-b8b9-dfc9666b7837 service swift] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:39.253480 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d37e0-409e-4778-b8b9-dfc9666b7837 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:39.263344 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d37e0-409e-4778-b8b9-dfc9666b7837 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:32:39.264950 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d37e0-409e-4778-b8b9-dfc9666b7837 service swift] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:32:39.273691 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1442/2884] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Mar 29 20:32:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 20:32:42.202875 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ffa26-ffef-4a2c-901f-0f78a8b714c3 None None] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:32:42.210015 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-ee7ffa26-ffef-4a2c-901f-0f78a8b714c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:32:42.280364 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ffa26-ffef-4a2c-901f-0f78a8b714c3 None None] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:32:42.285113 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a934f-68a1-4b71-bdbc-0a40c13073d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:32:42.286033 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a934f-68a1-4b71-bdbc-0a40c13073d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:42.286320 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a934f-68a1-4b71-bdbc-0a40c13073d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:42.286602 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a934f-68a1-4b71-bdbc-0a40c13073d5 admin admin] PATH_INFO: `/v3/users/b4d94d4485a94946af692e823249f411` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:42.287850 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a934f-68a1-4b71-bdbc-0a40c13073d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4d94d4485a94946af692e823249f411)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:32:42.289836 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a934f-68a1-4b71-bdbc-0a40c13073d5 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:32:42.606775 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a88a934f-68a1-4b71-bdbc-0a40c13073d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4d94d4485a94946af692e823249f411'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:42.746766 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a88a934f-68a1-4b71-bdbc-0a40c13073d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4d94d4485a94946af692e823249f411'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:42.747521 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a88a934f-68a1-4b71-bdbc-0a40c13073d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4d94d4485a94946af692e823249f411'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:42.748132 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a88a934f-68a1-4b71-bdbc-0a40c13073d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4d94d4485a94946af692e823249f411'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:42.755638 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a88a934f-68a1-4b71-bdbc-0a40c13073d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4d94d4485a94946af692e823249f411'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:42.773381 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1443/2885] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:32:42 2022] DELETE /identity/v3/users/b4d94d4485a94946af692e823249f411 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:32:42.778661 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0136a2-843f-4678-a22d-7ee70e1be824 None None] REQUEST_METHOD: `POST` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:42.779224 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0136a2-843f-4678-a22d-7ee70e1be824 None None] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:42.779359 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0136a2-843f-4678-a22d-7ee70e1be824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:42.801415 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.auth.core [None req-7b0136a2-843f-4678-a22d-7ee70e1be824 None None] MFA Rules not processed for user `5c0f0cae62ee4c75b41e0ef37bc31d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 20:32:42.802656 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-7b0136a2-843f-4678-a22d-7ee70e1be824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:32:42.871947 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1443/2886] 10.222.0.43 () {58 vars in 957 bytes} [Tue Mar 29 20:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 20:32:42.881693 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a934f-68a1-4b71-bdbc-0a40c13073d5 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:32:42.883115 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a88a934f-68a1-4b71-bdbc-0a40c13073d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:32:42.945705 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a934f-68a1-4b71-bdbc-0a40c13073d5 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:32:42.950318 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aced346-26d4-4d59-82da-45ab5783c011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:32:42.951133 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aced346-26d4-4d59-82da-45ab5783c011 service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:42.951478 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aced346-26d4-4d59-82da-45ab5783c011 service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:42.951753 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aced346-26d4-4d59-82da-45ab5783c011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:42.964535 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aced346-26d4-4d59-82da-45ab5783c011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:32:42.966054 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aced346-26d4-4d59-82da-45ab5783c011 service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:32:42.976190 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1444/2887] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 20:32:43.241809 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0136a2-843f-4678-a22d-7ee70e1be824 None None] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:32:43.243336 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-7b0136a2-843f-4678-a22d-7ee70e1be824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:32:43.263379 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0136a2-843f-4678-a22d-7ee70e1be824 None None] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:32:43.270337 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a12705-3cd6-4ec2-907c-74f9cbf8ed87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:32:43.271552 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a12705-3cd6-4ec2-907c-74f9cbf8ed87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:43.272035 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a12705-3cd6-4ec2-907c-74f9cbf8ed87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:43.272540 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a12705-3cd6-4ec2-907c-74f9cbf8ed87 admin admin] PATH_INFO: `/v3/projects/49220b2aae834a34a712db331db46a9c` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:43.274072 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a12705-3cd6-4ec2-907c-74f9cbf8ed87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49220b2aae834a34a712db331db46a9c)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:32:43.284686 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a12705-3cd6-4ec2-907c-74f9cbf8ed87 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:32:43.402818 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a3a12705-3cd6-4ec2-907c-74f9cbf8ed87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49220b2aae834a34a712db331db46a9c', 'request_id': 'req-a3a12705-3cd6-4ec2-907c-74f9cbf8ed87'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:43.474325 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a3a12705-3cd6-4ec2-907c-74f9cbf8ed87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49220b2aae834a34a712db331db46a9c', 'request_id': 'req-a3a12705-3cd6-4ec2-907c-74f9cbf8ed87'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:43.482256 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a3a12705-3cd6-4ec2-907c-74f9cbf8ed87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49220b2aae834a34a712db331db46a9c', 'request_id': 'req-a3a12705-3cd6-4ec2-907c-74f9cbf8ed87'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:43.495983 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a3a12705-3cd6-4ec2-907c-74f9cbf8ed87 admin admin] The token cache is being invalidate because project 49220b2aae834a34a712db331db46a9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:32:43.496302 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a3a12705-3cd6-4ec2-907c-74f9cbf8ed87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:43.497183 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-a3a12705-3cd6-4ec2-907c-74f9cbf8ed87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:43.509343 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1444/2888] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:32:43 2022] DELETE /identity/v3/projects/49220b2aae834a34a712db331db46a9c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:32:49.803549 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aced346-26d4-4d59-82da-45ab5783c011 service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:32:49.844339 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aced346-26d4-4d59-82da-45ab5783c011 service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:32:49.896349 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8ff9b-a551-4bd6-a5a6-373b5f4d1a3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bdaa02b1b14be3837b337fbf6e0eb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:32:49.897013 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8ff9b-a551-4bd6-a5a6-373b5f4d1a3b service neutron] REQUEST_METHOD: `GET` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:49.897319 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8ff9b-a551-4bd6-a5a6-373b5f4d1a3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:49.897607 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8ff9b-a551-4bd6-a5a6-373b5f4d1a3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:49.899410 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-3da8ff9b-a551-4bd6-a5a6-373b5f4d1a3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:32:49.997479 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8ff9b-a551-4bd6-a5a6-373b5f4d1a3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:32:49.998917 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8ff9b-a551-4bd6-a5a6-373b5f4d1a3b service neutron] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:32:50.009054 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1445/2889] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:32:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 20:32:57.651798 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a12705-3cd6-4ec2-907c-74f9cbf8ed87 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:32:57.653273 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-a3a12705-3cd6-4ec2-907c-74f9cbf8ed87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:32:57.730347 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a12705-3cd6-4ec2-907c-74f9cbf8ed87 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:32:57.734940 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bfad4-9230-445c-91fd-f6642606a8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:32:57.735822 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bfad4-9230-445c-91fd-f6642606a8f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:57.736110 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bfad4-9230-445c-91fd-f6642606a8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:57.736369 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bfad4-9230-445c-91fd-f6642606a8f7 admin admin] PATH_INFO: `/v3/users/a0ce08fda1014dff843c40970cf3af11` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:57.737880 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bfad4-9230-445c-91fd-f6642606a8f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0ce08fda1014dff843c40970cf3af11)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:32:57.741494 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bfad4-9230-445c-91fd-f6642606a8f7 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:32:57.914216 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-336bfad4-9230-445c-91fd-f6642606a8f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0ce08fda1014dff843c40970cf3af11'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:57.998849 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-336bfad4-9230-445c-91fd-f6642606a8f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0ce08fda1014dff843c40970cf3af11'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:58.003179 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-336bfad4-9230-445c-91fd-f6642606a8f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0ce08fda1014dff843c40970cf3af11'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:58.007520 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-336bfad4-9230-445c-91fd-f6642606a8f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0ce08fda1014dff843c40970cf3af11'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:58.020811 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-336bfad4-9230-445c-91fd-f6642606a8f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0ce08fda1014dff843c40970cf3af11'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:58.030404 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1445/2890] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:32:57 2022] DELETE /identity/v3/users/a0ce08fda1014dff843c40970cf3af11 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:32:58.267307 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8ff9b-a551-4bd6-a5a6-373b5f4d1a3b service neutron] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:32:58.298486 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8ff9b-a551-4bd6-a5a6-373b5f4d1a3b service neutron] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:32:58.354524 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be76be-1993-416c-a0aa-d5ecf4397d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:32:58.355384 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be76be-1993-416c-a0aa-d5ecf4397d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:58.355660 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be76be-1993-416c-a0aa-d5ecf4397d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:58.355930 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be76be-1993-416c-a0aa-d5ecf4397d17 admin admin] PATH_INFO: `/v3/projects/f9800a1b31b34882beb7e5e6dcb78fd6` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:58.357115 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be76be-1993-416c-a0aa-d5ecf4397d17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9800a1b31b34882beb7e5e6dcb78fd6)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:32:58.359057 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be76be-1993-416c-a0aa-d5ecf4397d17 admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:32:58.454525 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a2be76be-1993-416c-a0aa-d5ecf4397d17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9800a1b31b34882beb7e5e6dcb78fd6', 'request_id': 'req-a2be76be-1993-416c-a0aa-d5ecf4397d17'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:58.460005 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a2be76be-1993-416c-a0aa-d5ecf4397d17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9800a1b31b34882beb7e5e6dcb78fd6', 'request_id': 'req-a2be76be-1993-416c-a0aa-d5ecf4397d17'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:58.467540 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a2be76be-1993-416c-a0aa-d5ecf4397d17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9800a1b31b34882beb7e5e6dcb78fd6', 'request_id': 'req-a2be76be-1993-416c-a0aa-d5ecf4397d17'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:58.528443 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a2be76be-1993-416c-a0aa-d5ecf4397d17 admin admin] The token cache is being invalidate because project f9800a1b31b34882beb7e5e6dcb78fd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:32:58.528687 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a2be76be-1993-416c-a0aa-d5ecf4397d17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:58.529277 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-a2be76be-1993-416c-a0aa-d5ecf4397d17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:58.530871 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1446/2891] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:32:58 2022] DELETE /identity/v3/projects/f9800a1b31b34882beb7e5e6dcb78fd6 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:32:58.534942 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bfad4-9230-445c-91fd-f6642606a8f7 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:32:58.536344 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-336bfad4-9230-445c-91fd-f6642606a8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:32:58.549763 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bfad4-9230-445c-91fd-f6642606a8f7 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:32:58.608333 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa23f9-aaac-41fd-8b26-fcab150ccfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:32:58.609339 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa23f9-aaac-41fd-8b26-fcab150ccfd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:58.609633 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa23f9-aaac-41fd-8b26-fcab150ccfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:58.609919 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa23f9-aaac-41fd-8b26-fcab150ccfd8 admin admin] PATH_INFO: `/v3/users/7e9f53378a3247858997c804b376426e` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:58.611205 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa23f9-aaac-41fd-8b26-fcab150ccfd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e9f53378a3247858997c804b376426e)` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:32:58.613195 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa23f9-aaac-41fd-8b26-fcab150ccfd8 admin admin] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:32:58.778750 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-9bfa23f9-aaac-41fd-8b26-fcab150ccfd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e9f53378a3247858997c804b376426e'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:58.844662 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-9bfa23f9-aaac-41fd-8b26-fcab150ccfd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e9f53378a3247858997c804b376426e'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:58.845315 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-9bfa23f9-aaac-41fd-8b26-fcab150ccfd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e9f53378a3247858997c804b376426e'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:58.852647 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-9bfa23f9-aaac-41fd-8b26-fcab150ccfd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e9f53378a3247858997c804b376426e'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:58.866951 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.notifications [None req-9bfa23f9-aaac-41fd-8b26-fcab150ccfd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e9f53378a3247858997c804b376426e'} {{(pid=80093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:58.874459 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1446/2892] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Mar 29 20:32:58 2022] DELETE /identity/v3/users/7e9f53378a3247858997c804b376426e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:32:59.110356 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be76be-1993-416c-a0aa-d5ecf4397d17 admin admin] Authenticating user token {{(pid=80092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:32:59.111859 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.fernet_utils [None req-a2be76be-1993-416c-a0aa-d5ecf4397d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:32:59.127789 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be76be-1993-416c-a0aa-d5ecf4397d17 admin admin] Validating token access rules against request {{(pid=80092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:32:59.189599 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61238966-df8d-4f09-88fa-2df75e4a971f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0f0cae62ee4c75b41e0ef37bc31d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a15fd3ff4f1b47218a3a97159af6b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:32:59.191276 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61238966-df8d-4f09-88fa-2df75e4a971f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:32:59.191276 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61238966-df8d-4f09-88fa-2df75e4a971f admin admin] SCRIPT_NAME: `/identity` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:32:59.191276 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61238966-df8d-4f09-88fa-2df75e4a971f admin admin] PATH_INFO: `/v3/projects/4d4ba541303f4c3cbbbb479c169d8bd4` {{(pid=80092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:32:59.192284 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61238966-df8d-4f09-88fa-2df75e4a971f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d4ba541303f4c3cbbbb479c169d8bd4)` {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:32:59.194552 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61238966-df8d-4f09-88fa-2df75e4a971f admin admin] RBAC: Authorization granted {{(pid=80092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:32:59.304232 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-61238966-df8d-4f09-88fa-2df75e4a971f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d4ba541303f4c3cbbbb479c169d8bd4', 'request_id': 'req-61238966-df8d-4f09-88fa-2df75e4a971f'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:59.311188 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-61238966-df8d-4f09-88fa-2df75e4a971f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d4ba541303f4c3cbbbb479c169d8bd4', 'request_id': 'req-61238966-df8d-4f09-88fa-2df75e4a971f'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:59.317978 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-61238966-df8d-4f09-88fa-2df75e4a971f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d4ba541303f4c3cbbbb479c169d8bd4', 'request_id': 'req-61238966-df8d-4f09-88fa-2df75e4a971f'} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:59.411030 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-61238966-df8d-4f09-88fa-2df75e4a971f admin admin] The token cache is being invalidate because project 4d4ba541303f4c3cbbbb479c169d8bd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 20:32:59.411389 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-61238966-df8d-4f09-88fa-2df75e4a971f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:59.411908 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: DEBUG keystone.notifications [None req-61238966-df8d-4f09-88fa-2df75e4a971f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 20:32:59.413735 dv-cinder-784815-3-iscsi devstack@keystone.service[80092]: [pid: 80092|app: 0|req: 1447/2893] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Mar 29 20:32:59 2022] DELETE /identity/v3/projects/4d4ba541303f4c3cbbbb479c169d8bd4 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 20:33:44.396915 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa23f9-aaac-41fd-8b26-fcab150ccfd8 admin admin] Authenticating user token {{(pid=80093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 20:33:44.398376 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-9bfa23f9-aaac-41fd-8b26-fcab150ccfd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:33:44.490037 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa23f9-aaac-41fd-8b26-fcab150ccfd8 admin admin] Validating token access rules against request {{(pid=80093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 20:33:44.548039 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852c5e1-4729-4189-878d-396775d4f7f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef0001e91524a13a9ca601a601de66b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec1f2c5cb900473da1083830387e3ff4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 20:33:44.548704 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852c5e1-4729-4189-878d-396775d4f7f6 service placement] REQUEST_METHOD: `GET` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 20:33:44.548992 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852c5e1-4729-4189-878d-396775d4f7f6 service placement] SCRIPT_NAME: `/identity` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 20:33:44.549267 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852c5e1-4729-4189-878d-396775d4f7f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 20:33:44.551095 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.fernet_utils [None req-c852c5e1-4729-4189-878d-396775d4f7f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 20:33:44.562710 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852c5e1-4729-4189-878d-396775d4f7f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 20:33:44.564287 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852c5e1-4729-4189-878d-396775d4f7f6 service placement] RBAC: Authorization granted {{(pid=80093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 20:33:44.575865 dv-cinder-784815-3-iscsi devstack@keystone.service[80093]: [pid: 80093|app: 0|req: 1447/2894] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Mar 29 20:33:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)